-- Logs begin at Wed 2022-07-06 19:36:00 UTC, end at Wed 2022-07-06 20:59:19 UTC. -- Jul 06 20:27:21.411619 dv-cinder-848900-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 06 20:27:21.418860 dv-cinder-848900-2-smb devstack@keystone.service[80513]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 06 20:27:21.421974 dv-cinder-848900-2-smb devstack@keystone.service[80513]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 6 20:27:21 2022] *** Jul 06 20:27:21.421974 dv-cinder-848900-2-smb devstack@keystone.service[80513]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 06 20:27:21.421974 dv-cinder-848900-2-smb devstack@keystone.service[80513]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 06 20:27:21.421974 dv-cinder-848900-2-smb devstack@keystone.service[80513]: nodename: dv-cinder-848900-2-smb Jul 06 20:27:21.421974 dv-cinder-848900-2-smb devstack@keystone.service[80513]: machine: x86_64 Jul 06 20:27:21.421974 dv-cinder-848900-2-smb devstack@keystone.service[80513]: clock source: unix Jul 06 20:27:21.421974 dv-cinder-848900-2-smb devstack@keystone.service[80513]: pcre jit disabled Jul 06 20:27:21.421974 dv-cinder-848900-2-smb devstack@keystone.service[80513]: detected number of CPU cores: 4 Jul 06 20:27:21.421974 dv-cinder-848900-2-smb devstack@keystone.service[80513]: current working directory: / Jul 06 20:27:21.421974 dv-cinder-848900-2-smb devstack@keystone.service[80513]: detected binary path: /usr/bin/uwsgi-core Jul 06 20:27:21.421974 dv-cinder-848900-2-smb devstack@keystone.service[80513]: your processes number limit is 47680 Jul 06 20:27:21.421974 dv-cinder-848900-2-smb devstack@keystone.service[80513]: your memory page size is 4096 bytes Jul 06 20:27:21.422725 dv-cinder-848900-2-smb devstack@keystone.service[80513]: detected max file descriptor number: 2048 Jul 06 20:27:21.422725 dv-cinder-848900-2-smb devstack@keystone.service[80513]: lock engine: pthread robust mutexes Jul 06 20:27:21.422725 dv-cinder-848900-2-smb devstack@keystone.service[80513]: thunder lock: enabled Jul 06 20:27:21.422725 dv-cinder-848900-2-smb devstack@keystone.service[80513]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 06 20:27:21.422725 dv-cinder-848900-2-smb devstack@keystone.service[80513]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 06 20:27:21.467677 dv-cinder-848900-2-smb devstack@keystone.service[80513]: Python main interpreter initialized at 0x55c4b0bf59c0 Jul 06 20:27:21.467677 dv-cinder-848900-2-smb devstack@keystone.service[80513]: python threads support enabled Jul 06 20:27:21.467677 dv-cinder-848900-2-smb devstack@keystone.service[80513]: your server socket listen backlog is limited to 100 connections Jul 06 20:27:21.467677 dv-cinder-848900-2-smb devstack@keystone.service[80513]: your mercy for graceful operations on workers is 90 seconds Jul 06 20:27:21.468050 dv-cinder-848900-2-smb devstack@keystone.service[80513]: mapped 403077 bytes (393 KB) for 2 cores Jul 06 20:27:21.468125 dv-cinder-848900-2-smb devstack@keystone.service[80513]: *** Operational MODE: preforking *** Jul 06 20:27:21.468360 dv-cinder-848900-2-smb devstack@keystone.service[80513]: *** uWSGI is running in multiple interpreter mode *** Jul 06 20:27:21.468360 dv-cinder-848900-2-smb devstack@keystone.service[80513]: spawned uWSGI master process (pid: 80513) Jul 06 20:27:21.468567 dv-cinder-848900-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 06 20:27:21.469140 dv-cinder-848900-2-smb devstack@keystone.service[80513]: spawned uWSGI worker 1 (pid: 80523, cores: 1) Jul 06 20:27:21.469626 dv-cinder-848900-2-smb devstack@keystone.service[80513]: spawned uWSGI worker 2 (pid: 80524, cores: 1) Jul 06 20:27:21.469928 dv-cinder-848900-2-smb devstack@keystone.service[80513]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 06 20:27:26.919652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 20:27:26.919652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: from cryptography.utils import int_from_bytes Jul 06 20:27:26.920408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 20:27:26.920408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: from cryptography.utils import int_from_bytes Jul 06 20:27:26.920520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 20:27:26.920520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: from cryptography.utils import int_from_bytes Jul 06 20:27:26.920922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 20:27:26.920922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: from cryptography.utils import int_from_bytes Jul 06 20:27:26.969675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 20:27:26.969885 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 20:27:26.970103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 20:27:26.970200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] command line args: [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 20:27:26.970320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 20:27:26.970409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 20:27:26.970539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] command line args: [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 20:27:26.970623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ================================================================================ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 20:27:26.970841 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 20:27:26.970925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] admin_token = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.971023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ================================================================================ {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 20:27:26.971135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] config_dir = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.971317 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] admin_token = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.971396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.971518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] config_source = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.971600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] config_dir = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.971702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] debug = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.971795 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.971901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.972145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] config_source = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.972145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] debug = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.972271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.972329 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.972414 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.972560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.972671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.972755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.972918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.972996 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.973151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.973235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.973330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_config_append = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.973410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.973509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.973580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_config_append = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.973670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_dir = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.973746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.973842 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_file = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.973921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_dir = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.974591 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_file = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.974702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.974866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.975048 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.975155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.975344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.975447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.975556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.975657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.975757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.975857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.975965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.976070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.976171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.976269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.976395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.976504 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.976630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.976737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.976865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.976965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.977097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.977207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.977332 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.977431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.977568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.977681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.977816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.977928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.978064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.978335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.978437 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.978540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] publish_errors = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.978748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.978858 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.978982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.979106 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] publish_errors = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.979287 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.979404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.979515 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.979625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.979625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.979849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.979849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] standard_threads = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.980002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.980072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.980146 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.980317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.980397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] standard_threads = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.980494 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.980660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.980737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_journal = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.980835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_json = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.980919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.980996 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_stderr = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.981088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.981165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_syslog = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.981269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] use_journal = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.981392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.981470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] use_json = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.981611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] use_stderr = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.981693 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.981790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] use_syslog = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.981866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.982024 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 20:27:26.982109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.982284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.982368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.982527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.982610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.982797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.982884 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.983039 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.983122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.983312 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.983391 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.983556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.983640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.983802 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.983884 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.984038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.984114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.984274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.984357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.984521 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.984611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.984758 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.984835 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.984990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.985073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.985239 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.985323 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.985475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.985551 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.985726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.985811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.985975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.986059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.986215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.986298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.986449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.986532 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.986703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.986781 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.986949 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.987068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.987202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.987349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.987463 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.987607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.987828 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.987911 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.988061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.988138 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.988294 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.988386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.988535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.988662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.988776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.988851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.989016 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.989099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.989246 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.989334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.989478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.989560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.990349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.990516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.990578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.990740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.990873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.991003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.991239 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.991320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.991484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.991737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.991824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.991972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.992210 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.992290 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.992450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.992625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.992689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.992843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.992922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.993075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.993157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.993320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.993401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.993562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.993643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.993804 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.993891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.994043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.994123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.994283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.994371 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.994510 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.994589 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.994750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.994838 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.994985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.995065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.995256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.995338 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.995493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.995580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.995733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.995815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.995962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.996070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.997283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.997390 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.997457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.997516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.997582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.997642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.997708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.997778 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.997778 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.997882 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.997950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.998010 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.998010 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.998130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.998194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.998262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.998262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.998379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.998436 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.998501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.998570 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.998629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.998716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.998901 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.999051 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.999132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.999337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.999416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.999534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.999616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.999694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.999872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:26.999963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.000122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.000203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.000363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.000482 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.000601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.000682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.000837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.000955 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.001073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.001153 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.001311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.001427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.001547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.001624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.001786 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.001866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.002022 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.002102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.002258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.002335 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.002493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.002572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.002727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.002804 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.002961 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.003047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.003215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.003297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.003478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.003579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.003722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.003807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.003953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.004030 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.004174 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.004248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.004419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.004497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.004654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.004740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.004891 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.004981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.005122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.005255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.005423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.005546 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.005655 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.005731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.005875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.005956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.006110 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.006188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.006351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.006477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.006589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.006670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.006829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.006906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.007067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.007145 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.007340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.007419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.007601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.007683 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.007846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.007924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.008086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.external = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.008166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.008321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.008399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.external = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.008555 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.008639 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.008844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.008931 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.009077 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.009156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.password = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.009313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.token = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.009395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.password = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.009545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.token = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.009630 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.009779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.009856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.010014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.010090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.010249 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.010335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.010484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.010562 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.010737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.010824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.010966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.011052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.011221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.011305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.011460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.011538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.011711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.011803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.011958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.012037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.012197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.012276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.012434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.012519 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.012675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.012753 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.012908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.012984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.013175 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.013261 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.013413 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.013490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.013658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.013735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.013915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.014002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.014173 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.014252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.014431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.014508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.014672 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.014757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.014922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.014999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.015158 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.015277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.015424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.015512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.015660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.015737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.015908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.015987 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.016139 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.016224 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.016375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.016452 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.016616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.016693 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.016849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.016935 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.017100 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.017178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.017336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.017413 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.017584 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.017669 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.017824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.017902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.018058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.018135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.018294 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.018444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.018526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.018598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.018769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.018847 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.019002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.019081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.019262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.019354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.019500 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.019578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.019733 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.019811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.019971 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.020050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.020220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.020299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.020453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.020531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.020686 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.020764 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.020945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.021030 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.021177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.021256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.021422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.021565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.021671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.021823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.021910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.022086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.022166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.022339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.022418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.022620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.022706 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.022862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.023217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.023394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.023473 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.023626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.023726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.023869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.023991 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.024107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.024186 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.024343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.024430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.024586 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.024666 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.024826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.024904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.025075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.025161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.025309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.025389 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.025558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.025636 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.025806 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.025895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.026041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.026127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.026289 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.026367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.026534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.026619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.026769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.026846 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.027009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.027087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.027263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.027357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.027503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.027589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.027742 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.027820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.027984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.028070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.028222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.028301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.028461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.028539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.028712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.028798 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.028962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.029039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.029191 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.029268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.029421 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.029508 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.029668 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.029745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.029916 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.029993 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.030150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.030236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.030387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.030471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.030620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.030698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.030851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.030937 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.031089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.031179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.031371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.031449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.031604 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.031685 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.031853 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.031930 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.032098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.032175 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.032346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.032495 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.032575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.032635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.032798 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.032877 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.033031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.033110 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.033265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.033342 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.033499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.033576 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.033730 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.033815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.033976 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.034054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.034224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.034301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.034469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.034548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.034715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.034795 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.034961 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.035038 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.035224 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.035307 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.035456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.035533 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.035693 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.035771 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.035928 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.036007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.036162 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.036240 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.036398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.036978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.037194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.037334 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.037562 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.037812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.037890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.038074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.038285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.038365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.038549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.038780 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.038858 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.039019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.039271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.039352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.039525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.039749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.039828 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.039995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.040085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.040235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.040317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.040479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.040557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.040733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.040820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.040986 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.041065 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.041236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.041315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.041488 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.041575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.041740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.041820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.041978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.042056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.042231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.042318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.042471 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.042550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.042711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.042790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.042948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] role.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.043097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.043201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.043277 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] role.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.043440 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.043518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.043682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.043772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.043926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.044012 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.044166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] role.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.044245 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.044415 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.044500 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] role.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.044646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.044724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.044898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.044976 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.045145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.045230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.045395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.045473 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.045629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.045707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.045879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.045958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.046125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.046203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.046370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.046447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.046617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.046696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.046848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.047018 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.047097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.047282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.047375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.047537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.047617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.047790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.047868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.048042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.048226 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.048306 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.048466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.048545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.048721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.048799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.048973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.049053 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.049224 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.049302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.049456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.049534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.049692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.049778 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.049926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.050006 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.050183 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.050260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.050425 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.050505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.050657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.050736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.050891 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.050977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.051123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.051246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.051380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.051458 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.051619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.051710 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.051861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.051940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.052169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.052751 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.052996 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.053090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.053238 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.053317 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.053480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.053558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.053721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.053808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.053967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.054045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.054204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.054282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.054455 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.054540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.054699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.054779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.054940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.055017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.055189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.055281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.055440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.055518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.055690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.055768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.055925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.056012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.056163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.056241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.056399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.056478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.056648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.056734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.connection = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.056899 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.056990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.057130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.057209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.057372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.057451 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.057632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.057717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.057869 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.057948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.058108 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.058196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.058347 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.058426 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.058585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.058664 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.058829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.058909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.059062 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.059140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.059329 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.059409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.059565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.059643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.059802 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.059880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.060040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.060118 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.060275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.060352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.060512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.060589 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.060745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.060824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.060981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.061058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.061152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 20:27:27.061232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.061456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.061690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.061930 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.062165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 20:27:27.062334 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 20:27:27.092396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.092626 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.092777 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.092862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.093014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.093248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.101743 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.102081 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.130409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.130546 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.130759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.130865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.278112 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.281640 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.327314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.327546 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.328083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.328323 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.391549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.391781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.391868 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.392009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.392116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.392233 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.392318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.392453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.392545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.392670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.392754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.392888 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.418169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.418396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.418505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.418667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.418752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.418899 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.418983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.419121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.419226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.419363 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.419447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.419578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.419662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.419797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.431442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.432370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.444265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.444526 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.444749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.444840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.444978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.445062 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.445202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.445296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.445422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.445505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.445638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.445719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.445854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.446069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 20:27:27.463663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.463875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 20:27:27.464215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.464297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.464418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 20:27:27.464502 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 20:27:27.464687 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.464771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.464954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.465037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 20:27:27.465214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.465297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.465469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.465550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.465729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.465986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.476644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.476914 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.476999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.477182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.477264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.477450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.477532 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.477733 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.485884 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.486042 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.489208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.489342 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.489489 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.490177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.490315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.490462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.490602 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.490785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.490887 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.491123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.491234 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.491413 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.491495 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.491683 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.491763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.491951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.492038 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.492216 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.492295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.492481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.492560 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.492747 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.519324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.519446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.521473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.521626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.521765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.521905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.527319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.527455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.527601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.527737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.527888 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.528180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.535324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.535446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.535610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.535731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.540397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.540498 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.540690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.540777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.540970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.541054 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.541253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.541337 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.541530 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.541611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.541799 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.541882 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.542066 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.542149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.542331 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.542423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.561438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.561609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.561696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.561888 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.566303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.566440 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.570059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.570353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.572288 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.572686 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.575543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.577883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.579394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.581552 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.585889 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.585889 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.585889 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.585889 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.585889 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.585889 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.586256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.586256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.586422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.586806 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.587096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.589024 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.605339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.605637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.605905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.606170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.607520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.607816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.608086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.608353 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.614142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.615893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.616170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.616378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.618095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.618373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.619367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.619648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.619930 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.620224 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.620569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.621570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.621855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.622140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.622425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.622763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.633949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.634233 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.634516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.634808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.635091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.636055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.636338 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.636626 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.636820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.636910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.637114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.637204 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.637457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.637734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.655802 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.658184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.659060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.662083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.663057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.664843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.665513 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.666485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.666769 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.667061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.667145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.668920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.669201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.669491 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.675544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.676901 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.677243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.678563 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.680694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.680986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.681380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.681661 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.681903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.682196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.682483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.682762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.690783 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.691071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.691379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.692123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.692410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.692733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.699326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.699609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.699892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.700166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.700438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.700646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 20:27:27.700826 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.700927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.701106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.701192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.701383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.701465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.701662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.701747 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.701937 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.702034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.702208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.702294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.702471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.702554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.702745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.702861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.703011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.703134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.703438 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.703706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.703984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.704252 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 20:27:27.741196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c4b0bf59c0 pid: 80524 (default app) Jul 06 20:27:27.742793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c4b0bf59c0 pid: 80523 (default app) Jul 06 20:27:27.744575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1809-3290-40c1-9531-b74f2c823a6d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:27.744871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1809-3290-40c1-9531-b74f2c823a6d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:27.745154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1809-3290-40c1-9531-b74f2c823a6d None None] PATH_INFO: `/v3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:27.749385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Wed Jul 6 20:27:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:35.480529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92bf1-0fa8-4b91-8ea7-31d70dc5f1c4 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:35.481097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92bf1-0fa8-4b91-8ea7-31d70dc5f1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:35.481097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92bf1-0fa8-4b91-8ea7-31d70dc5f1c4 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:35.485475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:27:35.490960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae59b8-c4a7-4b6e-b778-ba708e0199b7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:35.491398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae59b8-c4a7-4b6e-b778-ba708e0199b7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:35.491561 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae59b8-c4a7-4b6e-b778-ba708e0199b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:35.560016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: INFO dbcounter [None req-d4ae59b8-c4a7-4b6e-b778-ba708e0199b7 None None] Registered counter for database keystone Jul 06 20:27:35.581172 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG oslo_db.sqlalchemy.engines [None req-d4ae59b8-c4a7-4b6e-b778-ba708e0199b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 20:27:35.588255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writer thread running {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 20:27:35.762102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG passlib.handlers.bcrypt [None req-d4ae59b8-c4a7-4b6e-b778-ba708e0199b7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80524) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 06 20:27:35.762434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG passlib.handlers.bcrypt [None req-d4ae59b8-c4a7-4b6e-b778-ba708e0199b7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80524) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 06 20:27:35.816803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d4ae59b8-c4a7-4b6e-b778-ba708e0199b7 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:35.818444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d4ae59b8-c4a7-4b6e-b778-ba708e0199b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:35.939011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 06 20:27:36.137673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92bf1-0fa8-4b91-8ea7-31d70dc5f1c4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:36.206954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: INFO dbcounter [None req-4be92bf1-0fa8-4b91-8ea7-31d70dc5f1c4 None None] Registered counter for database keystone Jul 06 20:27:36.226478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG oslo_db.sqlalchemy.engines [None req-4be92bf1-0fa8-4b91-8ea7-31d70dc5f1c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 20:27:36.232556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writer thread running {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 20:27:36.354125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92bf1-0fa8-4b91-8ea7-31d70dc5f1c4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:36.358372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126b9c3-bc9b-446e-a754-e10f20ab2f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:36.359035 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b9c3-bc9b-446e-a754-e10f20ab2f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:36.359349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b9c3-bc9b-446e-a754-e10f20ab2f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:36.359625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b9c3-bc9b-446e-a754-e10f20ab2f9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:36.368132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126b9c3-bc9b-446e-a754-e10f20ab2f9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:36.420242 dv-cinder-848900-2-smb devstack@keystone.service[80523]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7126b9c3-bc9b-446e-a754-e10f20ab2f9e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 06 20:27:36.420516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126b9c3-bc9b-446e-a754-e10f20ab2f9e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:36.430549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Wed Jul 6 20:27:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 20:27:36.436527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae59b8-c4a7-4b6e-b778-ba708e0199b7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:36.450771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae59b8-c4a7-4b6e-b778-ba708e0199b7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:36.455138 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91e0ce-76f4-4cb2-b285-affcd90494fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:36.456287 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91e0ce-76f4-4cb2-b285-affcd90494fb admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:36.456575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91e0ce-76f4-4cb2-b285-affcd90494fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:36.456851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91e0ce-76f4-4cb2-b285-affcd90494fb admin admin] PATH_INFO: `/v3/projects/371b1675f3c34bee9789abbf8b4d7fc5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:36.461620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91e0ce-76f4-4cb2-b285-affcd90494fb admin admin] RBAC: Authorizing `identity:get_project(project_id=371b1675f3c34bee9789abbf8b4d7fc5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:36.511495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3d91e0ce-76f4-4cb2-b285-affcd90494fb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 06 20:27:36.512040 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91e0ce-76f4-4cb2-b285-affcd90494fb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:36.516381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Wed Jul 6 20:27:36 2022] GET /identity/v3/projects/371b1675f3c34bee9789abbf8b4d7fc5 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:27:38.514001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ca396-4f34-42a8-822a-c49c7396c27d None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:38.514544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ca396-4f34-42a8-822a-c49c7396c27d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:38.514544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ca396-4f34-42a8-822a-c49c7396c27d None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:38.518688 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:38.524750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49daa89a-b2a9-433f-81e9-59e126ddad70 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:38.525151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49daa89a-b2a9-433f-81e9-59e126ddad70 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:38.525309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49daa89a-b2a9-433f-81e9-59e126ddad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:38.543594 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-49daa89a-b2a9-433f-81e9-59e126ddad70 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:38.545115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-49daa89a-b2a9-433f-81e9-59e126ddad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:38.553635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 06 20:27:38.577388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ca396-4f34-42a8-822a-c49c7396c27d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:38.591441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ca396-4f34-42a8-822a-c49c7396c27d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:38.595793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b0fff-86c5-4236-8b05-d914ac131d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:38.596436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b0fff-86c5-4236-8b05-d914ac131d6b admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:38.596717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b0fff-86c5-4236-8b05-d914ac131d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:38.596995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b0fff-86c5-4236-8b05-d914ac131d6b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:38.605282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b0fff-86c5-4236-8b05-d914ac131d6b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:38.607046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b0fff-86c5-4236-8b05-d914ac131d6b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:38.616492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Wed Jul 6 20:27:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:27:38.622027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49daa89a-b2a9-433f-81e9-59e126ddad70 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:38.631905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49daa89a-b2a9-433f-81e9-59e126ddad70 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:38.636346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce239a-5752-4bd9-a826-39ae9c718cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:38.637209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce239a-5752-4bd9-a826-39ae9c718cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:38.637554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce239a-5752-4bd9-a826-39ae9c718cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:38.637838 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce239a-5752-4bd9-a826-39ae9c718cd3 admin admin] PATH_INFO: `/v3/users/cfed129aafe54696bb42f388ec9baac7` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:38.639263 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce239a-5752-4bd9-a826-39ae9c718cd3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cfed129aafe54696bb42f388ec9baac7)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:38.641102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce239a-5752-4bd9-a826-39ae9c718cd3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:38.642673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Wed Jul 6 20:27:38 2022] GET /identity/v3/users/cfed129aafe54696bb42f388ec9baac7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:40.740145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128df75-acf6-491c-9c79-ee05b464fdb1 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:40.740648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128df75-acf6-491c-9c79-ee05b464fdb1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:40.740750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128df75-acf6-491c-9c79-ee05b464fdb1 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:40.742068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:27:40.744923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aef55-4379-42d9-82c1-badd692a2a9b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:40.745321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aef55-4379-42d9-82c1-badd692a2a9b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:40.745601 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aef55-4379-42d9-82c1-badd692a2a9b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:40.746958 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:40.747075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f93ea-2733-4661-88c7-1c5506987868 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:40.747391 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f93ea-2733-4661-88c7-1c5506987868 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:40.747674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f93ea-2733-4661-88c7-1c5506987868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:40.751723 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa085d7-412a-4a94-8e19-503875e67375 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:40.752009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa085d7-412a-4a94-8e19-503875e67375 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:40.752289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa085d7-412a-4a94-8e19-503875e67375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:40.768933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4fa085d7-412a-4a94-8e19-503875e67375 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:40.770702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4fa085d7-412a-4a94-8e19-503875e67375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:40.788812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG passlib.handlers.bcrypt [None req-aa1f93ea-2733-4661-88c7-1c5506987868 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80523) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 06 20:27:40.789237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG passlib.handlers.bcrypt [None req-aa1f93ea-2733-4661-88c7-1c5506987868 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80523) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 06 20:27:40.838401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-aa1f93ea-2733-4661-88c7-1c5506987868 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:40.840407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-aa1f93ea-2733-4661-88c7-1c5506987868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:40.851926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 7/12] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:27:40.874218 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa085d7-412a-4a94-8e19-503875e67375 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:40.897796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:40.944609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 6/13] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:27:40.967559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f93ea-2733-4661-88c7-1c5506987868 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:40.977299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa085d7-412a-4a94-8e19-503875e67375 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:41.012097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf525a-41df-412c-aab3-e842a813ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:41.012752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf525a-41df-412c-aab3-e842a813ac07 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:41.013043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf525a-41df-412c-aab3-e842a813ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:41.013326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf525a-41df-412c-aab3-e842a813ac07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:41.068546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f93ea-2733-4661-88c7-1c5506987868 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:41.071034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:41.081836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf525a-41df-412c-aab3-e842a813ac07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:41.084025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf525a-41df-412c-aab3-e842a813ac07 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:41.107118 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:41.108382 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11126628-e21f-47ed-9d8e-8c694f70c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:41.109004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11126628-e21f-47ed-9d8e-8c694f70c4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:41.109301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11126628-e21f-47ed-9d8e-8c694f70c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:41.109634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11126628-e21f-47ed-9d8e-8c694f70c4a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:41.122187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11126628-e21f-47ed-9d8e-8c694f70c4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-11126628-e21f-47ed-9d8e-8c694f70c4a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:27:41.134096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:27:41.135034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:27:41.135885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:27:41.135885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:27:41.135885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:27:41.135885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:27:41.135885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:27:41.135885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:27:41.135885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:27:41.135885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:27:41.135885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:27:41.135885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:27:41.135885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:27:41.135885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:27:41.135885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:27:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:27:41.141165 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11126628-e21f-47ed-9d8e-8c694f70c4a7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:41.184946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 8/15] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:27:41.190213 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf525a-41df-412c-aab3-e842a813ac07 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:41.240246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11126628-e21f-47ed-9d8e-8c694f70c4a7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:41.273477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c0591-e25d-49c1-8dd1-7a6934d8dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:41.274139 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c0591-e25d-49c1-8dd1-7a6934d8dc97 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:41.274420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c0591-e25d-49c1-8dd1-7a6934d8dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:41.274694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c0591-e25d-49c1-8dd1-7a6934d8dc97 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:41.275469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c0591-e25d-49c1-8dd1-7a6934d8dc97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:41.275776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c0591-e25d-49c1-8dd1-7a6934d8dc97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:41.277207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c0591-e25d-49c1-8dd1-7a6934d8dc97 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:41.288830 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf525a-41df-412c-aab3-e842a813ac07 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:41.289356 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 8/16] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:27:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:27:41.294732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c0591-e25d-49c1-8dd1-7a6934d8dc97 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:41.311981 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:41.322159 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:41.324861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcd98c-f5ed-47b0-b720-188740751400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:41.325661 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcd98c-f5ed-47b0-b720-188740751400 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:41.325946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcd98c-f5ed-47b0-b720-188740751400 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:41.326233 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcd98c-f5ed-47b0-b720-188740751400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:41.336146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcd98c-f5ed-47b0-b720-188740751400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:41.337656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcd98c-f5ed-47b0-b720-188740751400 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-cdfcd98c-f5ed-47b0-b720-188740751400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:27:41.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:27:41.359467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:27:41.360492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:27:41.360492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:27:41.360492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:27:41.360492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:27:41.360492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:27:41.366096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcd98c-f5ed-47b0-b720-188740751400 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:41.397124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c0591-e25d-49c1-8dd1-7a6934d8dc97 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:41.430941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd8836-4c6e-423f-ad13-da649d42319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:41.431843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd8836-4c6e-423f-ad13-da649d42319f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:41.432128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd8836-4c6e-423f-ad13-da649d42319f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:41.432412 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd8836-4c6e-423f-ad13-da649d42319f None admin] PATH_INFO: `/v3/users/cfed129aafe54696bb42f388ec9baac7` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:41.433973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd8836-4c6e-423f-ad13-da649d42319f None admin] RBAC: Authorizing `identity:get_user(user_id=cfed129aafe54696bb42f388ec9baac7)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:41.435461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd8836-4c6e-423f-ad13-da649d42319f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:41.437090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 9/18] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:27:41 2022] GET /identity/v3/users/cfed129aafe54696bb42f388ec9baac7 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:27:41.442414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd8836-4c6e-423f-ad13-da649d42319f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:41.467298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcd98c-f5ed-47b0-b720-188740751400 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:41.503010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7cf8f-d68f-4b96-b604-cc22c6b7f49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:41.503712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7cf8f-d68f-4b96-b604-cc22c6b7f49d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:41.504004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7cf8f-d68f-4b96-b604-cc22c6b7f49d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:41.504282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7cf8f-d68f-4b96-b604-cc22c6b7f49d None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:41.505362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7cf8f-d68f-4b96-b604-cc22c6b7f49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:41.505672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7cf8f-d68f-4b96-b604-cc22c6b7f49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:41.507082 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7cf8f-d68f-4b96-b604-cc22c6b7f49d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:41.524804 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 10/19] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:27:41.538008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:41.546341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd8836-4c6e-423f-ad13-da649d42319f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:41.583251 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a2ff6-1cf2-4ec6-bf2a-876a651a72cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:41.584177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a2ff6-1cf2-4ec6-bf2a-876a651a72cd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:41.584466 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a2ff6-1cf2-4ec6-bf2a-876a651a72cd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:41.584749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a2ff6-1cf2-4ec6-bf2a-876a651a72cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:41.586025 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a2ff6-1cf2-4ec6-bf2a-876a651a72cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:41.587566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a2ff6-1cf2-4ec6-bf2a-876a651a72cd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:41.589279 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 10/20] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:27:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:27:41.595327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7cf8f-d68f-4b96-b604-cc22c6b7f49d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:41.631263 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:41.701092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7cf8f-d68f-4b96-b604-cc22c6b7f49d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:41.734660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da0f6c-75af-4a93-8735-e6aff43fa01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:41.735353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da0f6c-75af-4a93-8735-e6aff43fa01e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:41.735644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da0f6c-75af-4a93-8735-e6aff43fa01e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:41.735923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da0f6c-75af-4a93-8735-e6aff43fa01e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:41.736763 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da0f6c-75af-4a93-8735-e6aff43fa01e None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.domain.id=default, user.id=cfed129aafe54696bb42f388ec9baac7) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:41.737080 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da0f6c-75af-4a93-8735-e6aff43fa01e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:41.738545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da0f6c-75af-4a93-8735-e6aff43fa01e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:41.746166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 11/21] 10.222.0.33 () {56 vars in 1322 bytes} [Wed Jul 6 20:27:41 2022] GET /identity/v3/role_assignments?user.id=cfed129aafe54696bb42f388ec9baac7&scope.domain.id=default&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:43.842167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb6027-32fb-4d5e-9ae3-aef88c4da42f None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:43.842643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb6027-32fb-4d5e-9ae3-aef88c4da42f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:43.842643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb6027-32fb-4d5e-9ae3-aef88c4da42f None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:43.844215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 11/22] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:43.850044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7deedf-7243-43ae-9fe6-6113dc89766e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:43.850477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7deedf-7243-43ae-9fe6-6113dc89766e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:43.850672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7deedf-7243-43ae-9fe6-6113dc89766e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:43.876254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-af7deedf-7243-43ae-9fe6-6113dc89766e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:43.877484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-af7deedf-7243-43ae-9fe6-6113dc89766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:43.967005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 12/23] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:27:44.003481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb6027-32fb-4d5e-9ae3-aef88c4da42f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:44.140900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb6027-32fb-4d5e-9ae3-aef88c4da42f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:44.184390 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b94c88-eee1-4e93-acd9-3ec091980cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:44.185188 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b94c88-eee1-4e93-acd9-3ec091980cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:44.185470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b94c88-eee1-4e93-acd9-3ec091980cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:44.185745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b94c88-eee1-4e93-acd9-3ec091980cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:44.209469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b94c88-eee1-4e93-acd9-3ec091980cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:44.210958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b94c88-eee1-4e93-acd9-3ec091980cb3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:44.235004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fc6f3-f19a-4c82-b0bd-4f275aef3320 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:44.235557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fc6f3-f19a-4c82-b0bd-4f275aef3320 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:44.235990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fc6f3-f19a-4c82-b0bd-4f275aef3320 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-53b94c88-eee1-4e93-acd9-3ec091980cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:27:44.237520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:27:44.238505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:27:44.244071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:27:44.244071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:27:44.244071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:27:44.244071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:27:44.244071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 12/24] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:27:44.244682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 13/25] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:44.246504 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b94c88-eee1-4e93-acd9-3ec091980cb3 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:44.250854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a2218-3ed7-4dcd-8bb8-b242a9b682c6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:44.251461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a2218-3ed7-4dcd-8bb8-b242a9b682c6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:44.252026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a2218-3ed7-4dcd-8bb8-b242a9b682c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:44.270332 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:44.275491 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-dd0a2218-3ed7-4dcd-8bb8-b242a9b682c6 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:44.280054 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dd0a2218-3ed7-4dcd-8bb8-b242a9b682c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:44.325703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:44.404866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 14/26] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:27:44.416216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b94c88-eee1-4e93-acd9-3ec091980cb3 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:44.442930 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a2218-3ed7-4dcd-8bb8-b242a9b682c6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:44.469293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e484b-bb3c-44ca-80c4-92019d79baf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:44.469969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e484b-bb3c-44ca-80c4-92019d79baf1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:44.470403 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e484b-bb3c-44ca-80c4-92019d79baf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:44.470694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e484b-bb3c-44ca-80c4-92019d79baf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:44.471454 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e484b-bb3c-44ca-80c4-92019d79baf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:44.471794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e484b-bb3c-44ca-80c4-92019d79baf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:44.473970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e484b-bb3c-44ca-80c4-92019d79baf1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:44.503187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 13/27] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:44.511187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e484b-bb3c-44ca-80c4-92019d79baf1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:44.594892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a2218-3ed7-4dcd-8bb8-b242a9b682c6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:44.635436 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65201d7b-7235-4408-b9ff-ed681312587c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:44.636117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65201d7b-7235-4408-b9ff-ed681312587c None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:44.636399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65201d7b-7235-4408-b9ff-ed681312587c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:44.636674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65201d7b-7235-4408-b9ff-ed681312587c None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:44.637437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65201d7b-7235-4408-b9ff-ed681312587c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:44.638856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65201d7b-7235-4408-b9ff-ed681312587c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:44.687917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:44.733056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e484b-bb3c-44ca-80c4-92019d79baf1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:44.783550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 15/28] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Jul 6 20:27:44 2022] POST /identity/v3/roles => generated 225 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:27:44.785285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08f7e1-a98d-4d50-b275-9be5c5f02aff None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:44.785933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08f7e1-a98d-4d50-b275-9be5c5f02aff None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:44.786076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08f7e1-a98d-4d50-b275-9be5c5f02aff None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:44.787530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 16/29] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:44.789040 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a1924-aeb5-45a1-a304-39d955a9b811 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:44.789275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a1924-aeb5-45a1-a304-39d955a9b811 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:44.789563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a1924-aeb5-45a1-a304-39d955a9b811 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:44.791121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 17/30] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:44.796464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e905d8-307e-4b84-bf03-e051be4d1729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:44.796791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d0788-cf69-4d29-95eb-210db833d25c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:44.797097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d0788-cf69-4d29-95eb-210db833d25c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:44.797386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d0788-cf69-4d29-95eb-210db833d25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:44.798137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e905d8-307e-4b84-bf03-e051be4d1729 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:44.798672 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e905d8-307e-4b84-bf03-e051be4d1729 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:44.799203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e905d8-307e-4b84-bf03-e051be4d1729 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:44.800390 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e905d8-307e-4b84-bf03-e051be4d1729 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:44.802941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e905d8-307e-4b84-bf03-e051be4d1729 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:44.836854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-013d0788-cf69-4d29-95eb-210db833d25c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:44.838486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-013d0788-cf69-4d29-95eb-210db833d25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:44.874394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:44.963333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 18/31] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:27:44.964531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d3032-cc5d-487c-a8d8-8f8f02607553 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:44.964835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d3032-cc5d-487c-a8d8-8f8f02607553 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:44.965122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d3032-cc5d-487c-a8d8-8f8f02607553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:44.982143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 14/32] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:27:44 2022] POST /identity/v3/projects => generated 301 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:27:44.986943 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b29d3032-cc5d-487c-a8d8-8f8f02607553 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:44.986943 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b29d3032-cc5d-487c-a8d8-8f8f02607553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:45.000097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e905d8-307e-4b84-bf03-e051be4d1729 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:45.138155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 19/33] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:27:45.149735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e905d8-307e-4b84-bf03-e051be4d1729 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:45.182165 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:45.194538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa689e9-f438-4f59-a66e-5b2165cf4799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:45.195399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa689e9-f438-4f59-a66e-5b2165cf4799 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:45.195697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa689e9-f438-4f59-a66e-5b2165cf4799 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:45.195984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa689e9-f438-4f59-a66e-5b2165cf4799 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:45.214346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa689e9-f438-4f59-a66e-5b2165cf4799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:27:45.217569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d3032-cc5d-487c-a8d8-8f8f02607553 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-4aa689e9-f438-4f59-a66e-5b2165cf4799 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:27:45.223878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:27:45.224819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:27:45.225578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:27:45.225578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:27:45.225578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:27:45.225578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:27:45.225578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:27:45.225578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:27:45.225578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:27:45.225578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:27:45.225578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:27:45.225578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:27:45.225578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:27:45.225578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:27:45.226151 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 15/34] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:27:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:27:45.229174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed41f4-5de0-45ad-ae95-3420c05d17b6 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:45.229174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed41f4-5de0-45ad-ae95-3420c05d17b6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:45.229174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed41f4-5de0-45ad-ae95-3420c05d17b6 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:45.229174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 16/35] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:45.234133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0f816-da0f-4f55-bfb7-6ac591c33104 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:45.234655 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0f816-da0f-4f55-bfb7-6ac591c33104 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:45.235134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0f816-da0f-4f55-bfb7-6ac591c33104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:45.253888 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ade0f816-da0f-4f55-bfb7-6ac591c33104 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:45.256372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ade0f816-da0f-4f55-bfb7-6ac591c33104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:45.325302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:45.342208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 17/36] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:27:45.343342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0f816-da0f-4f55-bfb7-6ac591c33104 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:45.352956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d3032-cc5d-487c-a8d8-8f8f02607553 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:45.391142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f509e6b-4ec3-4a57-8cf6-e27653d1d793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:45.391850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f509e6b-4ec3-4a57-8cf6-e27653d1d793 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:45.392144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f509e6b-4ec3-4a57-8cf6-e27653d1d793 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:45.392428 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f509e6b-4ec3-4a57-8cf6-e27653d1d793 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:45.393211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f509e6b-4ec3-4a57-8cf6-e27653d1d793 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:45.395409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f509e6b-4ec3-4a57-8cf6-e27653d1d793 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:45.412384 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 20/37] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Jul 6 20:27:45 2022] POST /identity/v3/roles => generated 219 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:27:45.413724 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f509e6b-4ec3-4a57-8cf6-e27653d1d793 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:45.471375 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0f816-da0f-4f55-bfb7-6ac591c33104 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:45.495075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:45.527549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675b4d3-56ef-4c4f-935f-913d02b719f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:45.528602 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675b4d3-56ef-4c4f-935f-913d02b719f4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:45.528983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675b4d3-56ef-4c4f-935f-913d02b719f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:45.529343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675b4d3-56ef-4c4f-935f-913d02b719f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:45.531259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675b4d3-56ef-4c4f-935f-913d02b719f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:45.531656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675b4d3-56ef-4c4f-935f-913d02b719f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:45.533508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675b4d3-56ef-4c4f-935f-913d02b719f4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:45.546991 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 18/38] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:27:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:45.553324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675b4d3-56ef-4c4f-935f-913d02b719f4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:45.569643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f509e6b-4ec3-4a57-8cf6-e27653d1d793 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:45.625401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46354ff0-36d2-443b-9071-db9704a6f460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:45.626365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46354ff0-36d2-443b-9071-db9704a6f460 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:45.626656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46354ff0-36d2-443b-9071-db9704a6f460 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:45.626938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46354ff0-36d2-443b-9071-db9704a6f460 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:45.630262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46354ff0-36d2-443b-9071-db9704a6f460 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:45.630682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46354ff0-36d2-443b-9071-db9704a6f460 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:45.646832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:45.653067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 21/39] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Jul 6 20:27:45 2022] POST /identity/v3/roles => generated 223 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:27:45.698393 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675b4d3-56ef-4c4f-935f-913d02b719f4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:45.736790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66247a-823c-4b79-a669-0b5bdd3c4a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:45.737612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66247a-823c-4b79-a669-0b5bdd3c4a62 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:45.737902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66247a-823c-4b79-a669-0b5bdd3c4a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:45.738186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66247a-823c-4b79-a669-0b5bdd3c4a62 None admin] PATH_INFO: `/v3/users/cfed129aafe54696bb42f388ec9baac7` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:45.739803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66247a-823c-4b79-a669-0b5bdd3c4a62 None admin] RBAC: Authorizing `identity:get_user(user_id=cfed129aafe54696bb42f388ec9baac7)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:45.741296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66247a-823c-4b79-a669-0b5bdd3c4a62 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:45.743321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 19/40] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:27:45 2022] GET /identity/v3/users/cfed129aafe54696bb42f388ec9baac7 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:45.748793 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46354ff0-36d2-443b-9071-db9704a6f460 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:45.767904 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6fbaa-1c16-44c3-870b-dd5ac0dda98b None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:45.768197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6fbaa-1c16-44c3-870b-dd5ac0dda98b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:45.768490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6fbaa-1c16-44c3-870b-dd5ac0dda98b None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:45.770673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 20/41] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:27:45.780139 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7a950-e96e-45b4-8659-af2dcd0160f8 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:45.780470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7a950-e96e-45b4-8659-af2dcd0160f8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:45.780709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7a950-e96e-45b4-8659-af2dcd0160f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:45.798076 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c6d7a950-e96e-45b4-8659-af2dcd0160f8 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:45.799346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c6d7a950-e96e-45b4-8659-af2dcd0160f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:45.852985 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:45.867090 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46354ff0-36d2-443b-9071-db9704a6f460 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:45.883565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 21/42] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:27:45.903920 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304524d5-fddc-4ab5-93cb-610115959b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:45.904727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304524d5-fddc-4ab5-93cb-610115959b75 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:45.905017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304524d5-fddc-4ab5-93cb-610115959b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:45.905303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304524d5-fddc-4ab5-93cb-610115959b75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:45.906482 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304524d5-fddc-4ab5-93cb-610115959b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:45.907138 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7a950-e96e-45b4-8659-af2dcd0160f8 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:45.907978 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304524d5-fddc-4ab5-93cb-610115959b75 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:45.909716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:27:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:45.915140 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304524d5-fddc-4ab5-93cb-610115959b75 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:45.980509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:46.005801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7a950-e96e-45b4-8659-af2dcd0160f8 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:46.042528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70c9df-da06-494b-a43c-2b288bf7413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:46.043385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70c9df-da06-494b-a43c-2b288bf7413a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:46.043673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70c9df-da06-494b-a43c-2b288bf7413a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:46.043950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70c9df-da06-494b-a43c-2b288bf7413a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:46.045196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70c9df-da06-494b-a43c-2b288bf7413a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:46.046689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70c9df-da06-494b-a43c-2b288bf7413a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:46.048434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 22/44] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:27:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:46.054684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70c9df-da06-494b-a43c-2b288bf7413a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:46.102508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:46.123367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304524d5-fddc-4ab5-93cb-610115959b75 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:46.157419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98b4a8-f494-4c69-8ad2-7f9caa6d0272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:46.157704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70c9df-da06-494b-a43c-2b288bf7413a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:46.158300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b4a8-f494-4c69-8ad2-7f9caa6d0272 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:46.158588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b4a8-f494-4c69-8ad2-7f9caa6d0272 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:46.158872 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b4a8-f494-4c69-8ad2-7f9caa6d0272 None admin] PATH_INFO: `/v3/domains/default/users/cfed129aafe54696bb42f388ec9baac7/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:46.161299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98b4a8-f494-4c69-8ad2-7f9caa6d0272 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cfed129aafe54696bb42f388ec9baac7, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:46.162754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98b4a8-f494-4c69-8ad2-7f9caa6d0272 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:46.176903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 23/45] 10.222.0.33 () {58 vars in 1361 bytes} [Wed Jul 6 20:27:45 2022] PUT /identity/v3/domains/default/users/cfed129aafe54696bb42f388ec9baac7/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:27:46.198456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f6042-42bd-43ed-8597-65152d60172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:46.199188 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f6042-42bd-43ed-8597-65152d60172c None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:46.199487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f6042-42bd-43ed-8597-65152d60172c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:46.199773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f6042-42bd-43ed-8597-65152d60172c None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:46.201064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f6042-42bd-43ed-8597-65152d60172c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:46.203823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f6042-42bd-43ed-8597-65152d60172c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:46.232262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:27:46 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:27:48.227109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cdbdc-a9f1-4e17-9ccb-6e28a9cd2861 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:48.227641 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cdbdc-a9f1-4e17-9ccb-6e28a9cd2861 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:48.227722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cdbdc-a9f1-4e17-9ccb-6e28a9cd2861 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:48.229076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 24/47] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:48.234317 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460790f-0b6e-4597-a259-5123513fe8dd None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:48.234709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460790f-0b6e-4597-a259-5123513fe8dd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:48.235002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460790f-0b6e-4597-a259-5123513fe8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:48.252244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9460790f-0b6e-4597-a259-5123513fe8dd None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:48.253418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9460790f-0b6e-4597-a259-5123513fe8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:48.291185 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adf026-5842-4b58-b543-b5297200890c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:48.291494 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adf026-5842-4b58-b543-b5297200890c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:48.291776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adf026-5842-4b58-b543-b5297200890c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:48.293142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 25/48] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:27:48.297934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831940d9-1d02-4f3c-a94d-c3e63d4709af None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:48.298220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831940d9-1d02-4f3c-a94d-c3e63d4709af None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:48.298498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831940d9-1d02-4f3c-a94d-c3e63d4709af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:48.315126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-831940d9-1d02-4f3c-a94d-c3e63d4709af None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:48.316341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-831940d9-1d02-4f3c-a94d-c3e63d4709af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:48.320912 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 24/49] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:27:48.343906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460790f-0b6e-4597-a259-5123513fe8dd None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:48.371194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:48.382919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 26/50] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:27:48.405922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831940d9-1d02-4f3c-a94d-c3e63d4709af None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:48.446974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460790f-0b6e-4597-a259-5123513fe8dd None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:48.461583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:48.482479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138eff79-698f-4505-bd32-351c92106be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:48.483228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eff79-698f-4505-bd32-351c92106be6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:48.483514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eff79-698f-4505-bd32-351c92106be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:48.483797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eff79-698f-4505-bd32-351c92106be6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:48.493963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138eff79-698f-4505-bd32-351c92106be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-138eff79-698f-4505-bd32-351c92106be6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:27:48.501845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:27:48.502675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:27:48.503458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:27:48.503458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:27:48.503458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:27:48.503458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:27:48.503458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:27:48.503458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:27:48.503458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:27:48.503458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:27:48.503458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:27:48.503458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:27:48.503458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:27:48.503458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:27:48.503458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 25/51] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:27:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:27:48.505800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831940d9-1d02-4f3c-a94d-c3e63d4709af None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:48.510431 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138eff79-698f-4505-bd32-351c92106be6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:48.541887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55466123-966c-4ff7-a435-e6b05c53b894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:48.542707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55466123-966c-4ff7-a435-e6b05c53b894 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:48.542999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55466123-966c-4ff7-a435-e6b05c53b894 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:48.543357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55466123-966c-4ff7-a435-e6b05c53b894 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:48.544622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55466123-966c-4ff7-a435-e6b05c53b894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:48.546125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55466123-966c-4ff7-a435-e6b05c53b894 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:48.547866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 27/52] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:27:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:27:48.554633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55466123-966c-4ff7-a435-e6b05c53b894 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:48.663993 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55466123-966c-4ff7-a435-e6b05c53b894 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:48.687223 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:48.698941 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078188f2-6d10-44bc-b93b-6fd374aa0a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:48.699632 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078188f2-6d10-44bc-b93b-6fd374aa0a9a None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:48.699922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078188f2-6d10-44bc-b93b-6fd374aa0a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:48.700204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078188f2-6d10-44bc-b93b-6fd374aa0a9a None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:48.700913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078188f2-6d10-44bc-b93b-6fd374aa0a9a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:48.702054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:48.702364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078188f2-6d10-44bc-b93b-6fd374aa0a9a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:48.716926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138eff79-698f-4505-bd32-351c92106be6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:48.730030 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 28/53] 10.222.0.33 () {60 vars in 1140 bytes} [Wed Jul 6 20:27:48 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:27:48.753709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058513c-a44a-46a4-b548-9856eef2ea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:48.754891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058513c-a44a-46a4-b548-9856eef2ea7c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:48.755189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058513c-a44a-46a4-b548-9856eef2ea7c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:48.755582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058513c-a44a-46a4-b548-9856eef2ea7c None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:48.756357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058513c-a44a-46a4-b548-9856eef2ea7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:48.756670 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058513c-a44a-46a4-b548-9856eef2ea7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:48.758116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058513c-a44a-46a4-b548-9856eef2ea7c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:48.767977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 26/54] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:27:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:27:48.774766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078188f2-6d10-44bc-b93b-6fd374aa0a9a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:48.878844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078188f2-6d10-44bc-b93b-6fd374aa0a9a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:48.914868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226304d-5273-4c37-93fe-2d5aafda60f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:48.915782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226304d-5273-4c37-93fe-2d5aafda60f8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:48.916071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226304d-5273-4c37-93fe-2d5aafda60f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:48.916351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226304d-5273-4c37-93fe-2d5aafda60f8 None admin] PATH_INFO: `/v3/users/cfed129aafe54696bb42f388ec9baac7` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:48.917570 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226304d-5273-4c37-93fe-2d5aafda60f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cfed129aafe54696bb42f388ec9baac7)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:48.919034 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226304d-5273-4c37-93fe-2d5aafda60f8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:48.920720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 29/55] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:27:48 2022] GET /identity/v3/users/cfed129aafe54696bb42f388ec9baac7 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:48.926390 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058513c-a44a-46a4-b548-9856eef2ea7c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:49.023349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058513c-a44a-46a4-b548-9856eef2ea7c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:49.055569 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fcc5c-ba16-4a8d-86b2-49ba6b907110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:49.056372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fcc5c-ba16-4a8d-86b2-49ba6b907110 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:49.056657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fcc5c-ba16-4a8d-86b2-49ba6b907110 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:49.056934 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fcc5c-ba16-4a8d-86b2-49ba6b907110 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:49.058127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fcc5c-ba16-4a8d-86b2-49ba6b907110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:49.059629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fcc5c-ba16-4a8d-86b2-49ba6b907110 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:49.061261 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 27/56] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:27:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:49.067661 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226304d-5273-4c37-93fe-2d5aafda60f8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:49.115237 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:49.171788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226304d-5273-4c37-93fe-2d5aafda60f8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:49.206575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac81605-32e3-4c23-91d1-1184490b7a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:49.207856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac81605-32e3-4c23-91d1-1184490b7a78 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:49.208157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac81605-32e3-4c23-91d1-1184490b7a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:49.208447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac81605-32e3-4c23-91d1-1184490b7a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:49.209297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac81605-32e3-4c23-91d1-1184490b7a78 None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.domain.id=default, user.id=cfed129aafe54696bb42f388ec9baac7) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:49.209621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac81605-32e3-4c23-91d1-1184490b7a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:49.211098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac81605-32e3-4c23-91d1-1184490b7a78 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:49.217058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 30/57] 10.222.0.33 () {56 vars in 1322 bytes} [Wed Jul 6 20:27:49 2022] GET /identity/v3/role_assignments?user.id=cfed129aafe54696bb42f388ec9baac7&scope.domain.id=default&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:50.776293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d96e70-577a-4c7c-9a19-b8c7c2cf9edb None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:50.776833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d96e70-577a-4c7c-9a19-b8c7c2cf9edb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:50.776944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d96e70-577a-4c7c-9a19-b8c7c2cf9edb None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:50.778230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 28/58] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:50.783382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1b39-6c29-4919-a39a-6e755083d578 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:50.783789 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1b39-6c29-4919-a39a-6e755083d578 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:50.783957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1b39-6c29-4919-a39a-6e755083d578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:50.802964 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-759b1b39-6c29-4919-a39a-6e755083d578 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:50.804983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-759b1b39-6c29-4919-a39a-6e755083d578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:50.870040 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 31/59] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:27:50.894413 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d96e70-577a-4c7c-9a19-b8c7c2cf9edb None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:50.912549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:50.993944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d96e70-577a-4c7c-9a19-b8c7c2cf9edb None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:51.027303 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887d115-4ac5-4688-91ce-19184c4e5d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:51.028085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887d115-4ac5-4688-91ce-19184c4e5d22 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:51.028374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887d115-4ac5-4688-91ce-19184c4e5d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:51.028656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887d115-4ac5-4688-91ce-19184c4e5d22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:51.029830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887d115-4ac5-4688-91ce-19184c4e5d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:51.031302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887d115-4ac5-4688-91ce-19184c4e5d22 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:51.032900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 29/60] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:27:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:51.038308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b1b39-6c29-4919-a39a-6e755083d578 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:51.075674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:51.132939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b1b39-6c29-4919-a39a-6e755083d578 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:51.165571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9d175-dcf4-4b39-8933-22ab5b053113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:51.166234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d175-dcf4-4b39-8933-22ab5b053113 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:51.166517 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d175-dcf4-4b39-8933-22ab5b053113 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:51.166794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d175-dcf4-4b39-8933-22ab5b053113 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:51.167538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9d175-dcf4-4b39-8933-22ab5b053113 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:51.168996 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9d175-dcf4-4b39-8933-22ab5b053113 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:51.197211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 32/61] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:27:51 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:27:54.275447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740bd4a-cfa9-49ad-b865-7aaca9153326 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:54.275447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740bd4a-cfa9-49ad-b865-7aaca9153326 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:54.275447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740bd4a-cfa9-49ad-b865-7aaca9153326 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:54.275447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 30/62] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:54.280676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96294620-b322-4e74-8000-ac7a0abea1b0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:54.281508 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96294620-b322-4e74-8000-ac7a0abea1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:54.282008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96294620-b322-4e74-8000-ac7a0abea1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:54.308232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-96294620-b322-4e74-8000-ac7a0abea1b0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:54.309773 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-96294620-b322-4e74-8000-ac7a0abea1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:54.411835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 33/63] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:27:54.455420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740bd4a-cfa9-49ad-b865-7aaca9153326 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:54.504699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e9ea3-af92-4046-b55e-6cdd9960239a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:54.505358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e9ea3-af92-4046-b55e-6cdd9960239a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:54.505867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e9ea3-af92-4046-b55e-6cdd9960239a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:54.507526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 34/64] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:54.516569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe9ee4-84ab-4517-8c7a-17506e1ae756 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:54.517200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe9ee4-84ab-4517-8c7a-17506e1ae756 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:54.517684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe9ee4-84ab-4517-8c7a-17506e1ae756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:54.541594 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2bbe9ee4-84ab-4517-8c7a-17506e1ae756 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:54.543115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2bbe9ee4-84ab-4517-8c7a-17506e1ae756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:54.566868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:54.581358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:54.612689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740bd4a-cfa9-49ad-b865-7aaca9153326 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:54.634991 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 35/65] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:27:54.637213 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce96e58-de05-4523-b006-574d7e2d8a73 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:54.637657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce96e58-de05-4523-b006-574d7e2d8a73 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:54.638380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce96e58-de05-4523-b006-574d7e2d8a73 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:54.640725 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 36/66] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:54.650547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bcc1b-28f2-472e-988b-e05ff1de4213 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:54.650547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bcc1b-28f2-472e-988b-e05ff1de4213 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:54.650547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bcc1b-28f2-472e-988b-e05ff1de4213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:54.665472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15081ca-2b3e-4a25-9440-0f7f3be079d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:54.666550 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15081ca-2b3e-4a25-9440-0f7f3be079d4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:54.667295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15081ca-2b3e-4a25-9440-0f7f3be079d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:54.667723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15081ca-2b3e-4a25-9440-0f7f3be079d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:54.671033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-801bcc1b-28f2-472e-988b-e05ff1de4213 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:54.672340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-801bcc1b-28f2-472e-988b-e05ff1de4213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:54.681576 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15081ca-2b3e-4a25-9440-0f7f3be079d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-d15081ca-2b3e-4a25-9440-0f7f3be079d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:27:54.692520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:27:54.693579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:27:54.694528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:27:54.694528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:27:54.694528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:27:54.694528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:27:54.694528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:27:54.694528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:27:54.694528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:27:54.694528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:27:54.694528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:27:54.694528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:27:54.694528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:27:54.694528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:27:54.697115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 31/67] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:27:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:27:54.698188 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15081ca-2b3e-4a25-9440-0f7f3be079d4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:54.750482 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 37/68] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:27:54.756150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bcc1b-28f2-472e-988b-e05ff1de4213 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:54.826518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15081ca-2b3e-4a25-9440-0f7f3be079d4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:54.874239 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79ba7f-f823-4735-b246-77dd84815deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:54.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79ba7f-f823-4735-b246-77dd84815deb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:54.875999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79ba7f-f823-4735-b246-77dd84815deb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:54.876448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79ba7f-f823-4735-b246-77dd84815deb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:54.880793 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:54.892965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79ba7f-f823-4735-b246-77dd84815deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:27:54.900859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bcc1b-28f2-472e-988b-e05ff1de4213 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-ea79ba7f-f823-4735-b246-77dd84815deb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:27:54.904561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:27:54.905397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:27:54.906161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:27:54.906161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:27:54.906161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:27:54.906161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:27:54.906161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:27:54.906161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:27:54.906161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:27:54.906161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:27:54.906161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:27:54.906161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:27:54.906161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:27:54.906161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:27:54.906161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 32/69] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:27:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:27:54.906787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79ba7f-f823-4735-b246-77dd84815deb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:54.919834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:54.942073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da3e10-dbb1-4ec9-a5c0-dc6413fd1b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:54.942754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da3e10-dbb1-4ec9-a5c0-dc6413fd1b8a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:54.943041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da3e10-dbb1-4ec9-a5c0-dc6413fd1b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:54.943354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da3e10-dbb1-4ec9-a5c0-dc6413fd1b8a None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:54.944108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da3e10-dbb1-4ec9-a5c0-dc6413fd1b8a None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:54.944416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da3e10-dbb1-4ec9-a5c0-dc6413fd1b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:54.945828 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da3e10-dbb1-4ec9-a5c0-dc6413fd1b8a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:54.959096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 38/70] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:27:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:54.959779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da3e10-dbb1-4ec9-a5c0-dc6413fd1b8a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:55.028088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79ba7f-f823-4735-b246-77dd84815deb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:55.060973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915a030-53a1-4e3d-bd40-eb2b91248554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:55.061783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915a030-53a1-4e3d-bd40-eb2b91248554 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.062073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915a030-53a1-4e3d-bd40-eb2b91248554 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.062357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915a030-53a1-4e3d-bd40-eb2b91248554 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.069207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da3e10-dbb1-4ec9-a5c0-dc6413fd1b8a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:55.073369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915a030-53a1-4e3d-bd40-eb2b91248554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-b915a030-53a1-4e3d-bd40-eb2b91248554 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:27:55.081518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:27:55.083141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:27:55.083946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:27:55.083946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:27:55.083946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:27:55.083946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:27:55.083946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:27:55.083946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:27:55.083946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:27:55.083946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:27:55.083946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:27:55.083946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:27:55.083946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:27:55.083946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:27:55.083946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 33/71] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:27:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:27:55.084819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c3617-a0cd-49b4-890d-01cfe1169e6d None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.084819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c3617-a0cd-49b4-890d-01cfe1169e6d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.085115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c3617-a0cd-49b4-890d-01cfe1169e6d None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.086312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 34/72] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:55.087017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c3617-a0cd-49b4-890d-01cfe1169e6d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:55.107618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b2838-5ed5-439e-8f61-a7fc4d8e4312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:55.108295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b2838-5ed5-439e-8f61-a7fc4d8e4312 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.108585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b2838-5ed5-439e-8f61-a7fc4d8e4312 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.108866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b2838-5ed5-439e-8f61-a7fc4d8e4312 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.109624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b2838-5ed5-439e-8f61-a7fc4d8e4312 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:55.109930 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b2838-5ed5-439e-8f61-a7fc4d8e4312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:55.111364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b2838-5ed5-439e-8f61-a7fc4d8e4312 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:55.119972 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 39/73] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:27:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:55.121192 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226f992-441f-4c8d-83dc-a1bf3e7085be None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.121485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226f992-441f-4c8d-83dc-a1bf3e7085be None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.121766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226f992-441f-4c8d-83dc-a1bf3e7085be None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.123014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 40/74] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:55.123722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226f992-441f-4c8d-83dc-a1bf3e7085be None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:55.135314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:55.154143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:55.196753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c3617-a0cd-49b4-890d-01cfe1169e6d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:55.233890 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536414d-2f7c-4b73-be3f-d5ea7a7d6462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:55.234762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536414d-2f7c-4b73-be3f-d5ea7a7d6462 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.235075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536414d-2f7c-4b73-be3f-d5ea7a7d6462 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.235345 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536414d-2f7c-4b73-be3f-d5ea7a7d6462 None admin] PATH_INFO: `/v3/users/354ba81d4750484ba041dc7f2f2438f1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.235709 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226f992-441f-4c8d-83dc-a1bf3e7085be None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:55.251133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536414d-2f7c-4b73-be3f-d5ea7a7d6462 None admin] RBAC: Authorizing `identity:get_user(user_id=354ba81d4750484ba041dc7f2f2438f1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:55.252632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536414d-2f7c-4b73-be3f-d5ea7a7d6462 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:55.255065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 35/75] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:27:55 2022] GET /identity/v3/users/354ba81d4750484ba041dc7f2f2438f1 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:55.256295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386f878-4d98-4d40-ac00-e80bbd7c1c5d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.256588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386f878-4d98-4d40-ac00-e80bbd7c1c5d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.256873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386f878-4d98-4d40-ac00-e80bbd7c1c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.270160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6196337-6ce1-4afa-ae00-f04bce8cb327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:55.270829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6196337-6ce1-4afa-ae00-f04bce8cb327 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.271116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6196337-6ce1-4afa-ae00-f04bce8cb327 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.271431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6196337-6ce1-4afa-ae00-f04bce8cb327 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.272438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6196337-6ce1-4afa-ae00-f04bce8cb327 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:55.272749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6196337-6ce1-4afa-ae00-f04bce8cb327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:55.273007 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5386f878-4d98-4d40-ac00-e80bbd7c1c5d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:55.274133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6196337-6ce1-4afa-ae00-f04bce8cb327 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:55.274226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5386f878-4d98-4d40-ac00-e80bbd7c1c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:55.282008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 41/76] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:27:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:55.282781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6196337-6ce1-4afa-ae00-f04bce8cb327 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:55.340661 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 36/77] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:27:55.344654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4b66c-abd6-4d03-a924-d24ed196bc31 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.345408 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4b66c-abd6-4d03-a924-d24ed196bc31 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.346112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4b66c-abd6-4d03-a924-d24ed196bc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.352400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:55.366733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f9c4b66c-abd6-4d03-a924-d24ed196bc31 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:55.367963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f9c4b66c-abd6-4d03-a924-d24ed196bc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:55.384174 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6196337-6ce1-4afa-ae00-f04bce8cb327 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:55.414891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:55.416963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79516547-50df-4773-99bd-2817b7405a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:55.418091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79516547-50df-4773-99bd-2817b7405a98 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.418380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79516547-50df-4773-99bd-2817b7405a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.418657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79516547-50df-4773-99bd-2817b7405a98 None admin] PATH_INFO: `/v3/users/cfed129aafe54696bb42f388ec9baac7` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.419906 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79516547-50df-4773-99bd-2817b7405a98 None admin] RBAC: Authorizing `identity:get_user(user_id=cfed129aafe54696bb42f388ec9baac7)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:55.421377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79516547-50df-4773-99bd-2817b7405a98 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:55.423014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 42/78] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:27:55 2022] GET /identity/v3/users/cfed129aafe54696bb42f388ec9baac7 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:55.423804 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79516547-50df-4773-99bd-2817b7405a98 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:55.440347 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 37/79] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:27:55.444108 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4b66c-abd6-4d03-a924-d24ed196bc31 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:55.530641 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79516547-50df-4773-99bd-2817b7405a98 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:55.547469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4b66c-abd6-4d03-a924-d24ed196bc31 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:55.564197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8c38b-520c-4189-bafe-f7f20053b888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:55.564854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8c38b-520c-4189-bafe-f7f20053b888 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.565145 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8c38b-520c-4189-bafe-f7f20053b888 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.565430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8c38b-520c-4189-bafe-f7f20053b888 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.574309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:55.581501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef3513-db1f-490c-866a-9bd09627258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:55.582956 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef3513-db1f-490c-866a-9bd09627258e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.583269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef3513-db1f-490c-866a-9bd09627258e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.583555 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef3513-db1f-490c-866a-9bd09627258e None admin] PATH_INFO: `/v3/users/354ba81d4750484ba041dc7f2f2438f1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.584836 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef3513-db1f-490c-866a-9bd09627258e None admin] RBAC: Authorizing `identity:get_user(user_id=354ba81d4750484ba041dc7f2f2438f1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:55.586502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef3513-db1f-490c-866a-9bd09627258e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:55.588000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 38/80] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:27:55 2022] GET /identity/v3/users/354ba81d4750484ba041dc7f2f2438f1 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:55.588770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef3513-db1f-490c-866a-9bd09627258e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:55.637653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8c38b-520c-4189-bafe-f7f20053b888 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:55.639110 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8c38b-520c-4189-bafe-f7f20053b888 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:55.643233 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:55.694112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef3513-db1f-490c-866a-9bd09627258e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:55.727094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bed181-d6b3-42c0-9cb2-9164b789f9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:55.727910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed181-d6b3-42c0-9cb2-9164b789f9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.728193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed181-d6b3-42c0-9cb2-9164b789f9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.728470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed181-d6b3-42c0-9cb2-9164b789f9f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.735484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 43/81] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:27:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:27:55.736407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8c38b-520c-4189-bafe-f7f20053b888 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:55.741736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bed181-d6b3-42c0-9cb2-9164b789f9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-44bed181-d6b3-42c0-9cb2-9164b789f9f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:27:55.749483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:27:55.750588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 39/82] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:27:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:27:55.751566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bed181-d6b3-42c0-9cb2-9164b789f9f2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:55.779004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:55.842981 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8c38b-520c-4189-bafe-f7f20053b888 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:55.857896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bed181-d6b3-42c0-9cb2-9164b789f9f2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:55.869228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:55.877344 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b354a-7c7c-4e1d-8d48-70afbb1fc2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:55.878005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b354a-7c7c-4e1d-8d48-70afbb1fc2ae None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.878296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b354a-7c7c-4e1d-8d48-70afbb1fc2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.879672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b354a-7c7c-4e1d-8d48-70afbb1fc2ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.893842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53ca0f-1ef9-4139-ac10-615899daa4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:55.895195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53ca0f-1ef9-4139-ac10-615899daa4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:55.895501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53ca0f-1ef9-4139-ac10-615899daa4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:55.895778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53ca0f-1ef9-4139-ac10-615899daa4e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:55.897206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53ca0f-1ef9-4139-ac10-615899daa4e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:55.898659 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53ca0f-1ef9-4139-ac10-615899daa4e1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:55.900296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 40/83] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:27:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:55.904974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53ca0f-1ef9-4139-ac10-615899daa4e1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:55.948038 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b354a-7c7c-4e1d-8d48-70afbb1fc2ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:55.949525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b354a-7c7c-4e1d-8d48-70afbb1fc2ae None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:55.989839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:55.999448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53ca0f-1ef9-4139-ac10-615899daa4e1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:56.032098 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d8039-f498-41d7-85e2-9375c2638a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:56.032739 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d8039-f498-41d7-85e2-9375c2638a0f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:56.033022 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d8039-f498-41d7-85e2-9375c2638a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:56.033301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d8039-f498-41d7-85e2-9375c2638a0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:56.049808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 44/84] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:27:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:27:56.049808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b354a-7c7c-4e1d-8d48-70afbb1fc2ae None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:56.078303 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:56.100417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d8039-f498-41d7-85e2-9375c2638a0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:56.101885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d8039-f498-41d7-85e2-9375c2638a0f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:56.150412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b354a-7c7c-4e1d-8d48-70afbb1fc2ae None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:56.183429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f97b2b-4341-4137-9652-30e7b8b42bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:56.184302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f97b2b-4341-4137-9652-30e7b8b42bee None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:56.184592 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f97b2b-4341-4137-9652-30e7b8b42bee None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:56.184873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f97b2b-4341-4137-9652-30e7b8b42bee None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:56.186099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f97b2b-4341-4137-9652-30e7b8b42bee None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:56.187594 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f97b2b-4341-4137-9652-30e7b8b42bee None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:56.189298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 45/85] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:27:56 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:56.190066 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f97b2b-4341-4137-9652-30e7b8b42bee None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:56.198761 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:56.203069 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 41/86] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:27:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:27:56.203929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d8039-f498-41d7-85e2-9375c2638a0f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:56.283112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:56.292844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f97b2b-4341-4137-9652-30e7b8b42bee None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:56.305902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d8039-f498-41d7-85e2-9375c2638a0f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:56.327312 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1e9cb-0f64-443b-801c-e2825bfc327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:56.327982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1e9cb-0f64-443b-801c-e2825bfc327f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:56.328271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1e9cb-0f64-443b-801c-e2825bfc327f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:56.328558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1e9cb-0f64-443b-801c-e2825bfc327f None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:56.329296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1e9cb-0f64-443b-801c-e2825bfc327f None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:56.329604 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1e9cb-0f64-443b-801c-e2825bfc327f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:56.330981 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1e9cb-0f64-443b-801c-e2825bfc327f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:56.338894 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 46/87] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:27:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:56.339762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1e9cb-0f64-443b-801c-e2825bfc327f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:56.340258 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ded240-7cd2-400f-97ee-f62e674810f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:56.340940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ded240-7cd2-400f-97ee-f62e674810f2 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:56.341443 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ded240-7cd2-400f-97ee-f62e674810f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:56.341513 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ded240-7cd2-400f-97ee-f62e674810f2 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:56.342216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ded240-7cd2-400f-97ee-f62e674810f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:56.343724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ded240-7cd2-400f-97ee-f62e674810f2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:56.370747 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 42/88] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:27:56 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:27:56.371777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ded240-7cd2-400f-97ee-f62e674810f2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:56.411773 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:56.454426 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1e9cb-0f64-443b-801c-e2825bfc327f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:56.501677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d492c0-fb1c-4269-b902-8d9b1ba8362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:56.502574 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d492c0-fb1c-4269-b902-8d9b1ba8362b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:56.502871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d492c0-fb1c-4269-b902-8d9b1ba8362b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:56.503155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d492c0-fb1c-4269-b902-8d9b1ba8362b None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:56.505777 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d492c0-fb1c-4269-b902-8d9b1ba8362b None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:56.507343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d492c0-fb1c-4269-b902-8d9b1ba8362b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:56.509341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 47/89] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:27:56 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:56.509941 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d492c0-fb1c-4269-b902-8d9b1ba8362b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:56.523496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ded240-7cd2-400f-97ee-f62e674810f2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:56.562478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a9fef-03e2-4a50-893b-834a0755a3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:56.563146 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a9fef-03e2-4a50-893b-834a0755a3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:56.563467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a9fef-03e2-4a50-893b-834a0755a3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:56.563750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a9fef-03e2-4a50-893b-834a0755a3c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:56.564604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a9fef-03e2-4a50-893b-834a0755a3c1 None admin] RBAC: Adding query filter params (role.id=e9451c79645545d78e667c61eece4ec8, scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b, user.id=354ba81d4750484ba041dc7f2f2438f1) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:56.564922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a9fef-03e2-4a50-893b-834a0755a3c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:56.567139 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a9fef-03e2-4a50-893b-834a0755a3c1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:56.573669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:56.587548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 43/90] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:27:56 2022] GET /identity/v3/role_assignments?user.id=354ba81d4750484ba041dc7f2f2438f1&scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b&role.id=e9451c79645545d78e667c61eece4ec8 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:56.588842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a9fef-03e2-4a50-893b-834a0755a3c1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:56.653771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d492c0-fb1c-4269-b902-8d9b1ba8362b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:56.698320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d6074-ea2a-472d-8217-53a5efde03c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:56.700253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d6074-ea2a-472d-8217-53a5efde03c8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:56.700645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d6074-ea2a-472d-8217-53a5efde03c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:56.701025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d6074-ea2a-472d-8217-53a5efde03c8 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:56.702460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d6074-ea2a-472d-8217-53a5efde03c8 None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:56.704155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d6074-ea2a-472d-8217-53a5efde03c8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:56.706920 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 48/91] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:27:56 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:56.707809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d6074-ea2a-472d-8217-53a5efde03c8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:56.714735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:56.744458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a9fef-03e2-4a50-893b-834a0755a3c1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:56.803409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a53662-11b0-44c1-97d9-939bd3eea0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:56.804303 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a53662-11b0-44c1-97d9-939bd3eea0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:56.804589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a53662-11b0-44c1-97d9-939bd3eea0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:56.804868 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a53662-11b0-44c1-97d9-939bd3eea0d7 None admin] PATH_INFO: `/v3/users/354ba81d4750484ba041dc7f2f2438f1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:56.806111 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a53662-11b0-44c1-97d9-939bd3eea0d7 None admin] RBAC: Authorizing `identity:get_user(user_id=354ba81d4750484ba041dc7f2f2438f1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:56.807621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a53662-11b0-44c1-97d9-939bd3eea0d7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:56.809577 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 44/92] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:27:56 2022] GET /identity/v3/users/354ba81d4750484ba041dc7f2f2438f1 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:56.810472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a53662-11b0-44c1-97d9-939bd3eea0d7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:56.844751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d6074-ea2a-472d-8217-53a5efde03c8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:56.879677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:56.889570 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4cb2a-33e5-4d2b-ac86-42c89feabdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:56.890627 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4cb2a-33e5-4d2b-ac86-42c89feabdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:56.890923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4cb2a-33e5-4d2b-ac86-42c89feabdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:56.891537 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4cb2a-33e5-4d2b-ac86-42c89feabdb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:56.892690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4cb2a-33e5-4d2b-ac86-42c89feabdb6 None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b, user.id=cfed129aafe54696bb42f388ec9baac7) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:56.893024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4cb2a-33e5-4d2b-ac86-42c89feabdb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:56.895209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4cb2a-33e5-4d2b-ac86-42c89feabdb6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:56.903501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 49/93] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:27:56 2022] GET /identity/v3/role_assignments?user.id=cfed129aafe54696bb42f388ec9baac7&scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:56.904337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4cb2a-33e5-4d2b-ac86-42c89feabdb6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:56.945497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a53662-11b0-44c1-97d9-939bd3eea0d7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:57.005308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:57.051975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddebe2f-ae32-4c90-b9bb-f6f8d1633c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:57.052670 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddebe2f-ae32-4c90-b9bb-f6f8d1633c3b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:57.052957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddebe2f-ae32-4c90-b9bb-f6f8d1633c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:57.053240 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddebe2f-ae32-4c90-b9bb-f6f8d1633c3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:57.054105 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddebe2f-ae32-4c90-b9bb-f6f8d1633c3b None admin] RBAC: Adding query filter params (role.id=4f0522c790e94492976ef2674f85ad66, scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b, user.id=354ba81d4750484ba041dc7f2f2438f1) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:57.054425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddebe2f-ae32-4c90-b9bb-f6f8d1633c3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:57.056034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddebe2f-ae32-4c90-b9bb-f6f8d1633c3b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:57.073261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4cb2a-33e5-4d2b-ac86-42c89feabdb6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:57.073472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 45/94] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:27:56 2022] GET /identity/v3/role_assignments?user.id=354ba81d4750484ba041dc7f2f2438f1&scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b&role.id=4f0522c790e94492976ef2674f85ad66 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:57.138984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f189cc-f8f7-48c6-9c8a-5448d6adc555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:57.139685 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f189cc-f8f7-48c6-9c8a-5448d6adc555 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:57.139981 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f189cc-f8f7-48c6-9c8a-5448d6adc555 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:57.140268 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f189cc-f8f7-48c6-9c8a-5448d6adc555 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:57.243222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f189cc-f8f7-48c6-9c8a-5448d6adc555 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:57.244707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f189cc-f8f7-48c6-9c8a-5448d6adc555 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:57.317461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:57.353926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 50/95] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:27:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:27:57.360272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddebe2f-ae32-4c90-b9bb-f6f8d1633c3b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:57.524620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddebe2f-ae32-4c90-b9bb-f6f8d1633c3b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:57.556147 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:57.561020 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6f95f-fb12-4993-a7cc-87b50b0e9da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:57.561909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6f95f-fb12-4993-a7cc-87b50b0e9da2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:57.562201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6f95f-fb12-4993-a7cc-87b50b0e9da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:57.562488 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6f95f-fb12-4993-a7cc-87b50b0e9da2 None admin] PATH_INFO: `/v3/projects/15d185d4c1384be495dfe3da9e5e6da1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:57.563745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6f95f-fb12-4993-a7cc-87b50b0e9da2 None admin] RBAC: Authorizing `identity:get_project(project_id=15d185d4c1384be495dfe3da9e5e6da1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:57.565482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6f95f-fb12-4993-a7cc-87b50b0e9da2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:57.570858 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 46/96] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:27:57 2022] GET /identity/v3/projects/15d185d4c1384be495dfe3da9e5e6da1 => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:57.576479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f189cc-f8f7-48c6-9c8a-5448d6adc555 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:57.683039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f189cc-f8f7-48c6-9c8a-5448d6adc555 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:57.718403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cd728-ee8b-43c8-ba13-31cab9336e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:57.719075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cd728-ee8b-43c8-ba13-31cab9336e9c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:57.719393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cd728-ee8b-43c8-ba13-31cab9336e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:57.719674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cd728-ee8b-43c8-ba13-31cab9336e9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:57.720516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cd728-ee8b-43c8-ba13-31cab9336e9c None admin] RBAC: Adding query filter params (role.id=e9451c79645545d78e667c61eece4ec8, scope.project.id=15d185d4c1384be495dfe3da9e5e6da1, user.id=354ba81d4750484ba041dc7f2f2438f1) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:27:57.720834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cd728-ee8b-43c8-ba13-31cab9336e9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:27:57.722428 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cd728-ee8b-43c8-ba13-31cab9336e9c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:27:57.728768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 51/97] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:27:57 2022] GET /identity/v3/role_assignments?user.id=354ba81d4750484ba041dc7f2f2438f1&scope.project.id=15d185d4c1384be495dfe3da9e5e6da1&role.id=e9451c79645545d78e667c61eece4ec8 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:27:59.304876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae7eb7-810f-462c-ad38-b09c3eb6f6e4 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:59.305893 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae7eb7-810f-462c-ad38-b09c3eb6f6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:59.306381 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae7eb7-810f-462c-ad38-b09c3eb6f6e4 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:59.308400 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 47/98] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:59.313529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0bdcb-1d61-44ba-86a9-6fa7a45c54dd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:59.314373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0bdcb-1d61-44ba-86a9-6fa7a45c54dd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:59.314851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0bdcb-1d61-44ba-86a9-6fa7a45c54dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:59.336172 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f1d0bdcb-1d61-44ba-86a9-6fa7a45c54dd None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:59.337716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f1d0bdcb-1d61-44ba-86a9-6fa7a45c54dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:59.369853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:59.421640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 52/99] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:27:59.456439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae7eb7-810f-462c-ad38-b09c3eb6f6e4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:59.464702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218e0ee-a118-4af7-9ded-cb0fa703fd00 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:59.465244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218e0ee-a118-4af7-9ded-cb0fa703fd00 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:59.465695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218e0ee-a118-4af7-9ded-cb0fa703fd00 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:59.467262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 53/100] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:59.473571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa085c-2408-4af7-abec-68d2d16ec373 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:59.474112 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa085c-2408-4af7-abec-68d2d16ec373 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:59.474564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa085c-2408-4af7-abec-68d2d16ec373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:59.496452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7bfa085c-2408-4af7-abec-68d2d16ec373 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:59.498675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7bfa085c-2408-4af7-abec-68d2d16ec373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:59.605686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 54/101] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:27:59.611261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d302148-f5a3-4849-83ab-9767b1bb07ec None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:59.611585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d302148-f5a3-4849-83ab-9767b1bb07ec None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:59.611875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d302148-f5a3-4849-83ab-9767b1bb07ec None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:59.613397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 55/102] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:27:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:27:59.618821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e4b6-0f07-49f4-9aba-51056e619387 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:59.619111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e4b6-0f07-49f4-9aba-51056e619387 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:59.619416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e4b6-0f07-49f4-9aba-51056e619387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:59.636051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae7eb7-810f-462c-ad38-b09c3eb6f6e4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:59.661953 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5007e4b6-0f07-49f4-9aba-51056e619387 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:27:59.663151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5007e4b6-0f07-49f4-9aba-51056e619387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:27:59.722032 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7b7a7-9364-4a8a-ae2c-91c5c946e4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:27:59.722840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b7a7-9364-4a8a-ae2c-91c5c946e4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:27:59.723125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b7a7-9364-4a8a-ae2c-91c5c946e4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:27:59.723991 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b7a7-9364-4a8a-ae2c-91c5c946e4b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:27:59.747853 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7b7a7-9364-4a8a-ae2c-91c5c946e4b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-49f7b7a7-9364-4a8a-ae2c-91c5c946e4b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:27:59.760939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:27:59.761794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:27:59.762538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:27:59.762538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:27:59.762538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:27:59.762538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:27:59.762538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:27:59.762538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:27:59.762538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:27:59.762538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:27:59.762538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:27:59.762538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:27:59.762538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:27:59.762538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:27:59.762538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 48/103] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:27:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:27:59.763197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7b7a7-9364-4a8a-ae2c-91c5c946e4b1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:59.793301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 56/104] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:27:59.794191 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007e4b6-0f07-49f4-9aba-51056e619387 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:27:59.835853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:59.881311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:27:59.956057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007e4b6-0f07-49f4-9aba-51056e619387 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:27:59.960018 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7b7a7-9364-4a8a-ae2c-91c5c946e4b1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:00.009439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3affa-7cd9-40af-a254-777cbbc2563b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:00.010239 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3affa-7cd9-40af-a254-777cbbc2563b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:00.010524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3affa-7cd9-40af-a254-777cbbc2563b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:00.010799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3affa-7cd9-40af-a254-777cbbc2563b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:00.013038 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca268-b7b2-47c2-8b16-c3f64fed94ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:00.014225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca268-b7b2-47c2-8b16-c3f64fed94ac None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:00.014717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca268-b7b2-47c2-8b16-c3f64fed94ac None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:00.015216 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca268-b7b2-47c2-8b16-c3f64fed94ac None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:00.016552 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeca268-b7b2-47c2-8b16-c3f64fed94ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:00.017123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeca268-b7b2-47c2-8b16-c3f64fed94ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:00.019276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeca268-b7b2-47c2-8b16-c3f64fed94ac None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:00.021573 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3affa-7cd9-40af-a254-777cbbc2563b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:00.028829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 57/105] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:27:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:00.034128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca268-b7b2-47c2-8b16-c3f64fed94ac None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-2cc3affa-7cd9-40af-a254-777cbbc2563b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:00.034273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:00.035704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 49/106] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:27:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:00.036539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872031ea-0735-4b8c-8f11-1c57862b7427 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:00.037226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872031ea-0735-4b8c-8f11-1c57862b7427 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:00.037226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872031ea-0735-4b8c-8f11-1c57862b7427 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:00.037226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 50/107] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:00.037226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872031ea-0735-4b8c-8f11-1c57862b7427 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:00.151841 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872031ea-0735-4b8c-8f11-1c57862b7427 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:00.162543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:00.172124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:00.187991 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca268-b7b2-47c2-8b16-c3f64fed94ac None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:00.201481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24b662-9c1a-44f8-9b16-07ebde1a6027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:00.202849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24b662-9c1a-44f8-9b16-07ebde1a6027 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:00.203372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24b662-9c1a-44f8-9b16-07ebde1a6027 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:00.204300 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24b662-9c1a-44f8-9b16-07ebde1a6027 None admin] PATH_INFO: `/v3/users/4d2f2a2663fa4f05a544d9486a865240` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:00.223355 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24b662-9c1a-44f8-9b16-07ebde1a6027 None admin] RBAC: Authorizing `identity:get_user(user_id=4d2f2a2663fa4f05a544d9486a865240)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:00.224689 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87179ca-2fb7-4ab1-9211-d3668c0fe184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:00.225187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24b662-9c1a-44f8-9b16-07ebde1a6027 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:00.225493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87179ca-2fb7-4ab1-9211-d3668c0fe184 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:00.225783 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87179ca-2fb7-4ab1-9211-d3668c0fe184 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:00.226062 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87179ca-2fb7-4ab1-9211-d3668c0fe184 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:00.230799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 51/108] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:00 2022] GET /identity/v3/users/4d2f2a2663fa4f05a544d9486a865240 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:00.230919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87179ca-2fb7-4ab1-9211-d3668c0fe184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:00.230990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24b662-9c1a-44f8-9b16-07ebde1a6027 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:00.231055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87179ca-2fb7-4ab1-9211-d3668c0fe184 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:00.231055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 58/109] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:00.231852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a21aa2-fb0d-4401-a019-00abe2c6e62b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:00.232137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a21aa2-fb0d-4401-a019-00abe2c6e62b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:00.232588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a21aa2-fb0d-4401-a019-00abe2c6e62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:00.248634 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-85a21aa2-fb0d-4401-a019-00abe2c6e62b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:00.249827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-85a21aa2-fb0d-4401-a019-00abe2c6e62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:00.322464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 59/110] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:00.332240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd973ced-c712-4bef-8e6b-2a080dc9e0f2 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:00.332240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd973ced-c712-4bef-8e6b-2a080dc9e0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:00.332240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd973ced-c712-4bef-8e6b-2a080dc9e0f2 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:00.332240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 60/111] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:00.332240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd973ced-c712-4bef-8e6b-2a080dc9e0f2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:00.352558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24b662-9c1a-44f8-9b16-07ebde1a6027 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:00.387458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e14b00-8290-454e-a8d3-250947233f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:00.388132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e14b00-8290-454e-a8d3-250947233f8d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:00.388419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e14b00-8290-454e-a8d3-250947233f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:00.388699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e14b00-8290-454e-a8d3-250947233f8d None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:00.389497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e14b00-8290-454e-a8d3-250947233f8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:00.389781 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e14b00-8290-454e-a8d3-250947233f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:00.391160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e14b00-8290-454e-a8d3-250947233f8d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:00.400320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 52/112] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:00.405364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e14b00-8290-454e-a8d3-250947233f8d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:00.417426 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:00.439718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd973ced-c712-4bef-8e6b-2a080dc9e0f2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:00.448918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:00.479530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdfdb4-0878-4dc5-bb51-204243ef1e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:00.480526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdfdb4-0878-4dc5-bb51-204243ef1e14 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:00.480821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdfdb4-0878-4dc5-bb51-204243ef1e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:00.481101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdfdb4-0878-4dc5-bb51-204243ef1e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:00.519614 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e14b00-8290-454e-a8d3-250947233f8d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:00.556480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdfdb4-0878-4dc5-bb51-204243ef1e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:00.558102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdfdb4-0878-4dc5-bb51-204243ef1e14 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:00.558202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28009f9-34a2-45e8-acfb-3a81137eceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:00.558870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28009f9-34a2-45e8-acfb-3a81137eceb1 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:00.559164 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28009f9-34a2-45e8-acfb-3a81137eceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:00.559474 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28009f9-34a2-45e8-acfb-3a81137eceb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:00.560358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28009f9-34a2-45e8-acfb-3a81137eceb1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:00.562608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28009f9-34a2-45e8-acfb-3a81137eceb1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:00.594913 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 53/113] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:28:00 2022] POST /identity/v3/projects => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:28:00.596230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3937b-f834-4f71-8fe4-903fed70a16a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:00.596524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3937b-f834-4f71-8fe4-903fed70a16a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:00.596837 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3937b-f834-4f71-8fe4-903fed70a16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:00.621448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8bd3937b-f834-4f71-8fe4-903fed70a16a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:00.622772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8bd3937b-f834-4f71-8fe4-903fed70a16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:00.680764 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:00.711080 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 61/114] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:00.712984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdfdb4-0878-4dc5-bb51-204243ef1e14 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:00.721213 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 54/115] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:00.721213 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3937b-f834-4f71-8fe4-903fed70a16a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:00.758962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:00.850864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdfdb4-0878-4dc5-bb51-204243ef1e14 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:00.867081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3937b-f834-4f71-8fe4-903fed70a16a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:00.886012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432e19b-d83f-44ff-bf9f-92da183da1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:00.886828 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e19b-d83f-44ff-bf9f-92da183da1cb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:00.887116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e19b-d83f-44ff-bf9f-92da183da1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:00.887424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e19b-d83f-44ff-bf9f-92da183da1cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:00.899564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432e19b-d83f-44ff-bf9f-92da183da1cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:00.904130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7d877-dffd-4bb0-aed8-bcae87dffd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:00.905010 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7d877-dffd-4bb0-aed8-bcae87dffd40 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:00.905292 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7d877-dffd-4bb0-aed8-bcae87dffd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:00.905566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7d877-dffd-4bb0-aed8-bcae87dffd40 None admin] PATH_INFO: `/v3/users/354ba81d4750484ba041dc7f2f2438f1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:00.906760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7d877-dffd-4bb0-aed8-bcae87dffd40 None admin] RBAC: Authorizing `identity:get_user(user_id=354ba81d4750484ba041dc7f2f2438f1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:00.908256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7d877-dffd-4bb0-aed8-bcae87dffd40 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e432e19b-d83f-44ff-bf9f-92da183da1cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:00.908909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:00.909755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:00.911288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:00.911288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:00.911288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:00.911288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:00.911288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:00.911288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:00.911288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:00.911288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:00.911288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:00.911288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:00.911288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:00.911288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:00.912090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 55/116] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:00 2022] GET /identity/v3/users/354ba81d4750484ba041dc7f2f2438f1 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:00.912158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 62/117] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:28:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:00.912158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432e19b-d83f-44ff-bf9f-92da183da1cb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:00.915780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7d877-dffd-4bb0-aed8-bcae87dffd40 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:00.955887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:01.009724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:01.014541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432e19b-d83f-44ff-bf9f-92da183da1cb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:01.023560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7d877-dffd-4bb0-aed8-bcae87dffd40 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:01.050407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bc6f9-4535-4296-95b7-9c88eb8ee3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:01.051264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc6f9-4535-4296-95b7-9c88eb8ee3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:01.051556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc6f9-4535-4296-95b7-9c88eb8ee3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:01.051843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc6f9-4535-4296-95b7-9c88eb8ee3d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:01.060144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78704196-7819-48f1-95cf-e619b24e38a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:01.061015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78704196-7819-48f1-95cf-e619b24e38a4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:01.061299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78704196-7819-48f1-95cf-e619b24e38a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:01.061730 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78704196-7819-48f1-95cf-e619b24e38a4 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:01.062312 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bc6f9-4535-4296-95b7-9c88eb8ee3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:01.063140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78704196-7819-48f1-95cf-e619b24e38a4 None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:01.064641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78704196-7819-48f1-95cf-e619b24e38a4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:01.067061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 56/118] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:00 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:01.069349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e780b-6382-48bb-8a8e-557859e1e957 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:01.069851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e780b-6382-48bb-8a8e-557859e1e957 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:01.070321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e780b-6382-48bb-8a8e-557859e1e957 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ef5bc6f9-4535-4296-95b7-9c88eb8ee3d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:01.070729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:01.071580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:01.072345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:01.072345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:01.072345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:01.072345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:01.072345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:01.072345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:01.072345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:01.072345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:01.072345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:01.072345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:01.072345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:01.072345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:01.072345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 63/119] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:28:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:01.072961 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bc6f9-4535-4296-95b7-9c88eb8ee3d2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:01.074778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 57/120] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:01.075756 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e780b-6382-48bb-8a8e-557859e1e957 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:01.185237 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bc6f9-4535-4296-95b7-9c88eb8ee3d2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:01.185867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e780b-6382-48bb-8a8e-557859e1e957 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:01.187642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:01.224209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797e8c6-7224-46f8-af10-6b1daad12087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:01.224965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797e8c6-7224-46f8-af10-6b1daad12087 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:01.225402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797e8c6-7224-46f8-af10-6b1daad12087 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:01.225777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797e8c6-7224-46f8-af10-6b1daad12087 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:01.226673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797e8c6-7224-46f8-af10-6b1daad12087 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:01.227110 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797e8c6-7224-46f8-af10-6b1daad12087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:01.228533 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e5f5f-5df2-4fbe-ba73-5c83278db6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:01.228705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797e8c6-7224-46f8-af10-6b1daad12087 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:01.229413 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e5f5f-5df2-4fbe-ba73-5c83278db6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:01.229708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e5f5f-5df2-4fbe-ba73-5c83278db6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:01.229992 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e5f5f-5df2-4fbe-ba73-5c83278db6f2 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:01.231230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e5f5f-5df2-4fbe-ba73-5c83278db6f2 None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:01.232722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e5f5f-5df2-4fbe-ba73-5c83278db6f2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:01.239163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 64/121] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:01 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:01.239163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e5f5f-5df2-4fbe-ba73-5c83278db6f2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:01.243355 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 58/122] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:01.248379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797e8c6-7224-46f8-af10-6b1daad12087 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:01.273209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:01.347790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e5f5f-5df2-4fbe-ba73-5c83278db6f2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:01.363846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797e8c6-7224-46f8-af10-6b1daad12087 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:01.385055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a9e9d-82cc-4321-9362-5dea8e6d45ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:01.385849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a9e9d-82cc-4321-9362-5dea8e6d45ef None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:01.386215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a9e9d-82cc-4321-9362-5dea8e6d45ef None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:01.386565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a9e9d-82cc-4321-9362-5dea8e6d45ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:01.387631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a9e9d-82cc-4321-9362-5dea8e6d45ef None admin] RBAC: Adding query filter params (role.id=45c107a1713445dcbcc66380d2666ae5, scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b, user.id=4d2f2a2663fa4f05a544d9486a865240) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:01.388047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a9e9d-82cc-4321-9362-5dea8e6d45ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:01.389587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a9e9d-82cc-4321-9362-5dea8e6d45ef None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:01.396129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 65/123] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:01 2022] GET /identity/v3/role_assignments?user.id=4d2f2a2663fa4f05a544d9486a865240&scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b&role.id=45c107a1713445dcbcc66380d2666ae5 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:01.397653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bd7be-faff-4d79-8090-c9be23bd439b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:01.397942 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bd7be-faff-4d79-8090-c9be23bd439b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:01.398218 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bd7be-faff-4d79-8090-c9be23bd439b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:01.413243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d6d96-407d-468f-b208-91e3ce45971c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:01.414344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d6d96-407d-468f-b208-91e3ce45971c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:01.414834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d6d96-407d-468f-b208-91e3ce45971c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:01.415384 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d6d96-407d-468f-b208-91e3ce45971c None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:01.416494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d6d96-407d-468f-b208-91e3ce45971c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:01.416956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-811bd7be-faff-4d79-8090-c9be23bd439b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:01.417463 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d6d96-407d-468f-b208-91e3ce45971c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:01.418189 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-811bd7be-faff-4d79-8090-c9be23bd439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:01.419384 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d6d96-407d-468f-b208-91e3ce45971c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:01.433197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 59/124] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:01.434714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d6d96-407d-468f-b208-91e3ce45971c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:01.451909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:01.504010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 66/125] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:01.509720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bd7be-faff-4d79-8090-c9be23bd439b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:01.563973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:01.602429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d6d96-407d-468f-b208-91e3ce45971c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:01.624911 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bd7be-faff-4d79-8090-c9be23bd439b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:01.640060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e930a-9c64-456a-b5d9-40eb8f02afa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:01.641364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e930a-9c64-456a-b5d9-40eb8f02afa4 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:01.641913 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e930a-9c64-456a-b5d9-40eb8f02afa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:01.642388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e930a-9c64-456a-b5d9-40eb8f02afa4 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b/users/354ba81d4750484ba041dc7f2f2438f1/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:01.645343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e930a-9c64-456a-b5d9-40eb8f02afa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d676d249fb5d4c0fa1addc459fc2e34b, user_id=354ba81d4750484ba041dc7f2f2438f1, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:01.647371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e930a-9c64-456a-b5d9-40eb8f02afa4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:01.663163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7660e-c0a5-47cd-84e5-5c8548a12f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:01.664125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7660e-c0a5-47cd-84e5-5c8548a12f54 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:01.664462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7660e-c0a5-47cd-84e5-5c8548a12f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:01.664738 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7660e-c0a5-47cd-84e5-5c8548a12f54 None admin] PATH_INFO: `/v3/users/354ba81d4750484ba041dc7f2f2438f1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:01.666064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7660e-c0a5-47cd-84e5-5c8548a12f54 None admin] RBAC: Authorizing `identity:get_user(user_id=354ba81d4750484ba041dc7f2f2438f1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:01.667878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7660e-c0a5-47cd-84e5-5c8548a12f54 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:01.668092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 60/126] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:28:01 2022] PUT /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b/users/354ba81d4750484ba041dc7f2f2438f1/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:28:01.669115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e930a-9c64-456a-b5d9-40eb8f02afa4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:01.673089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 67/127] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:01 2022] GET /identity/v3/users/354ba81d4750484ba041dc7f2f2438f1 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:01.678299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7660e-c0a5-47cd-84e5-5c8548a12f54 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:01.762223 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:01.810318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e930a-9c64-456a-b5d9-40eb8f02afa4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:01.852850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f126a-5771-4951-9f43-7ba49a45292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:01.854255 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f126a-5771-4951-9f43-7ba49a45292e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:01.855071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f126a-5771-4951-9f43-7ba49a45292e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:01.856439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f126a-5771-4951-9f43-7ba49a45292e None admin] PATH_INFO: `/v3/users/cfed129aafe54696bb42f388ec9baac7` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:01.857963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f126a-5771-4951-9f43-7ba49a45292e None admin] RBAC: Authorizing `identity:get_user(user_id=cfed129aafe54696bb42f388ec9baac7)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:01.859701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f126a-5771-4951-9f43-7ba49a45292e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:01.863004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 61/128] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:01 2022] GET /identity/v3/users/cfed129aafe54696bb42f388ec9baac7 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:01.864517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f126a-5771-4951-9f43-7ba49a45292e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:01.891568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:01.934246 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7660e-c0a5-47cd-84e5-5c8548a12f54 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:01.993702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f126a-5771-4951-9f43-7ba49a45292e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:01.997211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bd3e7-d49c-4bb0-aa69-f4512add180a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:01.998032 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd3e7-d49c-4bb0-aa69-f4512add180a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:01.998323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd3e7-d49c-4bb0-aa69-f4512add180a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:01.998664 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd3e7-d49c-4bb0-aa69-f4512add180a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:02.023439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bd3e7-d49c-4bb0-aa69-f4512add180a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2c3bd3e7-d49c-4bb0-aa69-f4512add180a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:02.031124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:02.031987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:02.032745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:02.032745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:02.032745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:02.032745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:02.032745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:02.032745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:02.032745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:02.032745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:02.032745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:02.032745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:02.032745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:02.032745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:02.032745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 68/129] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:02.040679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bd3e7-d49c-4bb0-aa69-f4512add180a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:02.064855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b13b3-92e9-488e-aa4f-75a82a5cc1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:02.066356 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b13b3-92e9-488e-aa4f-75a82a5cc1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:02.066656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b13b3-92e9-488e-aa4f-75a82a5cc1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:02.066997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b13b3-92e9-488e-aa4f-75a82a5cc1b3 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:02.069403 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b13b3-92e9-488e-aa4f-75a82a5cc1b3 None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:02.070882 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b13b3-92e9-488e-aa4f-75a82a5cc1b3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:02.073152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 62/130] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:01 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:02.073923 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b13b3-92e9-488e-aa4f-75a82a5cc1b3 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:02.213454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:02.231258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bd3e7-d49c-4bb0-aa69-f4512add180a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:02.233654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:02.265276 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b13b3-92e9-488e-aa4f-75a82a5cc1b3 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:02.308839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1803f-4c54-4974-9cef-dffbd814dc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:02.309528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1803f-4c54-4974-9cef-dffbd814dc94 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:02.309821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1803f-4c54-4974-9cef-dffbd814dc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:02.310107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1803f-4c54-4974-9cef-dffbd814dc94 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:02.310864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1803f-4c54-4974-9cef-dffbd814dc94 None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:02.311196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1803f-4c54-4974-9cef-dffbd814dc94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:02.313086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1803f-4c54-4974-9cef-dffbd814dc94 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:02.322273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 63/131] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:02.323062 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1803f-4c54-4974-9cef-dffbd814dc94 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:02.328498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79418fa-6e9a-43f7-8ce7-e21bb6d577b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:02.329382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79418fa-6e9a-43f7-8ce7-e21bb6d577b0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:02.329668 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79418fa-6e9a-43f7-8ce7-e21bb6d577b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:02.329944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79418fa-6e9a-43f7-8ce7-e21bb6d577b0 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:02.336035 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79418fa-6e9a-43f7-8ce7-e21bb6d577b0 None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:02.337558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79418fa-6e9a-43f7-8ce7-e21bb6d577b0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:02.339371 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 69/132] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:02 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:02.342294 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79418fa-6e9a-43f7-8ce7-e21bb6d577b0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:02.452223 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79418fa-6e9a-43f7-8ce7-e21bb6d577b0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:02.526546 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdfc2a-3581-464d-829a-f3c894b8ef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:02.529304 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdfc2a-3581-464d-829a-f3c894b8ef05 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:02.529596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdfc2a-3581-464d-829a-f3c894b8ef05 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:02.529877 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdfc2a-3581-464d-829a-f3c894b8ef05 None admin] PATH_INFO: `/v3/users/354ba81d4750484ba041dc7f2f2438f1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:02.531130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdfc2a-3581-464d-829a-f3c894b8ef05 None admin] RBAC: Authorizing `identity:get_user(user_id=354ba81d4750484ba041dc7f2f2438f1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:02.532654 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdfc2a-3581-464d-829a-f3c894b8ef05 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:02.534853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 70/133] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:02 2022] GET /identity/v3/users/354ba81d4750484ba041dc7f2f2438f1 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:02.537160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1803f-4c54-4974-9cef-dffbd814dc94 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:02.548119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdfc2a-3581-464d-829a-f3c894b8ef05 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:02.578155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef867c9-0aa0-43ef-b3c2-c46ea20d6a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:02.579277 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef867c9-0aa0-43ef-b3c2-c46ea20d6a37 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:02.579648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef867c9-0aa0-43ef-b3c2-c46ea20d6a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:02.580008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef867c9-0aa0-43ef-b3c2-c46ea20d6a37 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b/users/354ba81d4750484ba041dc7f2f2438f1/roles/4f0522c790e94492976ef2674f85ad66` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:02.594109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef867c9-0aa0-43ef-b3c2-c46ea20d6a37 None admin] RBAC: Authorizing `identity:create_grant(project_id=d676d249fb5d4c0fa1addc459fc2e34b, user_id=354ba81d4750484ba041dc7f2f2438f1, role_id=4f0522c790e94492976ef2674f85ad66)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:02.595819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef867c9-0aa0-43ef-b3c2-c46ea20d6a37 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:02.611706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:02.619537 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:02.619841 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 64/134] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:28:02 2022] PUT /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b/users/354ba81d4750484ba041dc7f2f2438f1/roles/4f0522c790e94492976ef2674f85ad66 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:28:02.620684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef867c9-0aa0-43ef-b3c2-c46ea20d6a37 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:02.710750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdfc2a-3581-464d-829a-f3c894b8ef05 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:02.766258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683aa5d-a3b2-41a5-8172-86309be63c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:02.767198 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683aa5d-a3b2-41a5-8172-86309be63c95 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:02.767567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683aa5d-a3b2-41a5-8172-86309be63c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:02.767855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683aa5d-a3b2-41a5-8172-86309be63c95 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b/users/cfed129aafe54696bb42f388ec9baac7/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:02.770322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683aa5d-a3b2-41a5-8172-86309be63c95 None admin] RBAC: Authorizing `identity:create_grant(project_id=d676d249fb5d4c0fa1addc459fc2e34b, user_id=cfed129aafe54696bb42f388ec9baac7, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:02.772107 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683aa5d-a3b2-41a5-8172-86309be63c95 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:02.807794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 71/135] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:28:02 2022] PUT /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b/users/cfed129aafe54696bb42f388ec9baac7/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:28:02.891075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef867c9-0aa0-43ef-b3c2-c46ea20d6a37 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:02.933116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010c9e7-df89-45c7-b65a-ddabe29471fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:02.934007 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010c9e7-df89-45c7-b65a-ddabe29471fa None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:02.934291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010c9e7-df89-45c7-b65a-ddabe29471fa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:02.934571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010c9e7-df89-45c7-b65a-ddabe29471fa None admin] PATH_INFO: `/v3/projects/15d185d4c1384be495dfe3da9e5e6da1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:02.940154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010c9e7-df89-45c7-b65a-ddabe29471fa None admin] RBAC: Authorizing `identity:get_project(project_id=15d185d4c1384be495dfe3da9e5e6da1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:02.942254 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010c9e7-df89-45c7-b65a-ddabe29471fa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:02.944154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 65/136] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:02 2022] GET /identity/v3/projects/15d185d4c1384be495dfe3da9e5e6da1 => generated 312 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:02.950072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683aa5d-a3b2-41a5-8172-86309be63c95 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:02.986963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe52701-bf69-4150-ada5-11aae4c0ce36 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:02.987960 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe52701-bf69-4150-ada5-11aae4c0ce36 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:02.988318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe52701-bf69-4150-ada5-11aae4c0ce36 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:02.989697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 66/137] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:28:03.002349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bb9c6-063e-4c20-bbcd-6922f047d600 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:03.002672 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bb9c6-063e-4c20-bbcd-6922f047d600 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:03.003013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bb9c6-063e-4c20-bbcd-6922f047d600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:03.023656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3d1bb9c6-063e-4c20-bbcd-6922f047d600 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:03.024888 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3d1bb9c6-063e-4c20-bbcd-6922f047d600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:03.124505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:03.133033 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:03.148066 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683aa5d-a3b2-41a5-8172-86309be63c95 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:03.154026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 67/138] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:03.187843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a8fbe-1755-4238-9c89-0e3da67a6436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:03.189061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a8fbe-1755-4238-9c89-0e3da67a6436 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:03.189617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a8fbe-1755-4238-9c89-0e3da67a6436 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:03.190074 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a8fbe-1755-4238-9c89-0e3da67a6436 None admin] PATH_INFO: `/v3/projects/15d185d4c1384be495dfe3da9e5e6da1/users/354ba81d4750484ba041dc7f2f2438f1/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:03.192448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a8fbe-1755-4238-9c89-0e3da67a6436 None admin] RBAC: Authorizing `identity:create_grant(project_id=15d185d4c1384be495dfe3da9e5e6da1, user_id=354ba81d4750484ba041dc7f2f2438f1, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:03.194097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a8fbe-1755-4238-9c89-0e3da67a6436 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:03.208620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bb9c6-063e-4c20-bbcd-6922f047d600 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:03.218780 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 72/139] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:28:02 2022] PUT /identity/v3/projects/15d185d4c1384be495dfe3da9e5e6da1/users/354ba81d4750484ba041dc7f2f2438f1/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:28:03.357658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bb9c6-063e-4c20-bbcd-6922f047d600 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:03.405990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc9701-0a41-474d-855f-1374fc49d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:03.406724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc9701-0a41-474d-855f-1374fc49d80e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:03.407015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc9701-0a41-474d-855f-1374fc49d80e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:03.407326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc9701-0a41-474d-855f-1374fc49d80e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:03.411104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc9701-0a41-474d-855f-1374fc49d80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:03.412662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc9701-0a41-474d-855f-1374fc49d80e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:03.414703 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 68/140] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:03.420223 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a8fbe-1755-4238-9c89-0e3da67a6436 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:03.548959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a8fbe-1755-4238-9c89-0e3da67a6436 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:03.584914 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1317922-84f0-44f2-a97d-503a8f8c1189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:03.585905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1317922-84f0-44f2-a97d-503a8f8c1189 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:03.586373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1317922-84f0-44f2-a97d-503a8f8c1189 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:03.586829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1317922-84f0-44f2-a97d-503a8f8c1189 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:03.588307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1317922-84f0-44f2-a97d-503a8f8c1189 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:03.595193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1317922-84f0-44f2-a97d-503a8f8c1189 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:03.619965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 73/141] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:28:03 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:28:04.385013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630444eb-704e-49b3-99b6-5dae6154e305 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:04.385572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630444eb-704e-49b3-99b6-5dae6154e305 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:04.385663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630444eb-704e-49b3-99b6-5dae6154e305 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:04.387394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 69/142] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:04.394288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead29317-f743-4887-bac3-c8792305dd1a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:04.394597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead29317-f743-4887-bac3-c8792305dd1a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:04.394989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead29317-f743-4887-bac3-c8792305dd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:04.404326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:04.411428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cd0f4-0de2-4592-a50e-d566133e6a46 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:04.411721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cd0f4-0de2-4592-a50e-d566133e6a46 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:04.412009 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cd0f4-0de2-4592-a50e-d566133e6a46 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:04.413533 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 70/143] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:04.419872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8695a0-f476-48ff-a2f2-2e562ef45f78 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:04.420409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8695a0-f476-48ff-a2f2-2e562ef45f78 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:04.420902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8695a0-f476-48ff-a2f2-2e562ef45f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:04.423074 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ead29317-f743-4887-bac3-c8792305dd1a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:04.424320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ead29317-f743-4887-bac3-c8792305dd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:04.444512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3c8695a0-f476-48ff-a2f2-2e562ef45f78 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:04.446042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3c8695a0-f476-48ff-a2f2-2e562ef45f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:04.532978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:04.551459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 71/144] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:04.555435 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 74/145] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:04.576404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8695a0-f476-48ff-a2f2-2e562ef45f78 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:04.589168 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead29317-f743-4887-bac3-c8792305dd1a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:04.712604 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead29317-f743-4887-bac3-c8792305dd1a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:04.722859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8695a0-f476-48ff-a2f2-2e562ef45f78 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:04.765322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dfa8f-1023-4f73-ab2c-5896024ca657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:04.766136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dfa8f-1023-4f73-ab2c-5896024ca657 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:04.766421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dfa8f-1023-4f73-ab2c-5896024ca657 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:04.766699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dfa8f-1023-4f73-ab2c-5896024ca657 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:04.769329 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92177d0-312b-4044-9517-6ba0eaa58b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:04.770135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92177d0-312b-4044-9517-6ba0eaa58b68 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:04.770417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92177d0-312b-4044-9517-6ba0eaa58b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:04.770696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92177d0-312b-4044-9517-6ba0eaa58b68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:04.773032 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:04.789037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dfa8f-1023-4f73-ab2c-5896024ca657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-685dfa8f-1023-4f73-ab2c-5896024ca657 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:04.796797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:04.797675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:04.798466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:04.798466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:04.798466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:04.798466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:04.798466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:04.798466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:04.798466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:04.798466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:04.798466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:04.798466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:04.798466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:04.798466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:04.798466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 75/146] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:04.804931 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92177d0-312b-4044-9517-6ba0eaa58b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:04.808854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dfa8f-1023-4f73-ab2c-5896024ca657 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-d92177d0-312b-4044-9517-6ba0eaa58b68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:04.812824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:04.813657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:04.814411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:04.814411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:04.814411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:04.814411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:04.814411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:04.814411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:04.814411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:04.814411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:04.814411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:04.814411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:04.814411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:04.814411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:04.814411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 72/147] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:04.824261 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92177d0-312b-4044-9517-6ba0eaa58b68 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:04.938135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:05.002353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dfa8f-1023-4f73-ab2c-5896024ca657 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:05.051917 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67923575-9327-4064-8662-4777ec5fb3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:05.052810 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92177d0-312b-4044-9517-6ba0eaa58b68 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:05.053181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67923575-9327-4064-8662-4777ec5fb3fc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:05.053667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67923575-9327-4064-8662-4777ec5fb3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:05.054171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67923575-9327-4064-8662-4777ec5fb3fc None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:05.055353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67923575-9327-4064-8662-4777ec5fb3fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:05.055881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67923575-9327-4064-8662-4777ec5fb3fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:05.057497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67923575-9327-4064-8662-4777ec5fb3fc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:05.073475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 76/148] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:05.079158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67923575-9327-4064-8662-4777ec5fb3fc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:05.146882 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec5aca-ef21-4a4f-8cda-1ee342fd3c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:05.151216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5aca-ef21-4a4f-8cda-1ee342fd3c93 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:05.151216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5aca-ef21-4a4f-8cda-1ee342fd3c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:05.151216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5aca-ef21-4a4f-8cda-1ee342fd3c93 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:05.151216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec5aca-ef21-4a4f-8cda-1ee342fd3c93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:05.151216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec5aca-ef21-4a4f-8cda-1ee342fd3c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:05.151216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec5aca-ef21-4a4f-8cda-1ee342fd3c93 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:05.158560 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:05.176669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 73/149] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:05.200666 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec5aca-ef21-4a4f-8cda-1ee342fd3c93 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:05.218736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67923575-9327-4064-8662-4777ec5fb3fc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:05.262638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f2904-b338-41a0-bf99-b9359a230232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:05.263483 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f2904-b338-41a0-bf99-b9359a230232 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:05.263774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f2904-b338-41a0-bf99-b9359a230232 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:05.264052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f2904-b338-41a0-bf99-b9359a230232 None admin] PATH_INFO: `/v3/users/4d2f2a2663fa4f05a544d9486a865240` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:05.265346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f2904-b338-41a0-bf99-b9359a230232 None admin] RBAC: Authorizing `identity:get_user(user_id=4d2f2a2663fa4f05a544d9486a865240)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:05.266855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f2904-b338-41a0-bf99-b9359a230232 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:05.270082 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 77/150] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:05 2022] GET /identity/v3/users/4d2f2a2663fa4f05a544d9486a865240 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:05.275879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f2904-b338-41a0-bf99-b9359a230232 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:05.395359 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f2904-b338-41a0-bf99-b9359a230232 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:05.422504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:05.440705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c2be6-a9d7-4b0c-9813-cf8316492156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:05.441579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c2be6-a9d7-4b0c-9813-cf8316492156 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:05.441867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c2be6-a9d7-4b0c-9813-cf8316492156 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:05.442145 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c2be6-a9d7-4b0c-9813-cf8316492156 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:05.446520 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c2be6-a9d7-4b0c-9813-cf8316492156 None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:05.449743 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c2be6-a9d7-4b0c-9813-cf8316492156 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:05.451533 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 78/151] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:05 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:05.458235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c2be6-a9d7-4b0c-9813-cf8316492156 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:05.489336 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec5aca-ef21-4a4f-8cda-1ee342fd3c93 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:05.549041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:05.584611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85769b59-742e-4aaf-8b80-c49682547b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:05.585508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85769b59-742e-4aaf-8b80-c49682547b7a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:05.585793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85769b59-742e-4aaf-8b80-c49682547b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:05.586072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85769b59-742e-4aaf-8b80-c49682547b7a None admin] PATH_INFO: `/v3/users/354ba81d4750484ba041dc7f2f2438f1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:05.589282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85769b59-742e-4aaf-8b80-c49682547b7a None admin] RBAC: Authorizing `identity:get_user(user_id=354ba81d4750484ba041dc7f2f2438f1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:05.592478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85769b59-742e-4aaf-8b80-c49682547b7a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:05.592478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 74/152] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:05 2022] GET /identity/v3/users/354ba81d4750484ba041dc7f2f2438f1 => generated 275 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:05.600121 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85769b59-742e-4aaf-8b80-c49682547b7a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:05.622485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c2be6-a9d7-4b0c-9813-cf8316492156 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:05.674762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f5d38-708e-43e3-918e-db981c5122c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:05.676314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f5d38-708e-43e3-918e-db981c5122c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:05.676753 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f5d38-708e-43e3-918e-db981c5122c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:05.677222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f5d38-708e-43e3-918e-db981c5122c7 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b/users/4d2f2a2663fa4f05a544d9486a865240/roles/45c107a1713445dcbcc66380d2666ae5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:05.679534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f5d38-708e-43e3-918e-db981c5122c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d676d249fb5d4c0fa1addc459fc2e34b, user_id=4d2f2a2663fa4f05a544d9486a865240, role_id=45c107a1713445dcbcc66380d2666ae5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:05.681269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f5d38-708e-43e3-918e-db981c5122c7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:05.709898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 79/153] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:28:05 2022] PUT /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b/users/4d2f2a2663fa4f05a544d9486a865240/roles/45c107a1713445dcbcc66380d2666ae5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:28:05.750137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85769b59-742e-4aaf-8b80-c49682547b7a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:05.790951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ebad8-83cc-481d-a460-97b4dd30f399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:05.791814 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ebad8-83cc-481d-a460-97b4dd30f399 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:05.792104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ebad8-83cc-481d-a460-97b4dd30f399 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:05.792459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ebad8-83cc-481d-a460-97b4dd30f399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:05.855798 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:05.872668 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ebad8-83cc-481d-a460-97b4dd30f399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:05.874231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ebad8-83cc-481d-a460-97b4dd30f399 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:05.987364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 75/154] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:05.993534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f5d38-708e-43e3-918e-db981c5122c7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:06.070325 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:06.094548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f014a67-2d0d-49a8-8cf9-fef1e7557319 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:06.094872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f014a67-2d0d-49a8-8cf9-fef1e7557319 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:06.095123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f014a67-2d0d-49a8-8cf9-fef1e7557319 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:06.096777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 76/155] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:28:06.102635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c35b40-63cb-4f96-bae2-d2644f2d848c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:06.102915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c35b40-63cb-4f96-bae2-d2644f2d848c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:06.104826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c35b40-63cb-4f96-bae2-d2644f2d848c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:06.132394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e1c35b40-63cb-4f96-bae2-d2644f2d848c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:06.133541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e1c35b40-63cb-4f96-bae2-d2644f2d848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:06.146006 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f5d38-708e-43e3-918e-db981c5122c7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:06.212608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc32872-bb1d-4daf-b451-871ef9f796be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:06.220386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc32872-bb1d-4daf-b451-871ef9f796be None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:06.220727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc32872-bb1d-4daf-b451-871ef9f796be None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:06.221012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc32872-bb1d-4daf-b451-871ef9f796be None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:06.222587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc32872-bb1d-4daf-b451-871ef9f796be None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:06.226507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc32872-bb1d-4daf-b451-871ef9f796be None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:06.226507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 80/156] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:05 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:06.232327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc32872-bb1d-4daf-b451-871ef9f796be None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:06.260782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 77/157] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:06.322980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c35b40-63cb-4f96-bae2-d2644f2d848c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:06.348709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:06.433485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc32872-bb1d-4daf-b451-871ef9f796be None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:06.480438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:06.520328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba35cf8-6ac6-4994-90f6-c21653322aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:06.521379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba35cf8-6ac6-4994-90f6-c21653322aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:06.522134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba35cf8-6ac6-4994-90f6-c21653322aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:06.522626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba35cf8-6ac6-4994-90f6-c21653322aa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:06.523952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba35cf8-6ac6-4994-90f6-c21653322aa2 None admin] RBAC: Adding query filter params (role.id=e9451c79645545d78e667c61eece4ec8, scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b, user.id=354ba81d4750484ba041dc7f2f2438f1) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:06.524512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba35cf8-6ac6-4994-90f6-c21653322aa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:06.526594 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba35cf8-6ac6-4994-90f6-c21653322aa2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:06.532929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c35b40-63cb-4f96-bae2-d2644f2d848c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:06.538365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 81/158] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:06 2022] GET /identity/v3/role_assignments?user.id=354ba81d4750484ba041dc7f2f2438f1&scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b&role.id=e9451c79645545d78e667c61eece4ec8 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:06.539862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406739f-070e-4be0-b7e3-57c76385587c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:06.540160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406739f-070e-4be0-b7e3-57c76385587c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:06.540442 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406739f-070e-4be0-b7e3-57c76385587c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:06.541843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 82/159] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:06.551774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae488d-75f3-4c16-af42-56a476c00b36 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:06.552061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae488d-75f3-4c16-af42-56a476c00b36 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:06.552332 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae488d-75f3-4c16-af42-56a476c00b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:06.596235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f1ae488d-75f3-4c16-af42-56a476c00b36 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:06.598137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f1ae488d-75f3-4c16-af42-56a476c00b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:06.618412 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5cfcd-1d6a-4ec1-a2d0-92ff29593793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:06.619402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5cfcd-1d6a-4ec1-a2d0-92ff29593793 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:06.619686 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5cfcd-1d6a-4ec1-a2d0-92ff29593793 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:06.619960 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5cfcd-1d6a-4ec1-a2d0-92ff29593793 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:06.645203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5cfcd-1d6a-4ec1-a2d0-92ff29593793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-35a5cfcd-1d6a-4ec1-a2d0-92ff29593793 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:06.654049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:06.654970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:06.655764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:06.655764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:06.655764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:06.655764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:06.655764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:06.655764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:06.655764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:06.655764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:06.655764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:06.655764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:06.655764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:06.655764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:06.659858 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 78/160] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:28:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:06.665907 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5cfcd-1d6a-4ec1-a2d0-92ff29593793 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:06.753888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 83/161] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:06.805819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:06.835322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae488d-75f3-4c16-af42-56a476c00b36 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:06.850485 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5cfcd-1d6a-4ec1-a2d0-92ff29593793 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:06.913960 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e30094-db88-4cc2-a03b-3306b614ef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:06.914643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e30094-db88-4cc2-a03b-3306b614ef4d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:06.915031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e30094-db88-4cc2-a03b-3306b614ef4d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:06.915337 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e30094-db88-4cc2-a03b-3306b614ef4d None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:06.916092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e30094-db88-4cc2-a03b-3306b614ef4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:06.916400 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e30094-db88-4cc2-a03b-3306b614ef4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:06.917797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e30094-db88-4cc2-a03b-3306b614ef4d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:06.934649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 79/162] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:06.940111 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e30094-db88-4cc2-a03b-3306b614ef4d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:07.000892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae488d-75f3-4c16-af42-56a476c00b36 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:07.021759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:07.054724 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a22059-8762-4584-832e-0bc86f54311d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:07.055957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a22059-8762-4584-832e-0bc86f54311d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:07.056453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a22059-8762-4584-832e-0bc86f54311d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:07.056918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a22059-8762-4584-832e-0bc86f54311d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:07.068711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a22059-8762-4584-832e-0bc86f54311d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-31a22059-8762-4584-832e-0bc86f54311d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:07.077431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:07.078266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:07.079037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:07.079037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:07.079037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:07.079037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:07.079037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:07.079037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:07.079037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:07.079037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:07.079037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:07.079037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:07.079037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:07.079037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:07.082004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 84/163] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:28:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:07.088130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a22059-8762-4584-832e-0bc86f54311d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:07.146174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e30094-db88-4cc2-a03b-3306b614ef4d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:07.204749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a22059-8762-4584-832e-0bc86f54311d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:07.207592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410376f3-da7c-42c1-81f6-f8f5a9ac61e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:07.208880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410376f3-da7c-42c1-81f6-f8f5a9ac61e5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:07.208880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410376f3-da7c-42c1-81f6-f8f5a9ac61e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:07.209144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410376f3-da7c-42c1-81f6-f8f5a9ac61e5 None admin] PATH_INFO: `/v3/users/354ba81d4750484ba041dc7f2f2438f1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:07.210479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410376f3-da7c-42c1-81f6-f8f5a9ac61e5 None admin] RBAC: Authorizing `identity:get_user(user_id=354ba81d4750484ba041dc7f2f2438f1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:07.212007 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410376f3-da7c-42c1-81f6-f8f5a9ac61e5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:07.214636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 80/164] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:06 2022] GET /identity/v3/users/354ba81d4750484ba041dc7f2f2438f1 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:07.219198 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410376f3-da7c-42c1-81f6-f8f5a9ac61e5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:07.226776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:07.248494 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bcc18-e3fb-4af3-b49f-af8443924e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:07.249503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bcc18-e3fb-4af3-b49f-af8443924e06 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:07.250006 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bcc18-e3fb-4af3-b49f-af8443924e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:07.250473 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bcc18-e3fb-4af3-b49f-af8443924e06 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:07.251448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bcc18-e3fb-4af3-b49f-af8443924e06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:07.251984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bcc18-e3fb-4af3-b49f-af8443924e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:07.254230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bcc18-e3fb-4af3-b49f-af8443924e06 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:07.263637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 85/165] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:07.269993 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bcc18-e3fb-4af3-b49f-af8443924e06 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:07.307832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:07.405768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bcc18-e3fb-4af3-b49f-af8443924e06 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:07.435762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410376f3-da7c-42c1-81f6-f8f5a9ac61e5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:07.478401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba6780-346a-46e9-9247-229374c331c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:07.479593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba6780-346a-46e9-9247-229374c331c8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:07.480014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba6780-346a-46e9-9247-229374c331c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:07.480468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba6780-346a-46e9-9247-229374c331c8 None admin] PATH_INFO: `/v3/users/cfed129aafe54696bb42f388ec9baac7` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:07.488002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba6780-346a-46e9-9247-229374c331c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cfed129aafe54696bb42f388ec9baac7)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:07.489727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba6780-346a-46e9-9247-229374c331c8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:07.491690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 86/166] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:07 2022] GET /identity/v3/users/cfed129aafe54696bb42f388ec9baac7 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:07.494331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c2ee0-666a-46c7-bd35-1ffcdb12ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:07.495233 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c2ee0-666a-46c7-bd35-1ffcdb12ad38 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:07.495709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c2ee0-666a-46c7-bd35-1ffcdb12ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:07.496226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c2ee0-666a-46c7-bd35-1ffcdb12ad38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:07.497082 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba6780-346a-46e9-9247-229374c331c8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:07.572988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c2ee0-666a-46c7-bd35-1ffcdb12ad38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:07.575114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c2ee0-666a-46c7-bd35-1ffcdb12ad38 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:07.578156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:07.648549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba6780-346a-46e9-9247-229374c331c8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:07.651527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:07.711975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ef236-b10c-44d2-9e7e-be30c15b4989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:07.712641 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ef236-b10c-44d2-9e7e-be30c15b4989 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:07.712927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ef236-b10c-44d2-9e7e-be30c15b4989 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:07.713205 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ef236-b10c-44d2-9e7e-be30c15b4989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:07.766241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 81/167] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:28:07.767745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac16b12-2b91-41db-8dd3-91a355edd45f None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:07.768047 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac16b12-2b91-41db-8dd3-91a355edd45f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:07.768860 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac16b12-2b91-41db-8dd3-91a355edd45f None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:07.770683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 82/168] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:07.773017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac16b12-2b91-41db-8dd3-91a355edd45f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:07.807464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ef236-b10c-44d2-9e7e-be30c15b4989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:07.808920 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ef236-b10c-44d2-9e7e-be30c15b4989 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:07.964625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 87/169] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:07.965966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a800b1a-e16c-41ff-99b4-3a0b20d56b23 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:07.966257 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a800b1a-e16c-41ff-99b4-3a0b20d56b23 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:07.966532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a800b1a-e16c-41ff-99b4-3a0b20d56b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:07.986674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:07.996340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3a800b1a-e16c-41ff-99b4-3a0b20d56b23 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:07.997853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3a800b1a-e16c-41ff-99b4-3a0b20d56b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:08.091867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac16b12-2b91-41db-8dd3-91a355edd45f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:08.095202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:08.104904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 88/170] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:08.105845 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a800b1a-e16c-41ff-99b4-3a0b20d56b23 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:08.197372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70b190-fef5-4b35-878a-df32c64c7d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:08.198259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b190-fef5-4b35-878a-df32c64c7d4b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:08.198545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b190-fef5-4b35-878a-df32c64c7d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:08.198821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b190-fef5-4b35-878a-df32c64c7d4b None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:08.201793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70b190-fef5-4b35-878a-df32c64c7d4b None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:08.203288 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70b190-fef5-4b35-878a-df32c64c7d4b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:08.206731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 83/171] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:07 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:08.207579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70b190-fef5-4b35-878a-df32c64c7d4b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:08.269687 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a800b1a-e16c-41ff-99b4-3a0b20d56b23 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:08.310990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d992de3-bfc4-4966-8065-845fe9774fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:08.312297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d992de3-bfc4-4966-8065-845fe9774fce None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:08.312796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d992de3-bfc4-4966-8065-845fe9774fce None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:08.313271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d992de3-bfc4-4966-8065-845fe9774fce None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:08.314663 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d992de3-bfc4-4966-8065-845fe9774fce None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:08.316923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d992de3-bfc4-4966-8065-845fe9774fce None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:08.318867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 89/172] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:08 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:08.320801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc27aea-d500-4140-a808-4045fc0f8af4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:08.321354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc27aea-d500-4140-a808-4045fc0f8af4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:08.321880 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc27aea-d500-4140-a808-4045fc0f8af4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:08.323677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 90/173] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:08.324817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc27aea-d500-4140-a808-4045fc0f8af4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:08.335560 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:08.445758 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc27aea-d500-4140-a808-4045fc0f8af4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:08.483883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9116d-9988-40f3-91cf-60da90b6740a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:08.485022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9116d-9988-40f3-91cf-60da90b6740a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:08.485497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9116d-9988-40f3-91cf-60da90b6740a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:08.485981 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9116d-9988-40f3-91cf-60da90b6740a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:08.487829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9116d-9988-40f3-91cf-60da90b6740a None admin] RBAC: Adding query filter params (role.id=4f0522c790e94492976ef2674f85ad66, scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b, user.id=354ba81d4750484ba041dc7f2f2438f1) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:08.489188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9116d-9988-40f3-91cf-60da90b6740a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:08.490872 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9116d-9988-40f3-91cf-60da90b6740a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:08.497885 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 91/174] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:08 2022] GET /identity/v3/role_assignments?user.id=354ba81d4750484ba041dc7f2f2438f1&scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b&role.id=4f0522c790e94492976ef2674f85ad66 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:08.498985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9116d-9988-40f3-91cf-60da90b6740a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:08.579117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:08.633269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70b190-fef5-4b35-878a-df32c64c7d4b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:08.635827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9116d-9988-40f3-91cf-60da90b6740a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:08.677031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f785a5-ae35-48c8-a23b-6e09de5f6c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:08.678116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f785a5-ae35-48c8-a23b-6e09de5f6c8f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:08.678596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f785a5-ae35-48c8-a23b-6e09de5f6c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:08.679062 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f785a5-ae35-48c8-a23b-6e09de5f6c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:08.680148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f785a5-ae35-48c8-a23b-6e09de5f6c8f None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b, user.id=cfed129aafe54696bb42f388ec9baac7) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:08.680704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f785a5-ae35-48c8-a23b-6e09de5f6c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:08.683117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f785a5-ae35-48c8-a23b-6e09de5f6c8f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:08.690550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 92/175] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:08 2022] GET /identity/v3/role_assignments?user.id=cfed129aafe54696bb42f388ec9baac7&scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:08.692101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c93ac-a1e9-4a05-a269-e91a6282204b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:08.692524 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c93ac-a1e9-4a05-a269-e91a6282204b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:08.692934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c93ac-a1e9-4a05-a269-e91a6282204b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:08.705278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be78c1-c5e1-43cd-a56e-1e3ce254990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:08.705866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be78c1-c5e1-43cd-a56e-1e3ce254990c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:08.706151 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be78c1-c5e1-43cd-a56e-1e3ce254990c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:08.706430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be78c1-c5e1-43cd-a56e-1e3ce254990c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:08.712217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1c6c93ac-a1e9-4a05-a269-e91a6282204b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:08.713787 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1c6c93ac-a1e9-4a05-a269-e91a6282204b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:08.734518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be78c1-c5e1-43cd-a56e-1e3ce254990c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-87be78c1-c5e1-43cd-a56e-1e3ce254990c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:08.742865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:08.744019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:08.744857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:08.744857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:08.744857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:08.744857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:08.744857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:08.744857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:08.744857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:08.744857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:08.744857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:08.744857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:08.744857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:08.744857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:08.744857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 84/176] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 537 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:08.745497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb549a1b-e074-46c7-abb2-3d88ef885964 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:08.745497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb549a1b-e074-46c7-abb2-3d88ef885964 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:08.745779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb549a1b-e074-46c7-abb2-3d88ef885964 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:08.751149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 85/177] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:08.751149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ac217-c816-4bbf-acad-5761056edeb8 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:08.751149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ac217-c816-4bbf-acad-5761056edeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:08.751149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ac217-c816-4bbf-acad-5761056edeb8 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:08.751149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 86/178] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:08.756297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be40a09-017a-406c-86f1-be3ef417cc78 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:08.756603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be40a09-017a-406c-86f1-be3ef417cc78 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:08.756858 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be40a09-017a-406c-86f1-be3ef417cc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:08.775842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9be40a09-017a-406c-86f1-be3ef417cc78 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:08.777081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9be40a09-017a-406c-86f1-be3ef417cc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:08.803032 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 93/179] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:08.804379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c93ac-a1e9-4a05-a269-e91a6282204b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:08.811621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:08.857824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 87/180] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:08.863292 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e9a31-d38f-49c6-8056-4e854d58a105 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:08.863292 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e9a31-d38f-49c6-8056-4e854d58a105 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:08.863292 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e9a31-d38f-49c6-8056-4e854d58a105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:08.889238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5c6e9a31-d38f-49c6-8056-4e854d58a105 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:08.892741 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5c6e9a31-d38f-49c6-8056-4e854d58a105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:08.901055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:08.964988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c93ac-a1e9-4a05-a269-e91a6282204b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:08.985679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 88/181] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:08.986558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e9a31-d38f-49c6-8056-4e854d58a105 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:09.024309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856036d-c5ac-460d-81ed-f91b8b9591d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:09.025050 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856036d-c5ac-460d-81ed-f91b8b9591d8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:09.025337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856036d-c5ac-460d-81ed-f91b8b9591d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:09.025617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856036d-c5ac-460d-81ed-f91b8b9591d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:09.026384 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856036d-c5ac-460d-81ed-f91b8b9591d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:09.026702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856036d-c5ac-460d-81ed-f91b8b9591d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:09.029324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856036d-c5ac-460d-81ed-f91b8b9591d8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:09.041109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 94/182] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:09.041983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856036d-c5ac-460d-81ed-f91b8b9591d8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:09.093863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:09.104728 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e9a31-d38f-49c6-8056-4e854d58a105 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:09.142731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c952a-89e9-415d-a7c8-fd1cae25939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:09.143488 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c952a-89e9-415d-a7c8-fd1cae25939a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:09.143769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c952a-89e9-415d-a7c8-fd1cae25939a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:09.144070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c952a-89e9-415d-a7c8-fd1cae25939a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:09.151833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856036d-c5ac-460d-81ed-f91b8b9591d8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:09.155562 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c952a-89e9-415d-a7c8-fd1cae25939a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-ab4c952a-89e9-415d-a7c8-fd1cae25939a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:09.163237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:09.164132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 89/183] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:28:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:09.171695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c952a-89e9-415d-a7c8-fd1cae25939a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:09.189676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:09.204265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b85aa-d2fd-48ad-8d57-6e675dfe40b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:09.205203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b85aa-d2fd-48ad-8d57-6e675dfe40b7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:09.206418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b85aa-d2fd-48ad-8d57-6e675dfe40b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:09.206418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b85aa-d2fd-48ad-8d57-6e675dfe40b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:09.217036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b85aa-d2fd-48ad-8d57-6e675dfe40b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-711b85aa-d2fd-48ad-8d57-6e675dfe40b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:09.225367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:09.226424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:09.227575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:09.227575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:09.227575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:09.227575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:09.227575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:09.227575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:09.227575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:09.227575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:09.227575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:09.227575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:09.227575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:09.227575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:09.227575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 95/184] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:28:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:09.228243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b85aa-d2fd-48ad-8d57-6e675dfe40b7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:09.291982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c952a-89e9-415d-a7c8-fd1cae25939a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:09.330866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f1fdd-4476-4d25-91a0-ca94a1a22193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:09.331691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f1fdd-4476-4d25-91a0-ca94a1a22193 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:09.331978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f1fdd-4476-4d25-91a0-ca94a1a22193 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:09.332260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f1fdd-4476-4d25-91a0-ca94a1a22193 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:09.333446 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f1fdd-4476-4d25-91a0-ca94a1a22193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:09.334909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f1fdd-4476-4d25-91a0-ca94a1a22193 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:09.336559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 90/185] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:09.337318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f1fdd-4476-4d25-91a0-ca94a1a22193 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:09.345982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b85aa-d2fd-48ad-8d57-6e675dfe40b7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:09.365159 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:09.383729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc01c2-11e8-496f-a4b6-6764f3a9cf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:09.384621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc01c2-11e8-496f-a4b6-6764f3a9cf69 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:09.384905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc01c2-11e8-496f-a4b6-6764f3a9cf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:09.385178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc01c2-11e8-496f-a4b6-6764f3a9cf69 None admin] PATH_INFO: `/v3/users/354ba81d4750484ba041dc7f2f2438f1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:09.386493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc01c2-11e8-496f-a4b6-6764f3a9cf69 None admin] RBAC: Authorizing `identity:get_user(user_id=354ba81d4750484ba041dc7f2f2438f1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:09.387989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc01c2-11e8-496f-a4b6-6764f3a9cf69 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:09.394368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 96/186] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:09 2022] GET /identity/v3/users/354ba81d4750484ba041dc7f2f2438f1 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:09.394883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc01c2-11e8-496f-a4b6-6764f3a9cf69 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:09.445757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:09.448570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f1fdd-4476-4d25-91a0-ca94a1a22193 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:09.482998 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3352a-95dc-4955-897f-be97fc0e2327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:09.483697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3352a-95dc-4955-897f-be97fc0e2327 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:09.483982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3352a-95dc-4955-897f-be97fc0e2327 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:09.484264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3352a-95dc-4955-897f-be97fc0e2327 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:09.485004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3352a-95dc-4955-897f-be97fc0e2327 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:09.485313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3352a-95dc-4955-897f-be97fc0e2327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:09.486696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3352a-95dc-4955-897f-be97fc0e2327 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:09.494756 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 91/187] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:09.495553 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3352a-95dc-4955-897f-be97fc0e2327 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:09.495955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc01c2-11e8-496f-a4b6-6764f3a9cf69 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:09.532646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da1069-a620-4d40-8d37-11c6b31c7263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:09.533312 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da1069-a620-4d40-8d37-11c6b31c7263 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:09.533636 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da1069-a620-4d40-8d37-11c6b31c7263 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:09.533937 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da1069-a620-4d40-8d37-11c6b31c7263 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:09.534672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da1069-a620-4d40-8d37-11c6b31c7263 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:09.534979 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da1069-a620-4d40-8d37-11c6b31c7263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:09.536388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da1069-a620-4d40-8d37-11c6b31c7263 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:09.544399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 97/188] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:09.545184 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da1069-a620-4d40-8d37-11c6b31c7263 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:09.577481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:09.602454 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3352a-95dc-4955-897f-be97fc0e2327 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:09.635356 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234a979-f53a-4280-9928-b0b7a92d1ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:09.636017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234a979-f53a-4280-9928-b0b7a92d1ce4 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:09.636300 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234a979-f53a-4280-9928-b0b7a92d1ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:09.636580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234a979-f53a-4280-9928-b0b7a92d1ce4 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:09.637282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234a979-f53a-4280-9928-b0b7a92d1ce4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:09.638717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234a979-f53a-4280-9928-b0b7a92d1ce4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:09.649215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da1069-a620-4d40-8d37-11c6b31c7263 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:09.659864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 92/189] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:28:09 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:28:09.661134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e4325-c4a3-43f2-89d3-a7222fe16c2b None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:09.661423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e4325-c4a3-43f2-89d3-a7222fe16c2b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:09.661702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e4325-c4a3-43f2-89d3-a7222fe16c2b None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:09.662972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 93/190] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:09.667277 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e4325-c4a3-43f2-89d3-a7222fe16c2b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:09.675527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:09.701685 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60ed9c-8962-4fd7-9d4f-cb031a3ac14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:09.702367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60ed9c-8962-4fd7-9d4f-cb031a3ac14a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:09.702636 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60ed9c-8962-4fd7-9d4f-cb031a3ac14a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:09.702910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60ed9c-8962-4fd7-9d4f-cb031a3ac14a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:09.782869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60ed9c-8962-4fd7-9d4f-cb031a3ac14a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:09.784616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60ed9c-8962-4fd7-9d4f-cb031a3ac14a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:09.787885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e4325-c4a3-43f2-89d3-a7222fe16c2b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:09.826642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa148c69-0b37-4122-8c80-70e3d5d36007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:09.827536 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa148c69-0b37-4122-8c80-70e3d5d36007 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:09.827817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa148c69-0b37-4122-8c80-70e3d5d36007 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:09.828090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa148c69-0b37-4122-8c80-70e3d5d36007 None admin] PATH_INFO: `/v3/users/0392050ac0d14e3d98bad91f330085f9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:09.837135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:09.844455 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa148c69-0b37-4122-8c80-70e3d5d36007 None admin] RBAC: Authorizing `identity:get_user(user_id=0392050ac0d14e3d98bad91f330085f9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:09.846250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa148c69-0b37-4122-8c80-70e3d5d36007 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:09.848257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 94/191] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:09 2022] GET /identity/v3/users/0392050ac0d14e3d98bad91f330085f9 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:09.849103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa148c69-0b37-4122-8c80-70e3d5d36007 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:09.907825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 98/192] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:09.908956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacadedb-8f5f-45ac-bc23-3b890953a109 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:09.909248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacadedb-8f5f-45ac-bc23-3b890953a109 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:09.909679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacadedb-8f5f-45ac-bc23-3b890953a109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:09.931042 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-aacadedb-8f5f-45ac-bc23-3b890953a109 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:09.932284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aacadedb-8f5f-45ac-bc23-3b890953a109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:09.941058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:09.991720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa148c69-0b37-4122-8c80-70e3d5d36007 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:10.031285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 99/193] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:10.032222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacadedb-8f5f-45ac-bc23-3b890953a109 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:10.036135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fd8c8-9777-4587-91a0-8c7a881fde01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:10.037213 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fd8c8-9777-4587-91a0-8c7a881fde01 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:10.037630 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fd8c8-9777-4587-91a0-8c7a881fde01 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:10.038041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fd8c8-9777-4587-91a0-8c7a881fde01 None admin] PATH_INFO: `/v3/users/0392050ac0d14e3d98bad91f330085f9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:10.039447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fd8c8-9777-4587-91a0-8c7a881fde01 None admin] RBAC: Authorizing `identity:get_user(user_id=0392050ac0d14e3d98bad91f330085f9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:10.042068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fd8c8-9777-4587-91a0-8c7a881fde01 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:10.044038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 95/194] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:09 2022] GET /identity/v3/users/0392050ac0d14e3d98bad91f330085f9 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:10.044926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fd8c8-9777-4587-91a0-8c7a881fde01 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:10.126163 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:10.167554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fd8c8-9777-4587-91a0-8c7a881fde01 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:10.169371 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacadedb-8f5f-45ac-bc23-3b890953a109 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:10.204615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75d61b-9dcd-4dc4-ad6e-a0959dc1df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:10.205251 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d61b-9dcd-4dc4-ad6e-a0959dc1df0c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:10.205589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d61b-9dcd-4dc4-ad6e-a0959dc1df0c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:10.205941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d61b-9dcd-4dc4-ad6e-a0959dc1df0c None admin] PATH_INFO: `/v3/projects/15d185d4c1384be495dfe3da9e5e6da1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:10.207089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75d61b-9dcd-4dc4-ad6e-a0959dc1df0c None admin] RBAC: Authorizing `identity:get_project(project_id=15d185d4c1384be495dfe3da9e5e6da1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:10.208669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75d61b-9dcd-4dc4-ad6e-a0959dc1df0c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:10.210304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 96/195] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:10 2022] GET /identity/v3/projects/15d185d4c1384be495dfe3da9e5e6da1 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:10.213570 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d10aa4-92e5-4048-a9c9-966e5fcf200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:10.214402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10aa4-92e5-4048-a9c9-966e5fcf200b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:10.214821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10aa4-92e5-4048-a9c9-966e5fcf200b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:10.215258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10aa4-92e5-4048-a9c9-966e5fcf200b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:10.215781 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75d61b-9dcd-4dc4-ad6e-a0959dc1df0c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:10.230281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:10.296716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d10aa4-92e5-4048-a9c9-966e5fcf200b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:10.298226 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d10aa4-92e5-4048-a9c9-966e5fcf200b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:10.352708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75d61b-9dcd-4dc4-ad6e-a0959dc1df0c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:10.384227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:10.390852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904e025-4530-4ee4-aa3b-85bdaf4d430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:10.391555 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904e025-4530-4ee4-aa3b-85bdaf4d430f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:10.391845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904e025-4530-4ee4-aa3b-85bdaf4d430f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:10.392129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904e025-4530-4ee4-aa3b-85bdaf4d430f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:10.427679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 100/196] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:10.429092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d10aa4-92e5-4048-a9c9-966e5fcf200b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:10.466059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904e025-4530-4ee4-aa3b-85bdaf4d430f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:10.467348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904e025-4530-4ee4-aa3b-85bdaf4d430f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:10.487353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:10.566815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d10aa4-92e5-4048-a9c9-966e5fcf200b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:10.593999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 97/197] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:10.595542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904e025-4530-4ee4-aa3b-85bdaf4d430f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:10.610814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412cf0a-76ad-4fc5-badd-aa9c20d3b488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:10.612543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412cf0a-76ad-4fc5-badd-aa9c20d3b488 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:10.613150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412cf0a-76ad-4fc5-badd-aa9c20d3b488 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:10.613875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412cf0a-76ad-4fc5-badd-aa9c20d3b488 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:10.629276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412cf0a-76ad-4fc5-badd-aa9c20d3b488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:10.632518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4412cf0a-76ad-4fc5-badd-aa9c20d3b488 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:10.642347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:10.643374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:10.644368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:10.644368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:10.644368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:10.644368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:10.644368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:10.644368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:10.644368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:10.644368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:10.644368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:10.644368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:10.644368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:10.644368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:10.644368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 101/198] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:10.645158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412cf0a-76ad-4fc5-badd-aa9c20d3b488 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:10.718073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904e025-4530-4ee4-aa3b-85bdaf4d430f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:10.760071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b43798-d44d-431e-8faf-e75b95c19915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:10.760863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b43798-d44d-431e-8faf-e75b95c19915 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:10.761243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b43798-d44d-431e-8faf-e75b95c19915 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:10.761620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b43798-d44d-431e-8faf-e75b95c19915 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:10.762958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b43798-d44d-431e-8faf-e75b95c19915 None admin] RBAC: Adding query filter params (role.id=e9451c79645545d78e667c61eece4ec8, scope.project.id=15d185d4c1384be495dfe3da9e5e6da1, user.id=354ba81d4750484ba041dc7f2f2438f1) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:10.763656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b43798-d44d-431e-8faf-e75b95c19915 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:10.765766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b43798-d44d-431e-8faf-e75b95c19915 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:10.774874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 98/199] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:10 2022] GET /identity/v3/role_assignments?user.id=354ba81d4750484ba041dc7f2f2438f1&scope.project.id=15d185d4c1384be495dfe3da9e5e6da1&role.id=e9451c79645545d78e667c61eece4ec8 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:10.775599 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b43798-d44d-431e-8faf-e75b95c19915 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:10.776185 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412cf0a-76ad-4fc5-badd-aa9c20d3b488 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:10.777680 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:10.827892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ae215-e87c-4e40-8d35-243ac90fec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:10.829672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ae215-e87c-4e40-8d35-243ac90fec7b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:10.830114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ae215-e87c-4e40-8d35-243ac90fec7b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:10.831097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ae215-e87c-4e40-8d35-243ac90fec7b None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:10.833984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ae215-e87c-4e40-8d35-243ac90fec7b None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:10.836079 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ae215-e87c-4e40-8d35-243ac90fec7b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:10.839085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 102/200] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:10 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:10.840413 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ae215-e87c-4e40-8d35-243ac90fec7b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:10.962859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:10.978703 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b43798-d44d-431e-8faf-e75b95c19915 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:11.017736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ae215-e87c-4e40-8d35-243ac90fec7b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:11.027387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0e5e-c7a0-4e2a-8e9b-67e91246f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:11.028543 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0e5e-c7a0-4e2a-8e9b-67e91246f805 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:11.028972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0e5e-c7a0-4e2a-8e9b-67e91246f805 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:11.029485 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0e5e-c7a0-4e2a-8e9b-67e91246f805 None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:11.031120 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0e5e-c7a0-4e2a-8e9b-67e91246f805 None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:11.032941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0e5e-c7a0-4e2a-8e9b-67e91246f805 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:11.035972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 99/201] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:10 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:11.037026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0e5e-c7a0-4e2a-8e9b-67e91246f805 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:11.063734 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805b4a0-fde5-4a47-a812-e5700d10391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:11.065341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805b4a0-fde5-4a47-a812-e5700d10391b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:11.065608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805b4a0-fde5-4a47-a812-e5700d10391b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:11.065978 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805b4a0-fde5-4a47-a812-e5700d10391b None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:11.066838 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805b4a0-fde5-4a47-a812-e5700d10391b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:11.067247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805b4a0-fde5-4a47-a812-e5700d10391b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:11.068835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805b4a0-fde5-4a47-a812-e5700d10391b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:11.079886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 103/202] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:11.079886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805b4a0-fde5-4a47-a812-e5700d10391b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:11.119769 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:11.166773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0e5e-c7a0-4e2a-8e9b-67e91246f805 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:11.221114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805b4a0-fde5-4a47-a812-e5700d10391b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:11.223685 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb98c5-0c9a-4656-ada1-073c81646fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:11.225684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb98c5-0c9a-4656-ada1-073c81646fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:11.225684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb98c5-0c9a-4656-ada1-073c81646fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:11.225878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb98c5-0c9a-4656-ada1-073c81646fa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:11.226911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb98c5-0c9a-4656-ada1-073c81646fa6 None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=e9135a691446476da5eef60527399dcc, user.id=0392050ac0d14e3d98bad91f330085f9) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:11.227015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb98c5-0c9a-4656-ada1-073c81646fa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:11.229072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb98c5-0c9a-4656-ada1-073c81646fa6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:11.236081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 100/203] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:11 2022] GET /identity/v3/role_assignments?user.id=0392050ac0d14e3d98bad91f330085f9&scope.project.id=e9135a691446476da5eef60527399dcc&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:11.237855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb98c5-0c9a-4656-ada1-073c81646fa6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:11.271037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897d151-1231-48ff-8cca-ed17e75a2a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:11.272242 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897d151-1231-48ff-8cca-ed17e75a2a97 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:11.272708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897d151-1231-48ff-8cca-ed17e75a2a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:11.273135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897d151-1231-48ff-8cca-ed17e75a2a97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:11.274113 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897d151-1231-48ff-8cca-ed17e75a2a97 None admin] RBAC: Adding query filter params (role.id=4f0522c790e94492976ef2674f85ad66, scope.project.id=e9135a691446476da5eef60527399dcc, user.id=0392050ac0d14e3d98bad91f330085f9) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:11.274569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897d151-1231-48ff-8cca-ed17e75a2a97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:11.276207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897d151-1231-48ff-8cca-ed17e75a2a97 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:11.281656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:11.283081 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 104/204] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:11 2022] GET /identity/v3/role_assignments?user.id=0392050ac0d14e3d98bad91f330085f9&scope.project.id=e9135a691446476da5eef60527399dcc&role.id=4f0522c790e94492976ef2674f85ad66 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:11.374268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb98c5-0c9a-4656-ada1-073c81646fa6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:11.415451 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cad27-462f-4b9e-974d-0b68507cda4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:11.416419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cad27-462f-4b9e-974d-0b68507cda4a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:11.416707 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cad27-462f-4b9e-974d-0b68507cda4a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:11.416987 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cad27-462f-4b9e-974d-0b68507cda4a None admin] PATH_INFO: `/v3/users/4d2f2a2663fa4f05a544d9486a865240` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:11.418423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cad27-462f-4b9e-974d-0b68507cda4a None admin] RBAC: Authorizing `identity:get_user(user_id=4d2f2a2663fa4f05a544d9486a865240)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:11.420141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cad27-462f-4b9e-974d-0b68507cda4a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:11.422306 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 101/205] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:11 2022] GET /identity/v3/users/4d2f2a2663fa4f05a544d9486a865240 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:11.432412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897d151-1231-48ff-8cca-ed17e75a2a97 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:11.566141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:11.573049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897d151-1231-48ff-8cca-ed17e75a2a97 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:11.623908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e7b5f-7c5b-4328-a3f8-3f7f34513149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:11.624581 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e7b5f-7c5b-4328-a3f8-3f7f34513149 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:11.624879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e7b5f-7c5b-4328-a3f8-3f7f34513149 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:11.625157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e7b5f-7c5b-4328-a3f8-3f7f34513149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:11.718622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e7b5f-7c5b-4328-a3f8-3f7f34513149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:11.720146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e7b5f-7c5b-4328-a3f8-3f7f34513149 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:11.855352 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:11.864044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 105/206] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:11.872572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cad27-462f-4b9e-974d-0b68507cda4a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:12.026423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:12.033334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cad27-462f-4b9e-974d-0b68507cda4a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:12.093788 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13526f6-639c-41f1-80e9-95878bccf92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:12.094680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13526f6-639c-41f1-80e9-95878bccf92e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:12.094952 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13526f6-639c-41f1-80e9-95878bccf92e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:12.095255 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13526f6-639c-41f1-80e9-95878bccf92e None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:12.096758 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13526f6-639c-41f1-80e9-95878bccf92e None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:12.098205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13526f6-639c-41f1-80e9-95878bccf92e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:12.100127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 102/207] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:11 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:12.105985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e7b5f-7c5b-4328-a3f8-3f7f34513149 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:12.161488 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64008851-c5de-4640-b083-efe60622d1b3 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:12.161806 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64008851-c5de-4640-b083-efe60622d1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:12.162052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64008851-c5de-4640-b083-efe60622d1b3 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:12.163474 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 103/208] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:28:12.168401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b53b-511f-4aa3-95e9-4674dd6a06da None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:12.168693 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b53b-511f-4aa3-95e9-4674dd6a06da None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:12.168978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b53b-511f-4aa3-95e9-4674dd6a06da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:12.190799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ab84b53b-511f-4aa3-95e9-4674dd6a06da None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:12.192042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ab84b53b-511f-4aa3-95e9-4674dd6a06da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:12.249679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e7b5f-7c5b-4328-a3f8-3f7f34513149 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:12.269526 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 104/209] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:12.270861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b946372-9a1e-43e8-9d65-3e196262f721 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:12.271404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b946372-9a1e-43e8-9d65-3e196262f721 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:12.271697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b946372-9a1e-43e8-9d65-3e196262f721 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:12.279537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 105/210] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:12.285601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c60eb2-e6e9-4211-984c-9ed97f004281 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:12.285894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c60eb2-e6e9-4211-984c-9ed97f004281 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:12.286172 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c60eb2-e6e9-4211-984c-9ed97f004281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:12.297033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28fe30-c687-453b-b627-880f4a96ab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:12.297821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28fe30-c687-453b-b627-880f4a96ab1f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:12.298207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28fe30-c687-453b-b627-880f4a96ab1f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:12.298585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28fe30-c687-453b-b627-880f4a96ab1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:12.300405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28fe30-c687-453b-b627-880f4a96ab1f None admin] RBAC: Adding query filter params (role.id=45c107a1713445dcbcc66380d2666ae5, scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b, user.id=4d2f2a2663fa4f05a544d9486a865240) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:12.300829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28fe30-c687-453b-b627-880f4a96ab1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:12.302411 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28fe30-c687-453b-b627-880f4a96ab1f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:12.309161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 106/211] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:12 2022] GET /identity/v3/role_assignments?user.id=4d2f2a2663fa4f05a544d9486a865240&scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b&role.id=45c107a1713445dcbcc66380d2666ae5 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:12.310113 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28fe30-c687-453b-b627-880f4a96ab1f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:12.314372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-92c60eb2-e6e9-4211-984c-9ed97f004281 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:12.316374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-92c60eb2-e6e9-4211-984c-9ed97f004281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:12.375857 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:12.442658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28fe30-c687-453b-b627-880f4a96ab1f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:12.472669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 106/212] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:12.514665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3052b0-c6d4-4fc1-94e7-f5b04bffea54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:12.515118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c60eb2-e6e9-4211-984c-9ed97f004281 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:12.515508 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3052b0-c6d4-4fc1-94e7-f5b04bffea54 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:12.515798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3052b0-c6d4-4fc1-94e7-f5b04bffea54 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:12.516078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3052b0-c6d4-4fc1-94e7-f5b04bffea54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:12.530971 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3052b0-c6d4-4fc1-94e7-f5b04bffea54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9d3052b0-c6d4-4fc1-94e7-f5b04bffea54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:12.539374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:12.540253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:12.541048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:12.541048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:12.541048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:12.541048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:12.541048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:12.541048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:12.541048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:12.541048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:12.541048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:12.541048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:12.541048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:12.541048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:12.541048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 107/213] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:12.546703 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:12.547502 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3052b0-c6d4-4fc1-94e7-f5b04bffea54 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:12.666858 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c60eb2-e6e9-4211-984c-9ed97f004281 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:12.700083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3052b0-c6d4-4fc1-94e7-f5b04bffea54 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:12.719708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cfdfe-1cdb-4abc-8c57-6144225bfd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:12.720537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cfdfe-1cdb-4abc-8c57-6144225bfd60 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:12.720849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cfdfe-1cdb-4abc-8c57-6144225bfd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:12.721255 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cfdfe-1cdb-4abc-8c57-6144225bfd60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:12.723692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cfdfe-1cdb-4abc-8c57-6144225bfd60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:12.725186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cfdfe-1cdb-4abc-8c57-6144225bfd60 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:12.727136 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 107/214] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:12.732398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cfdfe-1cdb-4abc-8c57-6144225bfd60 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:12.737182 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:12.759780 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898f281-59e0-482f-9c9c-19854c4a50e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:12.760799 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898f281-59e0-482f-9c9c-19854c4a50e0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:12.761315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898f281-59e0-482f-9c9c-19854c4a50e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:12.761791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898f281-59e0-482f-9c9c-19854c4a50e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:12.762750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898f281-59e0-482f-9c9c-19854c4a50e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:12.763304 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898f281-59e0-482f-9c9c-19854c4a50e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:12.764912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898f281-59e0-482f-9c9c-19854c4a50e0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:12.774612 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 108/215] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:12.780617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898f281-59e0-482f-9c9c-19854c4a50e0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:12.843974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:12.854052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cfdfe-1cdb-4abc-8c57-6144225bfd60 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:12.882548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898f281-59e0-482f-9c9c-19854c4a50e0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:12.889668 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca78b46-5068-4dbf-a45f-2deb87f9ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:12.890901 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca78b46-5068-4dbf-a45f-2deb87f9ca68 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:12.891427 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca78b46-5068-4dbf-a45f-2deb87f9ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:12.891903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca78b46-5068-4dbf-a45f-2deb87f9ca68 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:12.893366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca78b46-5068-4dbf-a45f-2deb87f9ca68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:12.895011 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca78b46-5068-4dbf-a45f-2deb87f9ca68 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:12.923353 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 108/216] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:28:12 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:28:12.925621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb76107-9951-46f6-9dc5-4fbe9fc3969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:12.925621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb76107-9951-46f6-9dc5-4fbe9fc3969f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:12.926938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb76107-9951-46f6-9dc5-4fbe9fc3969f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:12.926938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb76107-9951-46f6-9dc5-4fbe9fc3969f None admin] PATH_INFO: `/v3/users/964ac0e3b4864f6e9acb3286ecd01cd6` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:12.942722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb76107-9951-46f6-9dc5-4fbe9fc3969f None admin] RBAC: Authorizing `identity:get_user(user_id=964ac0e3b4864f6e9acb3286ecd01cd6)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:12.944372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb76107-9951-46f6-9dc5-4fbe9fc3969f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:12.946637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 109/217] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:12 2022] GET /identity/v3/users/964ac0e3b4864f6e9acb3286ecd01cd6 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:12.951984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca78b46-5068-4dbf-a45f-2deb87f9ca68 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:13.064711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca78b46-5068-4dbf-a45f-2deb87f9ca68 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:13.102217 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1b90-40a1-43fb-a9c1-4334edb90fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:13.102891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1b90-40a1-43fb-a9c1-4334edb90fbf None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:13.103193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1b90-40a1-43fb-a9c1-4334edb90fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:13.103490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1b90-40a1-43fb-a9c1-4334edb90fbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:13.124104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:13.178464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb1b90-40a1-43fb-a9c1-4334edb90fbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:13.179953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb1b90-40a1-43fb-a9c1-4334edb90fbf None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:13.289824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 109/218] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:28:13.295354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb76107-9951-46f6-9dc5-4fbe9fc3969f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:13.352717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:13.415477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb76107-9951-46f6-9dc5-4fbe9fc3969f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:13.451098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8465f24-8705-4902-b01c-083f5e4b6b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:13.451919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8465f24-8705-4902-b01c-083f5e4b6b7d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:13.452299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8465f24-8705-4902-b01c-083f5e4b6b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:13.452582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8465f24-8705-4902-b01c-083f5e4b6b7d None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:13.453800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8465f24-8705-4902-b01c-083f5e4b6b7d None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:13.455481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8465f24-8705-4902-b01c-083f5e4b6b7d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:13.457209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 110/219] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:13 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:13.463321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1b90-40a1-43fb-a9c1-4334edb90fbf None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:13.523826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:13.578334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1b90-40a1-43fb-a9c1-4334edb90fbf None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:13.620164 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9476be3-28b2-4f95-b0df-dffc7bc3e285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:13.620835 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9476be3-28b2-4f95-b0df-dffc7bc3e285 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:13.621159 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9476be3-28b2-4f95-b0df-dffc7bc3e285 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:13.621449 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9476be3-28b2-4f95-b0df-dffc7bc3e285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:13.622293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9476be3-28b2-4f95-b0df-dffc7bc3e285 None admin] RBAC: Adding query filter params (role.id=e9451c79645545d78e667c61eece4ec8, scope.project.id=e9135a691446476da5eef60527399dcc, user.id=964ac0e3b4864f6e9acb3286ecd01cd6) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:13.622610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9476be3-28b2-4f95-b0df-dffc7bc3e285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:13.624102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9476be3-28b2-4f95-b0df-dffc7bc3e285 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:13.634087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 110/220] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:13 2022] GET /identity/v3/role_assignments?user.id=964ac0e3b4864f6e9acb3286ecd01cd6&scope.project.id=e9135a691446476da5eef60527399dcc&role.id=e9451c79645545d78e667c61eece4ec8 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:13.643632 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283df9d-6279-45f4-b357-06381504e9e1 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:13.643947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283df9d-6279-45f4-b357-06381504e9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:13.644195 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283df9d-6279-45f4-b357-06381504e9e1 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:13.645871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 111/221] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:13.651472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79b8d-f095-4168-876e-8a13690e5593 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:13.651767 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79b8d-f095-4168-876e-8a13690e5593 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:13.652063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79b8d-f095-4168-876e-8a13690e5593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:13.673168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-27c79b8d-f095-4168-876e-8a13690e5593 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:13.675090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-27c79b8d-f095-4168-876e-8a13690e5593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:13.708844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ba56c-5c0a-4d9d-9a95-c6b620d3ecfa None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:13.709051 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ba56c-5c0a-4d9d-9a95-c6b620d3ecfa None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:13.709318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ba56c-5c0a-4d9d-9a95-c6b620d3ecfa None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:13.710691 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 112/222] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:13.718307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41fac2-3e1c-4b94-8455-f98627f98a46 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:13.718307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41fac2-3e1c-4b94-8455-f98627f98a46 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:13.718307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41fac2-3e1c-4b94-8455-f98627f98a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:13.746492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fa41fac2-3e1c-4b94-8455-f98627f98a46 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:13.750432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fa41fac2-3e1c-4b94-8455-f98627f98a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:13.806861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 111/223] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:13.835128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c79b8d-f095-4168-876e-8a13690e5593 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:13.852231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 113/224] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:13.888414 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41fac2-3e1c-4b94-8455-f98627f98a46 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:13.897107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:13.966925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c79b8d-f095-4168-876e-8a13690e5593 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:13.975587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:14.037921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10d0fc-8427-4a93-a3c8-5f320a5fd607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:14.038726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10d0fc-8427-4a93-a3c8-5f320a5fd607 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:14.039007 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10d0fc-8427-4a93-a3c8-5f320a5fd607 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:14.039306 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10d0fc-8427-4a93-a3c8-5f320a5fd607 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:14.056968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10d0fc-8427-4a93-a3c8-5f320a5fd607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-da10d0fc-8427-4a93-a3c8-5f320a5fd607 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:14.065186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:14.066088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:14.067301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:14.067301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:14.067301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:14.067301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:14.067301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:14.067301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:14.067301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:14.067301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:14.067301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:14.067301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:14.067301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:14.067301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:14.067301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 112/225] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:28:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:14.075091 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10d0fc-8427-4a93-a3c8-5f320a5fd607 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:14.091626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41fac2-3e1c-4b94-8455-f98627f98a46 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:14.152868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641ef89-da18-4bc5-8ce4-04f16299827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:14.153700 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ef89-da18-4bc5-8ce4-04f16299827e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:14.153982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ef89-da18-4bc5-8ce4-04f16299827e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:14.154256 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ef89-da18-4bc5-8ce4-04f16299827e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:14.174679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641ef89-da18-4bc5-8ce4-04f16299827e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0641ef89-da18-4bc5-8ce4-04f16299827e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:14.182915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:14.183862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:14.184651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:14.184651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:14.184651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:14.184651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:14.184651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:14.184651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:14.184651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:14.184651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:14.184651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:14.184651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:14.184651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:14.184651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:14.185679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 114/226] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:28:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:14.199633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641ef89-da18-4bc5-8ce4-04f16299827e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:14.279799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10d0fc-8427-4a93-a3c8-5f320a5fd607 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:14.281281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:14.343059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ca4e2-d1cd-4778-bb40-adb132e119d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:14.343764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ca4e2-d1cd-4778-bb40-adb132e119d4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:14.344046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ca4e2-d1cd-4778-bb40-adb132e119d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:14.344324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ca4e2-d1cd-4778-bb40-adb132e119d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:14.345078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ca4e2-d1cd-4778-bb40-adb132e119d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:14.345387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ca4e2-d1cd-4778-bb40-adb132e119d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:14.346948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ca4e2-d1cd-4778-bb40-adb132e119d4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:14.366044 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 113/227] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:14.368351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ca4e2-d1cd-4778-bb40-adb132e119d4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:14.383551 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:14.387628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641ef89-da18-4bc5-8ce4-04f16299827e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:14.451039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaf838-2c4e-4706-b7ac-11f830784a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:14.451742 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaf838-2c4e-4706-b7ac-11f830784a96 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:14.452034 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaf838-2c4e-4706-b7ac-11f830784a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:14.452312 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaf838-2c4e-4706-b7ac-11f830784a96 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:14.453208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecaf838-2c4e-4706-b7ac-11f830784a96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:14.453526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecaf838-2c4e-4706-b7ac-11f830784a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:14.455571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecaf838-2c4e-4706-b7ac-11f830784a96 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:14.465223 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 115/228] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:14.470703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaf838-2c4e-4706-b7ac-11f830784a96 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:14.563230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ca4e2-d1cd-4778-bb40-adb132e119d4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:14.646855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaf838-2c4e-4706-b7ac-11f830784a96 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:14.660426 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab1754-94cf-461f-bba7-d927f559175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:14.661310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1754-94cf-461f-bba7-d927f559175a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:14.661593 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1754-94cf-461f-bba7-d927f559175a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:14.661870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1754-94cf-461f-bba7-d927f559175a None admin] PATH_INFO: `/v3/users/0392050ac0d14e3d98bad91f330085f9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:14.667898 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab1754-94cf-461f-bba7-d927f559175a None admin] RBAC: Authorizing `identity:get_user(user_id=0392050ac0d14e3d98bad91f330085f9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:14.669353 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab1754-94cf-461f-bba7-d927f559175a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:14.671321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 114/229] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:14 2022] GET /identity/v3/users/0392050ac0d14e3d98bad91f330085f9 => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:14.677137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab1754-94cf-461f-bba7-d927f559175a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:14.685067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a539152-1685-4868-b15f-7c430d9bd38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:14.685946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a539152-1685-4868-b15f-7c430d9bd38d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:14.686230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a539152-1685-4868-b15f-7c430d9bd38d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:14.686504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a539152-1685-4868-b15f-7c430d9bd38d None admin] PATH_INFO: `/v3/users/0392050ac0d14e3d98bad91f330085f9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:14.688591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a539152-1685-4868-b15f-7c430d9bd38d None admin] RBAC: Authorizing `identity:get_user(user_id=0392050ac0d14e3d98bad91f330085f9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:14.690088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a539152-1685-4868-b15f-7c430d9bd38d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:14.691760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 116/230] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:14 2022] GET /identity/v3/users/0392050ac0d14e3d98bad91f330085f9 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:14.697781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a539152-1685-4868-b15f-7c430d9bd38d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:14.743011 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:14.754376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:14.833558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a539152-1685-4868-b15f-7c430d9bd38d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:14.869572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555b8cd-d7f1-4624-a220-282ff67d27e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:14.870443 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555b8cd-d7f1-4624-a220-282ff67d27e6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:14.870727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555b8cd-d7f1-4624-a220-282ff67d27e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:14.871003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555b8cd-d7f1-4624-a220-282ff67d27e6 None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:14.872322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555b8cd-d7f1-4624-a220-282ff67d27e6 None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:14.873800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555b8cd-d7f1-4624-a220-282ff67d27e6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:14.875951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 117/231] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:14 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:14.888197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555b8cd-d7f1-4624-a220-282ff67d27e6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:14.892483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab1754-94cf-461f-bba7-d927f559175a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:14.962318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a637d-7138-48a2-8be0-9f5dcdec9127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:14.965126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a637d-7138-48a2-8be0-9f5dcdec9127 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:14.965126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a637d-7138-48a2-8be0-9f5dcdec9127 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:14.965126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a637d-7138-48a2-8be0-9f5dcdec9127 None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:14.966134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a637d-7138-48a2-8be0-9f5dcdec9127 None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:14.967843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a637d-7138-48a2-8be0-9f5dcdec9127 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:14.975615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 115/232] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:14 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:14.980760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a637d-7138-48a2-8be0-9f5dcdec9127 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:14.995552 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555b8cd-d7f1-4624-a220-282ff67d27e6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:15.003641 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:15.042856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b43bba-8385-48da-b7e8-17863232a85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:15.043790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b43bba-8385-48da-b7e8-17863232a85b None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:15.044075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b43bba-8385-48da-b7e8-17863232a85b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:15.044351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b43bba-8385-48da-b7e8-17863232a85b None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc/users/0392050ac0d14e3d98bad91f330085f9/roles/4f0522c790e94492976ef2674f85ad66` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:15.046782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b43bba-8385-48da-b7e8-17863232a85b None admin] RBAC: Authorizing `identity:create_grant(project_id=e9135a691446476da5eef60527399dcc, user_id=0392050ac0d14e3d98bad91f330085f9, role_id=4f0522c790e94492976ef2674f85ad66)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:15.048269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b43bba-8385-48da-b7e8-17863232a85b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:15.081361 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 118/233] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:28:14 2022] PUT /identity/v3/projects/e9135a691446476da5eef60527399dcc/users/0392050ac0d14e3d98bad91f330085f9/roles/4f0522c790e94492976ef2674f85ad66 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:28:15.109043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:15.112749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a637d-7138-48a2-8be0-9f5dcdec9127 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:15.152585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a63d7-b833-4d42-8cb9-c88e49565efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:15.153559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a63d7-b833-4d42-8cb9-c88e49565efa None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:15.153885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a63d7-b833-4d42-8cb9-c88e49565efa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:15.154180 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a63d7-b833-4d42-8cb9-c88e49565efa None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc/users/0392050ac0d14e3d98bad91f330085f9/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:15.156383 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a63d7-b833-4d42-8cb9-c88e49565efa None admin] RBAC: Authorizing `identity:create_grant(project_id=e9135a691446476da5eef60527399dcc, user_id=0392050ac0d14e3d98bad91f330085f9, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:15.157880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a63d7-b833-4d42-8cb9-c88e49565efa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:15.180279 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 116/234] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:28:14 2022] PUT /identity/v3/projects/e9135a691446476da5eef60527399dcc/users/0392050ac0d14e3d98bad91f330085f9/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:28:15.607183 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0366-1e29-426c-b03b-5f660cbbac09 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:15.607682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0366-1e29-426c-b03b-5f660cbbac09 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:15.607758 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0366-1e29-426c-b03b-5f660cbbac09 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:15.609391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 119/235] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:15.615346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0b889-a3ac-4262-b53b-698bf908bcd5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:15.615895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0b889-a3ac-4262-b53b-698bf908bcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:15.616374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0b889-a3ac-4262-b53b-698bf908bcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:15.638189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-36c0b889-a3ac-4262-b53b-698bf908bcd5 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:15.639866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-36c0b889-a3ac-4262-b53b-698bf908bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:15.736982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 117/236] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:15.772705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a0366-1e29-426c-b03b-5f660cbbac09 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:15.896638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940aacb-79ce-4962-b5df-7dfb8624d2df None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:15.896833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940aacb-79ce-4962-b5df-7dfb8624d2df None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:15.897116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940aacb-79ce-4962-b5df-7dfb8624d2df None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:15.899969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 118/237] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:15.903903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a4eab-d643-4d69-aab0-6e04c93c9ba5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:15.904257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a4eab-d643-4d69-aab0-6e04c93c9ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:15.904464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a4eab-d643-4d69-aab0-6e04c93c9ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:15.912600 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a0366-1e29-426c-b03b-5f660cbbac09 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:15.941092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f30a4eab-d643-4d69-aab0-6e04c93c9ba5 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:15.943752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f30a4eab-d643-4d69-aab0-6e04c93c9ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:15.973903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84ad40-115c-4b97-929e-655b2311c108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:15.974970 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84ad40-115c-4b97-929e-655b2311c108 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:15.977000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84ad40-115c-4b97-929e-655b2311c108 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:15.977470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84ad40-115c-4b97-929e-655b2311c108 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:16.000143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84ad40-115c-4b97-929e-655b2311c108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-be84ad40-115c-4b97-929e-655b2311c108 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:16.009835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:16.010985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:16.012010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:16.012010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:16.012010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:16.012010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:16.012010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:16.012010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:16.012010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:16.012010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:16.012010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:16.012010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:16.012010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:16.012010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:16.023636 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 120/238] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:16.028932 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84ad40-115c-4b97-929e-655b2311c108 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:16.055543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:16.075279 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 119/239] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:16.076607 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02cde-7291-4310-881c-971bb25ebf5d None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:16.076897 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02cde-7291-4310-881c-971bb25ebf5d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:16.077174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02cde-7291-4310-881c-971bb25ebf5d None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:16.084634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 120/240] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:16.089763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a6c02-f6ae-4950-b260-fd1e76576c71 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:16.090052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a6c02-f6ae-4950-b260-fd1e76576c71 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:16.090335 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a6c02-f6ae-4950-b260-fd1e76576c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:16.118974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a50a6c02-f6ae-4950-b260-fd1e76576c71 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:16.120189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a50a6c02-f6ae-4950-b260-fd1e76576c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:16.137606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:16.148902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84ad40-115c-4b97-929e-655b2311c108 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:16.192761 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edc897-3566-4da8-8cb3-bfac5b40a6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:16.193589 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edc897-3566-4da8-8cb3-bfac5b40a6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:16.193871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edc897-3566-4da8-8cb3-bfac5b40a6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:16.194146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edc897-3566-4da8-8cb3-bfac5b40a6d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:16.195108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edc897-3566-4da8-8cb3-bfac5b40a6d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:16.196619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edc897-3566-4da8-8cb3-bfac5b40a6d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:16.198904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edc897-3566-4da8-8cb3-bfac5b40a6d1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:16.204679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 121/241] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:16.205986 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a6c02-f6ae-4950-b260-fd1e76576c71 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:16.212675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 121/242] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:16.213642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edc897-3566-4da8-8cb3-bfac5b40a6d1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:16.304417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:16.328901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edc897-3566-4da8-8cb3-bfac5b40a6d1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:16.331936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a6c02-f6ae-4950-b260-fd1e76576c71 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:16.364355 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675a984-0a3c-4c94-a089-66c581842bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:16.365131 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675a984-0a3c-4c94-a089-66c581842bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:16.365407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675a984-0a3c-4c94-a089-66c581842bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:16.365764 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675a984-0a3c-4c94-a089-66c581842bd3 None admin] PATH_INFO: `/v3/users/d4373b035f48465088f9416f24447fdf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:16.376565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bf23d-f19c-4a5e-b758-6766a8e05427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:16.378917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bf23d-f19c-4a5e-b758-6766a8e05427 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:16.379443 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bf23d-f19c-4a5e-b758-6766a8e05427 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:16.379926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bf23d-f19c-4a5e-b758-6766a8e05427 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:16.380046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675a984-0a3c-4c94-a089-66c581842bd3 None admin] RBAC: Authorizing `identity:get_user(user_id=d4373b035f48465088f9416f24447fdf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:16.381400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675a984-0a3c-4c94-a089-66c581842bd3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:16.381685 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bf23d-f19c-4a5e-b758-6766a8e05427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:16.383375 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bf23d-f19c-4a5e-b758-6766a8e05427 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:16.385512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 122/244] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:16.386475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bf23d-f19c-4a5e-b758-6766a8e05427 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:16.387474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 122/244] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:16 2022] GET /identity/v3/users/d4373b035f48465088f9416f24447fdf => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:16.392244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675a984-0a3c-4c94-a089-66c581842bd3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:16.419733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:16.500646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675a984-0a3c-4c94-a089-66c581842bd3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:16.506521 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bf23d-f19c-4a5e-b758-6766a8e05427 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:16.537546 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91857793-20a4-4d5d-a5f6-fb2c37dd5c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:16.538361 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91857793-20a4-4d5d-a5f6-fb2c37dd5c98 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:16.538876 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91857793-20a4-4d5d-a5f6-fb2c37dd5c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:16.539147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91857793-20a4-4d5d-a5f6-fb2c37dd5c98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:16.542718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:16.543149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005d80f-e571-404c-8327-a99021335a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:16.544246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005d80f-e571-404c-8327-a99021335a1a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:16.544733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005d80f-e571-404c-8327-a99021335a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:16.545207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005d80f-e571-404c-8327-a99021335a1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:16.557124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005d80f-e571-404c-8327-a99021335a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-e005d80f-e571-404c-8327-a99021335a1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:16.565425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:16.566298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:16.567625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:16.567625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:16.567625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:16.567625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:16.567625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:16.567625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:16.567625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:16.567625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:16.567625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:16.567625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:16.567625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:16.567625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:16.570546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 123/245] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:16.572183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005d80f-e571-404c-8327-a99021335a1a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:16.622231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91857793-20a4-4d5d-a5f6-fb2c37dd5c98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:16.624433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91857793-20a4-4d5d-a5f6-fb2c37dd5c98 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:16.687373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:16.719394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005d80f-e571-404c-8327-a99021335a1a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:16.737033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 123/246] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:16.738160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91857793-20a4-4d5d-a5f6-fb2c37dd5c98 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:16.775278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f1a9e-1dc5-4a7c-b125-71f1b5c6d672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:16.776795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:16.777926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1a9e-1dc5-4a7c-b125-71f1b5c6d672 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:16.778109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1a9e-1dc5-4a7c-b125-71f1b5c6d672 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:16.778385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1a9e-1dc5-4a7c-b125-71f1b5c6d672 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:16.779104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f1a9e-1dc5-4a7c-b125-71f1b5c6d672 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:16.780797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f1a9e-1dc5-4a7c-b125-71f1b5c6d672 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:16.811218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 124/247] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:28:16 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:28:16.815834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f1a9e-1dc5-4a7c-b125-71f1b5c6d672 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:16.905779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91857793-20a4-4d5d-a5f6-fb2c37dd5c98 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:16.956709 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42002cad-89bc-47fc-b670-b93a31281366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:16.957310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42002cad-89bc-47fc-b670-b93a31281366 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:16.958169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42002cad-89bc-47fc-b670-b93a31281366 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:16.958460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42002cad-89bc-47fc-b670-b93a31281366 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:16.959438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42002cad-89bc-47fc-b670-b93a31281366 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:16.959767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42002cad-89bc-47fc-b670-b93a31281366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:16.961319 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42002cad-89bc-47fc-b670-b93a31281366 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:16.971574 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 124/248] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:16.977989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42002cad-89bc-47fc-b670-b93a31281366 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:17.028394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f1a9e-1dc5-4a7c-b125-71f1b5c6d672 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:17.072713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643848f4-adab-48fa-a155-b84cdf568b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:17.073596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643848f4-adab-48fa-a155-b84cdf568b1f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:17.073878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643848f4-adab-48fa-a155-b84cdf568b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:17.074153 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643848f4-adab-48fa-a155-b84cdf568b1f None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:17.075614 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643848f4-adab-48fa-a155-b84cdf568b1f None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:17.077439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643848f4-adab-48fa-a155-b84cdf568b1f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:17.079320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 125/249] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:16 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:17.085510 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643848f4-adab-48fa-a155-b84cdf568b1f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:17.089382 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:17.136268 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:17.140453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42002cad-89bc-47fc-b670-b93a31281366 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:17.179445 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90298d13-b7b1-44c5-9a38-b13851bf3780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:17.180752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90298d13-b7b1-44c5-9a38-b13851bf3780 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:17.181255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90298d13-b7b1-44c5-9a38-b13851bf3780 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:17.181713 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90298d13-b7b1-44c5-9a38-b13851bf3780 None admin] PATH_INFO: `/v3/users/964ac0e3b4864f6e9acb3286ecd01cd6` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:17.183140 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90298d13-b7b1-44c5-9a38-b13851bf3780 None admin] RBAC: Authorizing `identity:get_user(user_id=964ac0e3b4864f6e9acb3286ecd01cd6)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:17.184837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90298d13-b7b1-44c5-9a38-b13851bf3780 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:17.187065 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 125/250] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:16 2022] GET /identity/v3/users/964ac0e3b4864f6e9acb3286ecd01cd6 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:17.193859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90298d13-b7b1-44c5-9a38-b13851bf3780 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:17.203521 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643848f4-adab-48fa-a155-b84cdf568b1f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:17.244477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da440876-ae53-4803-aba6-4b6538bc2528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:17.245656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440876-ae53-4803-aba6-4b6538bc2528 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:17.245656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440876-ae53-4803-aba6-4b6538bc2528 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:17.245847 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440876-ae53-4803-aba6-4b6538bc2528 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:17.246748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da440876-ae53-4803-aba6-4b6538bc2528 None admin] RBAC: Adding query filter params (role.id=45c107a1713445dcbcc66380d2666ae5, scope.project.id=e9135a691446476da5eef60527399dcc, user.id=d4373b035f48465088f9416f24447fdf) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:17.247128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da440876-ae53-4803-aba6-4b6538bc2528 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:17.248834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da440876-ae53-4803-aba6-4b6538bc2528 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:17.255797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 126/251] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:17 2022] GET /identity/v3/role_assignments?user.id=d4373b035f48465088f9416f24447fdf&scope.project.id=e9135a691446476da5eef60527399dcc&role.id=45c107a1713445dcbcc66380d2666ae5 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:17.321958 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90298d13-b7b1-44c5-9a38-b13851bf3780 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:17.364225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85ec5e-ce3f-4014-a754-379e1b2397bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:17.365423 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85ec5e-ce3f-4014-a754-379e1b2397bd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:17.365917 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85ec5e-ce3f-4014-a754-379e1b2397bd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:17.366371 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85ec5e-ce3f-4014-a754-379e1b2397bd None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:17.367878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85ec5e-ce3f-4014-a754-379e1b2397bd None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:17.369577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85ec5e-ce3f-4014-a754-379e1b2397bd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:17.371677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 126/252] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:17 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:17.378948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da440876-ae53-4803-aba6-4b6538bc2528 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:17.424121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce30c2-e6e4-47e4-8570-1f605d46fd6b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:17.424912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce30c2-e6e4-47e4-8570-1f605d46fd6b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:17.424912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce30c2-e6e4-47e4-8570-1f605d46fd6b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:17.428708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 127/253] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:17.433124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc8d78-21e6-4493-b34c-11410a67ec8d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:17.433398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc8d78-21e6-4493-b34c-11410a67ec8d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:17.433678 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc8d78-21e6-4493-b34c-11410a67ec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:17.456854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-50dc8d78-21e6-4493-b34c-11410a67ec8d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:17.458122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-50dc8d78-21e6-4493-b34c-11410a67ec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:17.481393 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:17.494942 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:17.539217 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da440876-ae53-4803-aba6-4b6538bc2528 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:17.557782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 128/254] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:17.586922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc8d78-21e6-4493-b34c-11410a67ec8d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:17.588881 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab8082-ef33-452f-a3b5-01c25cb9761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:17.589808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab8082-ef33-452f-a3b5-01c25cb9761b None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:17.590099 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab8082-ef33-452f-a3b5-01c25cb9761b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:17.590380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab8082-ef33-452f-a3b5-01c25cb9761b None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc/users/964ac0e3b4864f6e9acb3286ecd01cd6/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:17.593236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab8082-ef33-452f-a3b5-01c25cb9761b None admin] RBAC: Authorizing `identity:create_grant(project_id=e9135a691446476da5eef60527399dcc, user_id=964ac0e3b4864f6e9acb3286ecd01cd6, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:17.594073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab8082-ef33-452f-a3b5-01c25cb9761b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:17.619398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 127/255] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:28:17 2022] PUT /identity/v3/projects/e9135a691446476da5eef60527399dcc/users/964ac0e3b4864f6e9acb3286ecd01cd6/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:28:17.715905 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d80d51-c926-4fe4-a2ca-937ec4b106a2 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:17.716423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d80d51-c926-4fe4-a2ca-937ec4b106a2 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:17.716682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc8d78-21e6-4493-b34c-11410a67ec8d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:17.717377 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d80d51-c926-4fe4-a2ca-937ec4b106a2 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:17.719501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 128/256] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:17.725904 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fccb6-2663-4514-8270-a1305e0bbcfd None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:17.726408 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fccb6-2663-4514-8270-a1305e0bbcfd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:17.726835 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fccb6-2663-4514-8270-a1305e0bbcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:17.758841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b3608-8d5d-45dd-aa43-92f13cb61b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:17.759626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3608-8d5d-45dd-aa43-92f13cb61b29 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:17.759913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3608-8d5d-45dd-aa43-92f13cb61b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:17.760183 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3608-8d5d-45dd-aa43-92f13cb61b29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:17.760689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1d0fccb6-2663-4514-8270-a1305e0bbcfd None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:17.762015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1d0fccb6-2663-4514-8270-a1305e0bbcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:17.773913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b3608-8d5d-45dd-aa43-92f13cb61b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f29b3608-8d5d-45dd-aa43-92f13cb61b29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:17.784278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:17.785244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:17.786029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:17.786029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:17.786029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:17.786029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:17.786029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:17.786029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:17.786029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:17.786029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:17.786029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:17.786029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:17.786029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:17.786029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:17.786029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 129/257] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:28:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:17.792502 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b3608-8d5d-45dd-aa43-92f13cb61b29 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:17.847893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:17.949083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 129/258] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:17.960413 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b3608-8d5d-45dd-aa43-92f13cb61b29 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:17.990641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fccb6-2663-4514-8270-a1305e0bbcfd None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:18.012694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32e481-2cd0-42df-b459-0158c79432b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:18.013347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32e481-2cd0-42df-b459-0158c79432b6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:18.013637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32e481-2cd0-42df-b459-0158c79432b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:18.013909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32e481-2cd0-42df-b459-0158c79432b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:18.014673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32e481-2cd0-42df-b459-0158c79432b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:18.014981 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32e481-2cd0-42df-b459-0158c79432b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:18.016422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32e481-2cd0-42df-b459-0158c79432b6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:18.033070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 130/259] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:18.038929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32e481-2cd0-42df-b459-0158c79432b6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:18.082112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:18.168396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fccb6-2663-4514-8270-a1305e0bbcfd None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:18.188839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:18.204655 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c13684-23ef-4a40-b821-22b9d15a2e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:18.206123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c13684-23ef-4a40-b821-22b9d15a2e27 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:18.206299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c13684-23ef-4a40-b821-22b9d15a2e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:18.206559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c13684-23ef-4a40-b821-22b9d15a2e27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:18.209337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32e481-2cd0-42df-b459-0158c79432b6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:18.217259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c13684-23ef-4a40-b821-22b9d15a2e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-29c13684-23ef-4a40-b821-22b9d15a2e27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:18.225704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:18.226582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:18.227483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:18.227483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:18.227483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:18.227483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:18.227483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:18.227483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:18.227483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:18.227483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:18.227483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:18.227483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:18.227483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:18.227483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:18.227483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 130/260] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:18.232777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c13684-23ef-4a40-b821-22b9d15a2e27 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:18.279412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca345f3-b626-426a-bd09-351b9f1d5dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:18.284498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca345f3-b626-426a-bd09-351b9f1d5dbe None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:18.284811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca345f3-b626-426a-bd09-351b9f1d5dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:18.285236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca345f3-b626-426a-bd09-351b9f1d5dbe None admin] PATH_INFO: `/v3/users/0392050ac0d14e3d98bad91f330085f9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:18.286514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca345f3-b626-426a-bd09-351b9f1d5dbe None admin] RBAC: Authorizing `identity:get_user(user_id=0392050ac0d14e3d98bad91f330085f9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:18.288116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca345f3-b626-426a-bd09-351b9f1d5dbe None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:18.290095 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 131/261] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:18 2022] GET /identity/v3/users/0392050ac0d14e3d98bad91f330085f9 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:18.295195 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca345f3-b626-426a-bd09-351b9f1d5dbe None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:18.337686 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c13684-23ef-4a40-b821-22b9d15a2e27 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:18.354364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:18.373134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2f258-ee5f-43fa-8c98-4ac896a39fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:18.373900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2f258-ee5f-43fa-8c98-4ac896a39fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:18.374319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2f258-ee5f-43fa-8c98-4ac896a39fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:18.374666 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2f258-ee5f-43fa-8c98-4ac896a39fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:18.375507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2f258-ee5f-43fa-8c98-4ac896a39fe9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:18.375886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2f258-ee5f-43fa-8c98-4ac896a39fe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:18.377525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2f258-ee5f-43fa-8c98-4ac896a39fe9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:18.390576 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 131/262] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:18.391949 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2f258-ee5f-43fa-8c98-4ac896a39fe9 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:18.492599 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca345f3-b626-426a-bd09-351b9f1d5dbe None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:18.530836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bbd60-5e98-4972-902b-9e721af5f900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:18.531610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bbd60-5e98-4972-902b-9e721af5f900 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:18.531999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bbd60-5e98-4972-902b-9e721af5f900 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:18.532351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bbd60-5e98-4972-902b-9e721af5f900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:18.535357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2f258-ee5f-43fa-8c98-4ac896a39fe9 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:18.559653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:18.587130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac984604-2b0b-4967-9833-e6329849c0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:18.591267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac984604-2b0b-4967-9833-e6329849c0ed None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:18.591267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac984604-2b0b-4967-9833-e6329849c0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:18.591267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac984604-2b0b-4967-9833-e6329849c0ed None admin] PATH_INFO: `/v3/users/0392050ac0d14e3d98bad91f330085f9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:18.594526 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac984604-2b0b-4967-9833-e6329849c0ed None admin] RBAC: Authorizing `identity:get_user(user_id=0392050ac0d14e3d98bad91f330085f9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:18.594526 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac984604-2b0b-4967-9833-e6329849c0ed None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:18.605146 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 132/263] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:18 2022] GET /identity/v3/users/0392050ac0d14e3d98bad91f330085f9 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:18.607237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac984604-2b0b-4967-9833-e6329849c0ed None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:18.669311 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bbd60-5e98-4972-902b-9e721af5f900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:18.670807 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bbd60-5e98-4972-902b-9e721af5f900 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:18.698901 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:18.788662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac984604-2b0b-4967-9833-e6329849c0ed None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:18.838399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fadf85-54f5-4c76-961c-28faef1f33f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:18.839335 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fadf85-54f5-4c76-961c-28faef1f33f1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:18.840270 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fadf85-54f5-4c76-961c-28faef1f33f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:18.840690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fadf85-54f5-4c76-961c-28faef1f33f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:18.898346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 132/264] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:18.903509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bbd60-5e98-4972-902b-9e721af5f900 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:18.921067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fadf85-54f5-4c76-961c-28faef1f33f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:18.922774 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fadf85-54f5-4c76-961c-28faef1f33f1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:18.988228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:18.996401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:19.050864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bbd60-5e98-4972-902b-9e721af5f900 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:19.091644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8ea08-48f9-4366-8502-a097bf6e07b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:19.092656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8ea08-48f9-4366-8502-a097bf6e07b3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:19.093040 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8ea08-48f9-4366-8502-a097bf6e07b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:19.093415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8ea08-48f9-4366-8502-a097bf6e07b3 None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:19.095384 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8ea08-48f9-4366-8502-a097bf6e07b3 None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:19.097138 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8ea08-48f9-4366-8502-a097bf6e07b3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:19.099713 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 133/265] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:18 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:19.108234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8ea08-48f9-4366-8502-a097bf6e07b3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:19.127216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 133/266] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:19.133177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fadf85-54f5-4c76-961c-28faef1f33f1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:19.336483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fadf85-54f5-4c76-961c-28faef1f33f1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:19.347960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8ea08-48f9-4366-8502-a097bf6e07b3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:19.377600 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:19.391042 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30169d9c-f6e9-402b-9dd0-d895d600f015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:19.391263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936c1fc-e337-49bc-8a1d-a9b1590ec33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:19.391732 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30169d9c-f6e9-402b-9dd0-d895d600f015 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:19.392014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30169d9c-f6e9-402b-9dd0-d895d600f015 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:19.392291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936c1fc-e337-49bc-8a1d-a9b1590ec33a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:19.392388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30169d9c-f6e9-402b-9dd0-d895d600f015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:19.392584 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936c1fc-e337-49bc-8a1d-a9b1590ec33a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:19.392867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936c1fc-e337-49bc-8a1d-a9b1590ec33a None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:19.393299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30169d9c-f6e9-402b-9dd0-d895d600f015 None admin] RBAC: Adding query filter params (role.id=4f0522c790e94492976ef2674f85ad66, scope.project.id=e9135a691446476da5eef60527399dcc, user.id=0392050ac0d14e3d98bad91f330085f9) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:19.393725 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30169d9c-f6e9-402b-9dd0-d895d600f015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:19.394096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936c1fc-e337-49bc-8a1d-a9b1590ec33a None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:19.395204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30169d9c-f6e9-402b-9dd0-d895d600f015 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:19.395573 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936c1fc-e337-49bc-8a1d-a9b1590ec33a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:19.397870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 134/267] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:19 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:19.401748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 134/268] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:19 2022] GET /identity/v3/role_assignments?user.id=0392050ac0d14e3d98bad91f330085f9&scope.project.id=e9135a691446476da5eef60527399dcc&role.id=4f0522c790e94492976ef2674f85ad66 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:19.403909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936c1fc-e337-49bc-8a1d-a9b1590ec33a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:19.430110 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:19.535364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936c1fc-e337-49bc-8a1d-a9b1590ec33a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:19.573506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3086961-06c4-4eef-833a-4ab4289924fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:19.574169 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086961-06c4-4eef-833a-4ab4289924fa None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:19.574456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086961-06c4-4eef-833a-4ab4289924fa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:19.574738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086961-06c4-4eef-833a-4ab4289924fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:19.575609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3086961-06c4-4eef-833a-4ab4289924fa None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=e9135a691446476da5eef60527399dcc, user.id=0392050ac0d14e3d98bad91f330085f9) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:19.575928 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3086961-06c4-4eef-833a-4ab4289924fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:19.577379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3086961-06c4-4eef-833a-4ab4289924fa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:19.594786 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 135/269] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:19 2022] GET /identity/v3/role_assignments?user.id=0392050ac0d14e3d98bad91f330085f9&scope.project.id=e9135a691446476da5eef60527399dcc&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:19.968980 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89169a1e-2af7-4810-8490-ff2bf9e1ac3e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:19.969629 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89169a1e-2af7-4810-8490-ff2bf9e1ac3e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:19.969629 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89169a1e-2af7-4810-8490-ff2bf9e1ac3e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:19.972006 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 135/270] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:19.984571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7211f-c09c-495f-b420-ca80ffa7b138 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:19.985158 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7211f-c09c-495f-b420-ca80ffa7b138 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:19.985629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7211f-c09c-495f-b420-ca80ffa7b138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.007197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-49d7211f-c09c-495f-b420-ca80ffa7b138 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:20.008393 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-49d7211f-c09c-495f-b420-ca80ffa7b138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:20.094253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 136/271] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:20.119564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89169a1e-2af7-4810-8490-ff2bf9e1ac3e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:20.231800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89169a1e-2af7-4810-8490-ff2bf9e1ac3e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:20.269576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9181ab7-4ed1-429b-b7d6-2093cd274b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:20.270924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9181ab7-4ed1-429b-b7d6-2093cd274b5c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:20.271250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9181ab7-4ed1-429b-b7d6-2093cd274b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:20.271658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9181ab7-4ed1-429b-b7d6-2093cd274b5c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.282511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9181ab7-4ed1-429b-b7d6-2093cd274b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c9181ab7-4ed1-429b-b7d6-2093cd274b5c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:20.291064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:20.291973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:20.293209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:20.293209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:20.293209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:20.293209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:20.293209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:20.293209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:20.293209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:20.293209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:20.293209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:20.293209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:20.293209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:20.293209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:20.293209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 136/272] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:20.298147 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7211f-c09c-495f-b420-ca80ffa7b138 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:20.310471 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:20.367042 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a810-ab62-431e-ad33-f0e2ce52111e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:20.367402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a810-ab62-431e-ad33-f0e2ce52111e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:20.367623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a810-ab62-431e-ad33-f0e2ce52111e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.369134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 137/273] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:20.380371 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b38b63-2351-4ecd-94b6-aed5e973c11d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:20.380655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b38b63-2351-4ecd-94b6-aed5e973c11d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:20.380929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b38b63-2351-4ecd-94b6-aed5e973c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.402376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-16b38b63-2351-4ecd-94b6-aed5e973c11d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:20.403581 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-16b38b63-2351-4ecd-94b6-aed5e973c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:20.417090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7211f-c09c-495f-b420-ca80ffa7b138 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:20.452980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4dd5e-2648-47ba-9321-d45fc2dbbea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:20.454019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4dd5e-2648-47ba-9321-d45fc2dbbea8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:20.455268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4dd5e-2648-47ba-9321-d45fc2dbbea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:20.455760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4dd5e-2648-47ba-9321-d45fc2dbbea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.456693 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4dd5e-2648-47ba-9321-d45fc2dbbea8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:20.457199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4dd5e-2648-47ba-9321-d45fc2dbbea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:20.458786 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4dd5e-2648-47ba-9321-d45fc2dbbea8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:20.463561 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:20.468223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 137/274] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:20.474364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4dd5e-2648-47ba-9321-d45fc2dbbea8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:20.477615 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 138/275] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:20.506024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b38b63-2351-4ecd-94b6-aed5e973c11d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:20.563040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:20.601713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4dd5e-2648-47ba-9321-d45fc2dbbea8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:20.616123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b38b63-2351-4ecd-94b6-aed5e973c11d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:20.642842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c03fb-78bb-4825-b172-328e82e48b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:20.643866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c03fb-78bb-4825-b172-328e82e48b17 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:20.644155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c03fb-78bb-4825-b172-328e82e48b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:20.644438 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c03fb-78bb-4825-b172-328e82e48b17 None admin] PATH_INFO: `/v3/users/d4373b035f48465088f9416f24447fdf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.646034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c03fb-78bb-4825-b172-328e82e48b17 None admin] RBAC: Authorizing `identity:get_user(user_id=d4373b035f48465088f9416f24447fdf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:20.647682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c03fb-78bb-4825-b172-328e82e48b17 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:20.650973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e501f5f-59cb-46be-9431-0db48105a9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:20.651809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e501f5f-59cb-46be-9431-0db48105a9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:20.652098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e501f5f-59cb-46be-9431-0db48105a9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:20.652377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e501f5f-59cb-46be-9431-0db48105a9b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.653919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 138/276] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:20 2022] GET /identity/v3/users/d4373b035f48465088f9416f24447fdf => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:20.655472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8e411-16ed-47df-9bf9-5c46facc4a4f None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:20.655765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8e411-16ed-47df-9bf9-5c46facc4a4f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:20.656048 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8e411-16ed-47df-9bf9-5c46facc4a4f None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.657338 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 139/277] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:20.662732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8e411-16ed-47df-9bf9-5c46facc4a4f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:20.663510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e501f5f-59cb-46be-9431-0db48105a9b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-8e501f5f-59cb-46be-9431-0db48105a9b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:20.671197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:20.672073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 139/278] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:20.678716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a21b7-9760-439c-825c-3792286aee93 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:20.679543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a21b7-9760-439c-825c-3792286aee93 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:20.679543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a21b7-9760-439c-825c-3792286aee93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.699681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ba2a21b7-9760-439c-825c-3792286aee93 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:20.701346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ba2a21b7-9760-439c-825c-3792286aee93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:20.734955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:20.773431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 140/279] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:20.774269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a21b7-9760-439c-825c-3792286aee93 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:20.780765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8e411-16ed-47df-9bf9-5c46facc4a4f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:20.815712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e1f59-b093-407f-8111-2abe588238f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:20.816562 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1f59-b093-407f-8111-2abe588238f3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:20.816843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1f59-b093-407f-8111-2abe588238f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:20.817119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1f59-b093-407f-8111-2abe588238f3 None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.818286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e1f59-b093-407f-8111-2abe588238f3 None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:20.819788 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e1f59-b093-407f-8111-2abe588238f3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:20.821473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 140/280] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:20 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:20.822730 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e6482-1ad7-4653-a492-3001a5241ccc None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:20.823013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e6482-1ad7-4653-a492-3001a5241ccc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:20.823316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e6482-1ad7-4653-a492-3001a5241ccc None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.824529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 141/281] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:20.827344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e6482-1ad7-4653-a492-3001a5241ccc None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:20.836612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:20.883877 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a21b7-9760-439c-825c-3792286aee93 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:20.916973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e75f0b-6adb-439a-a702-8aebed72eda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:20.917644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e75f0b-6adb-439a-a702-8aebed72eda0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:20.917927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e75f0b-6adb-439a-a702-8aebed72eda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:20.918201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e75f0b-6adb-439a-a702-8aebed72eda0 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.918944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e75f0b-6adb-439a-a702-8aebed72eda0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:20.919290 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e75f0b-6adb-439a-a702-8aebed72eda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:20.920674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e75f0b-6adb-439a-a702-8aebed72eda0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:20.929385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 141/282] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:20.929708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e6482-1ad7-4653-a492-3001a5241ccc None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:20.930060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e75f0b-6adb-439a-a702-8aebed72eda0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:20.960064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:20.964388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51776e7e-90e8-4cea-9c87-3f8eea2d0f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:20.965178 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776e7e-90e8-4cea-9c87-3f8eea2d0f5b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:20.965459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776e7e-90e8-4cea-9c87-3f8eea2d0f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:20.965733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776e7e-90e8-4cea-9c87-3f8eea2d0f5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.966881 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51776e7e-90e8-4cea-9c87-3f8eea2d0f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:20.968352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51776e7e-90e8-4cea-9c87-3f8eea2d0f5b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:20.969956 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 142/283] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:20.971526 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee90d4c-778e-4213-92fa-089fd0fb141b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:20.971800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee90d4c-778e-4213-92fa-089fd0fb141b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:20.972072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee90d4c-778e-4213-92fa-089fd0fb141b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:20.988350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fee90d4c-778e-4213-92fa-089fd0fb141b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:20.996718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fee90d4c-778e-4213-92fa-089fd0fb141b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:21.038200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e75f0b-6adb-439a-a702-8aebed72eda0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:21.060239 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 143/284] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:21.068061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee90d4c-778e-4213-92fa-089fd0fb141b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:21.071130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:21.071699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cae99-e9b8-495e-ba54-966c9f44211f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:21.072701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cae99-e9b8-495e-ba54-966c9f44211f None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:21.072986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cae99-e9b8-495e-ba54-966c9f44211f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:21.073262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cae99-e9b8-495e-ba54-966c9f44211f None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc/users/d4373b035f48465088f9416f24447fdf/roles/45c107a1713445dcbcc66380d2666ae5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:21.075529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cae99-e9b8-495e-ba54-966c9f44211f None admin] RBAC: Authorizing `identity:create_grant(project_id=e9135a691446476da5eef60527399dcc, user_id=d4373b035f48465088f9416f24447fdf, role_id=45c107a1713445dcbcc66380d2666ae5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:21.076992 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cae99-e9b8-495e-ba54-966c9f44211f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:21.090599 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 142/285] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:28:20 2022] PUT /identity/v3/projects/e9135a691446476da5eef60527399dcc/users/d4373b035f48465088f9416f24447fdf/roles/45c107a1713445dcbcc66380d2666ae5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:28:21.091416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cae99-e9b8-495e-ba54-966c9f44211f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:21.181725 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee90d4c-778e-4213-92fa-089fd0fb141b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:21.202361 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:21.218921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cae99-e9b8-495e-ba54-966c9f44211f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:21.221285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49838e85-1cf8-425f-af13-fa1ca9c9e2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:21.222371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49838e85-1cf8-425f-af13-fa1ca9c9e2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:21.222509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49838e85-1cf8-425f-af13-fa1ca9c9e2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:21.222740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49838e85-1cf8-425f-af13-fa1ca9c9e2b9 None admin] PATH_INFO: `/v3/users/e58d3eea598a4549a3fccefde8afdfa0` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:21.239928 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49838e85-1cf8-425f-af13-fa1ca9c9e2b9 None admin] RBAC: Authorizing `identity:get_user(user_id=e58d3eea598a4549a3fccefde8afdfa0)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:21.241331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49838e85-1cf8-425f-af13-fa1ca9c9e2b9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:21.243318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 144/286] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:21 2022] GET /identity/v3/users/e58d3eea598a4549a3fccefde8afdfa0 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:21.244330 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49838e85-1cf8-425f-af13-fa1ca9c9e2b9 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:21.264973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4e6a-d3c9-42a8-a589-365e59694173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:21.265651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4e6a-d3c9-42a8-a589-365e59694173 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:21.265938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4e6a-d3c9-42a8-a589-365e59694173 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:21.266210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4e6a-d3c9-42a8-a589-365e59694173 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:21.266950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4e6a-d3c9-42a8-a589-365e59694173 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:21.268593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4e6a-d3c9-42a8-a589-365e59694173 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:21.290495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 143/287] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:28:21 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:28:21.291265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4e6a-d3c9-42a8-a589-365e59694173 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:21.318924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:21.368882 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49838e85-1cf8-425f-af13-fa1ca9c9e2b9 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:21.409434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c7cce-72d0-4498-9c71-5f0845b935e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:21.410796 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c7cce-72d0-4498-9c71-5f0845b935e8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:21.411433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c7cce-72d0-4498-9c71-5f0845b935e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:21.411924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c7cce-72d0-4498-9c71-5f0845b935e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:21.425269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c7cce-72d0-4498-9c71-5f0845b935e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-b58c7cce-72d0-4498-9c71-5f0845b935e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:21.434361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:21.435385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:21.436208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:21.436208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:21.436208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:21.436208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:21.436208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:21.436208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:21.436208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:21.436208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:21.436208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:21.436208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:21.436208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:21.436208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:21.437382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4e6a-d3c9-42a8-a589-365e59694173 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:21.439608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 145/288] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:21.446120 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c7cce-72d0-4498-9c71-5f0845b935e8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:21.494440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434f83f-c67f-447f-9019-4ab7bbcf11ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:21.495427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434f83f-c67f-447f-9019-4ab7bbcf11ff None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:21.495891 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434f83f-c67f-447f-9019-4ab7bbcf11ff None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:21.496367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434f83f-c67f-447f-9019-4ab7bbcf11ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:21.497239 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434f83f-c67f-447f-9019-4ab7bbcf11ff None admin] RBAC: Adding query filter params (role.id=e9451c79645545d78e667c61eece4ec8, user.id=e58d3eea598a4549a3fccefde8afdfa0, scope.system=all) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:21.497554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434f83f-c67f-447f-9019-4ab7bbcf11ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:21.499040 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434f83f-c67f-447f-9019-4ab7bbcf11ff None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:21.507856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 144/289] 10.222.0.33 () {56 vars in 1308 bytes} [Wed Jul 6 20:28:21 2022] GET /identity/v3/role_assignments?user.id=e58d3eea598a4549a3fccefde8afdfa0&scope.system=all&role.id=e9451c79645545d78e667c61eece4ec8 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:21.578148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c7cce-72d0-4498-9c71-5f0845b935e8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:21.609049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:21.623524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8644f-621b-4269-bcf8-a24238f1e9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:21.624450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8644f-621b-4269-bcf8-a24238f1e9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:21.624906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8644f-621b-4269-bcf8-a24238f1e9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:21.625430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8644f-621b-4269-bcf8-a24238f1e9b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:21.626484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8644f-621b-4269-bcf8-a24238f1e9b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:21.627153 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8644f-621b-4269-bcf8-a24238f1e9b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:21.628780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8644f-621b-4269-bcf8-a24238f1e9b2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:21.639914 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 146/290] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:21.645515 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434f83f-c67f-447f-9019-4ab7bbcf11ff None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:21.661250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:21.759680 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434f83f-c67f-447f-9019-4ab7bbcf11ff None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:21.796898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac48e5-03cc-4989-9eea-be72482d850a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:21.797828 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac48e5-03cc-4989-9eea-be72482d850a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:21.798762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac48e5-03cc-4989-9eea-be72482d850a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:21.799132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac48e5-03cc-4989-9eea-be72482d850a None admin] PATH_INFO: `/v3/users/964ac0e3b4864f6e9acb3286ecd01cd6` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:21.800398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac48e5-03cc-4989-9eea-be72482d850a None admin] RBAC: Authorizing `identity:get_user(user_id=964ac0e3b4864f6e9acb3286ecd01cd6)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:21.801866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac48e5-03cc-4989-9eea-be72482d850a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:21.804221 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 145/291] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:21 2022] GET /identity/v3/users/964ac0e3b4864f6e9acb3286ecd01cd6 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:21.809608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8644f-621b-4269-bcf8-a24238f1e9b2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:21.933395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8644f-621b-4269-bcf8-a24238f1e9b2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:21.982123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a545e-a7f9-43bf-ac84-b268c0f98184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:21.983199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a545e-a7f9-43bf-ac84-b268c0f98184 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:21.983199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a545e-a7f9-43bf-ac84-b268c0f98184 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:21.983199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a545e-a7f9-43bf-ac84-b268c0f98184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:22.071696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a545e-a7f9-43bf-ac84-b268c0f98184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:22.073156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a545e-a7f9-43bf-ac84-b268c0f98184 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:22.075111 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:22.211592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 147/292] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:22.216253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac48e5-03cc-4989-9eea-be72482d850a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:22.331483 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:22.359501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac48e5-03cc-4989-9eea-be72482d850a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:22.404125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e17b75-38e5-426c-9aae-9d1344d95ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:22.404994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e17b75-38e5-426c-9aae-9d1344d95ffc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:22.405274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e17b75-38e5-426c-9aae-9d1344d95ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:22.405548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e17b75-38e5-426c-9aae-9d1344d95ffc None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:22.411927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e17b75-38e5-426c-9aae-9d1344d95ffc None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:22.413397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e17b75-38e5-426c-9aae-9d1344d95ffc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:22.415329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 146/293] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:22 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:22.421326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a545e-a7f9-43bf-ac84-b268c0f98184 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:22.550596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:22.578335 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a545e-a7f9-43bf-ac84-b268c0f98184 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:22.641312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8899b-8e37-4fc8-b1dc-4dce64d227b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:22.642193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8899b-8e37-4fc8-b1dc-4dce64d227b3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:22.642509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8899b-8e37-4fc8-b1dc-4dce64d227b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:22.642793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8899b-8e37-4fc8-b1dc-4dce64d227b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:22.643678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8899b-8e37-4fc8-b1dc-4dce64d227b3 None admin] RBAC: Adding query filter params (role.id=e9451c79645545d78e667c61eece4ec8, scope.project.id=e9135a691446476da5eef60527399dcc, user.id=964ac0e3b4864f6e9acb3286ecd01cd6) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:22.643998 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8899b-8e37-4fc8-b1dc-4dce64d227b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:22.645454 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8899b-8e37-4fc8-b1dc-4dce64d227b3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:22.657609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 148/294] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:22 2022] GET /identity/v3/role_assignments?user.id=964ac0e3b4864f6e9acb3286ecd01cd6&scope.project.id=e9135a691446476da5eef60527399dcc&role.id=e9451c79645545d78e667c61eece4ec8 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:23.576201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f8220-e0f0-4231-b6b4-c356f7de64c4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:23.576742 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f8220-e0f0-4231-b6b4-c356f7de64c4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:23.576742 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f8220-e0f0-4231-b6b4-c356f7de64c4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:23.578116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 147/295] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:23.589179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f418-5901-4691-b0ec-288e618336b4 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:23.594589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f418-5901-4691-b0ec-288e618336b4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:23.595401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f418-5901-4691-b0ec-288e618336b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:23.613044 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-25d5f418-5901-4691-b0ec-288e618336b4 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:23.614511 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-25d5f418-5901-4691-b0ec-288e618336b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:23.683470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 149/296] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:23.707567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f8220-e0f0-4231-b6b4-c356f7de64c4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:23.751737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721e90f-8740-43b1-b319-96b3c9c53d57 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:23.752349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721e90f-8740-43b1-b319-96b3c9c53d57 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:23.752818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721e90f-8740-43b1-b319-96b3c9c53d57 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:23.754678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 150/297] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:28:23.760266 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dbcef-7436-4bf3-9117-9bb7505e1e7e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:23.760794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dbcef-7436-4bf3-9117-9bb7505e1e7e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:23.761264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dbcef-7436-4bf3-9117-9bb7505e1e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:23.779000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-bc8dbcef-7436-4bf3-9117-9bb7505e1e7e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:23.780519 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-bc8dbcef-7436-4bf3-9117-9bb7505e1e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:23.822261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f8220-e0f0-4231-b6b4-c356f7de64c4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:23.858776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1c8ae-f45d-4a27-90e4-306664d4e09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:23.859143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 151/298] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:23.859540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c8ae-f45d-4a27-90e4-306664d4e09d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:23.860097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c8ae-f45d-4a27-90e4-306664d4e09d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:23.860382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c8ae-f45d-4a27-90e4-306664d4e09d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:23.872035 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1c8ae-f45d-4a27-90e4-306664d4e09d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:23.874902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dbcef-7436-4bf3-9117-9bb7505e1e7e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-19d1c8ae-f45d-4a27-90e4-306664d4e09d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:23.881176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:23.882083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:23.883481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:23.883481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:23.883481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:23.883481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:23.883481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:23.883481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:23.883481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:23.883481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:23.883481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:23.883481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:23.883481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:23.883481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:23.883481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 148/299] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:23.889411 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1c8ae-f45d-4a27-90e4-306664d4e09d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:23.891970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:23.896434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:23.984003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dbcef-7436-4bf3-9117-9bb7505e1e7e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:23.997024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1c8ae-f45d-4a27-90e4-306664d4e09d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:24.025253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a91f3-1175-4aeb-ab6b-cc16b79dc638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:24.026084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a91f3-1175-4aeb-ab6b-cc16b79dc638 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.026322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a91f3-1175-4aeb-ab6b-cc16b79dc638 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.026632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a91f3-1175-4aeb-ab6b-cc16b79dc638 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.037153 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2ddb8-8c62-4c1d-9539-f86cbfdb7c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:24.037823 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ddb8-8c62-4c1d-9539-f86cbfdb7c14 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.038106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ddb8-8c62-4c1d-9539-f86cbfdb7c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.038207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a91f3-1175-4aeb-ab6b-cc16b79dc638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:24.038380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ddb8-8c62-4c1d-9539-f86cbfdb7c14 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.039119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2ddb8-8c62-4c1d-9539-f86cbfdb7c14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:24.039459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2ddb8-8c62-4c1d-9539-f86cbfdb7c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:24.040837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2ddb8-8c62-4c1d-9539-f86cbfdb7c14 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-d20a91f3-1175-4aeb-ab6b-cc16b79dc638 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:24.046919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:24.048058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:24.049060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:24.049060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:24.049060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:24.049060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:24.049060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:24.049060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:24.049060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:24.049060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:24.049060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:24.049060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:24.049060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:24.049060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:24.049661 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 152/300] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:24.050760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 149/301] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:24.051027 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb0be2-7c62-4d24-bfb8-00d8124a55d0 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.051369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb0be2-7c62-4d24-bfb8-00d8124a55d0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.051709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb0be2-7c62-4d24-bfb8-00d8124a55d0 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.052093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c2f6-943d-4c09-9fc6-c39870ad81b7 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.052374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c2f6-943d-4c09-9fc6-c39870ad81b7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.052682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c2f6-943d-4c09-9fc6-c39870ad81b7 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.053360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 153/302] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:24.057754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 150/303] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:24.058629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb0be2-7c62-4d24-bfb8-00d8124a55d0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:24.059058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa5375-9824-4670-960e-0b04f8a8b510 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.059392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa5375-9824-4670-960e-0b04f8a8b510 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.059672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa5375-9824-4670-960e-0b04f8a8b510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.080629 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a3aa5375-9824-4670-960e-0b04f8a8b510 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:24.081819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a3aa5375-9824-4670-960e-0b04f8a8b510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:24.137367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:24.148983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:24.157332 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 151/304] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:24.158383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa5375-9824-4670-960e-0b04f8a8b510 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:24.179129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb0be2-7c62-4d24-bfb8-00d8124a55d0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:24.225561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78134565-1fe4-468b-8c99-5dfc49c2791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:24.226555 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78134565-1fe4-468b-8c99-5dfc49c2791a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.227082 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78134565-1fe4-468b-8c99-5dfc49c2791a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.227527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78134565-1fe4-468b-8c99-5dfc49c2791a None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.228406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78134565-1fe4-468b-8c99-5dfc49c2791a None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:24.228875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78134565-1fe4-468b-8c99-5dfc49c2791a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:24.230257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78134565-1fe4-468b-8c99-5dfc49c2791a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:24.241706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 154/305] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:24.242963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6bd64-4635-48c5-a0d8-47bd434b1dde None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.243271 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6bd64-4635-48c5-a0d8-47bd434b1dde None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.243547 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6bd64-4635-48c5-a0d8-47bd434b1dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.261554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d7d6bd64-4635-48c5-a0d8-47bd434b1dde None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:24.263291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d7d6bd64-4635-48c5-a0d8-47bd434b1dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:24.275111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa5375-9824-4670-960e-0b04f8a8b510 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:24.311912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d26c60-de07-477e-95cb-62ba26e6496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:24.312798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d26c60-de07-477e-95cb-62ba26e6496c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.313085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d26c60-de07-477e-95cb-62ba26e6496c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.313360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d26c60-de07-477e-95cb-62ba26e6496c None admin] PATH_INFO: `/v3/users/d4373b035f48465088f9416f24447fdf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.315115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d26c60-de07-477e-95cb-62ba26e6496c None admin] RBAC: Authorizing `identity:get_user(user_id=d4373b035f48465088f9416f24447fdf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:24.317015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d26c60-de07-477e-95cb-62ba26e6496c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:24.323215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 152/306] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:24 2022] GET /identity/v3/users/d4373b035f48465088f9416f24447fdf => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:24.323215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d26c60-de07-477e-95cb-62ba26e6496c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:24.346271 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 155/307] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:24.347119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6bd64-4635-48c5-a0d8-47bd434b1dde None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:24.383270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:24.414060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:24.420461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d26c60-de07-477e-95cb-62ba26e6496c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:24.453737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6bd64-4635-48c5-a0d8-47bd434b1dde None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:24.453918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3781c9-31fb-4668-98f5-f959dbc46994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:24.455208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3781c9-31fb-4668-98f5-f959dbc46994 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.455631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3781c9-31fb-4668-98f5-f959dbc46994 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.455912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3781c9-31fb-4668-98f5-f959dbc46994 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.457106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3781c9-31fb-4668-98f5-f959dbc46994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:24.458567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3781c9-31fb-4668-98f5-f959dbc46994 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:24.460227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 153/308] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:24.460990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3781c9-31fb-4668-98f5-f959dbc46994 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:24.492930 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4a875-0263-45a7-a077-f2552f9323cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:24.493799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4a875-0263-45a7-a077-f2552f9323cb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.494081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4a875-0263-45a7-a077-f2552f9323cb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.494360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4a875-0263-45a7-a077-f2552f9323cb None admin] PATH_INFO: `/v3/users/e58d3eea598a4549a3fccefde8afdfa0` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.495579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4a875-0263-45a7-a077-f2552f9323cb None admin] RBAC: Authorizing `identity:get_user(user_id=e58d3eea598a4549a3fccefde8afdfa0)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:24.497012 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4a875-0263-45a7-a077-f2552f9323cb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:24.498634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 156/309] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:24 2022] GET /identity/v3/users/e58d3eea598a4549a3fccefde8afdfa0 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:24.499405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4a875-0263-45a7-a077-f2552f9323cb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:24.566651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3781c9-31fb-4668-98f5-f959dbc46994 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:24.600438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:24.604862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4a875-0263-45a7-a077-f2552f9323cb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:24.606158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57d946-a42d-47fc-99cd-ce447fb66671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:24.606808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57d946-a42d-47fc-99cd-ce447fb66671 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.607093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57d946-a42d-47fc-99cd-ce447fb66671 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.607397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57d946-a42d-47fc-99cd-ce447fb66671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.632464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:24.640557 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba066a-c168-4cec-a917-96c877a9a1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:24.641349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba066a-c168-4cec-a917-96c877a9a1ca None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.641654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba066a-c168-4cec-a917-96c877a9a1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.641990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba066a-c168-4cec-a917-96c877a9a1ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.653451 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba066a-c168-4cec-a917-96c877a9a1ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-7cba066a-c168-4cec-a917-96c877a9a1ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:24.661720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:24.662604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 157/310] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:24.668648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba066a-c168-4cec-a917-96c877a9a1ca None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:24.676939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57d946-a42d-47fc-99cd-ce447fb66671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:24.678418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57d946-a42d-47fc-99cd-ce447fb66671 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:24.764259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba066a-c168-4cec-a917-96c877a9a1ca None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:24.777930 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 154/311] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:24.778739 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57d946-a42d-47fc-99cd-ce447fb66671 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:24.802705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d993e-f607-495b-bb32-92ca8865b714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:24.803399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d993e-f607-495b-bb32-92ca8865b714 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.803686 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d993e-f607-495b-bb32-92ca8865b714 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.803964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d993e-f607-495b-bb32-92ca8865b714 None admin] PATH_INFO: `/v3/groups` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.804645 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d993e-f607-495b-bb32-92ca8865b714 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:24.806100 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d993e-f607-495b-bb32-92ca8865b714 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:24.810518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:24.821572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 158/312] 10.222.0.33 () {60 vars in 1134 bytes} [Wed Jul 6 20:28:24 2022] POST /identity/v3/groups => generated 229 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:28:24.822356 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d993e-f607-495b-bb32-92ca8865b714 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:24.881333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:24.898871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57d946-a42d-47fc-99cd-ce447fb66671 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:24.940187 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22366493-86b5-4baa-9ac0-a72de0d1434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:24.940851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d993e-f607-495b-bb32-92ca8865b714 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:24.940964 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22366493-86b5-4baa-9ac0-a72de0d1434a None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.941249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22366493-86b5-4baa-9ac0-a72de0d1434a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.941525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22366493-86b5-4baa-9ac0-a72de0d1434a None admin] PATH_INFO: `/v3/system/users/e58d3eea598a4549a3fccefde8afdfa0/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.943336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22366493-86b5-4baa-9ac0-a72de0d1434a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e58d3eea598a4549a3fccefde8afdfa0, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:24.945659 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22366493-86b5-4baa-9ac0-a72de0d1434a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:24.956879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 155/313] 10.222.0.33 () {58 vars in 1334 bytes} [Wed Jul 6 20:28:24 2022] PUT /identity/v3/system/users/e58d3eea598a4549a3fccefde8afdfa0/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:28:24.958261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22366493-86b5-4baa-9ac0-a72de0d1434a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:24.993129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e2b94-9af1-45ff-bdc3-bc5d7ce80864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:24.993904 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e2b94-9af1-45ff-bdc3-bc5d7ce80864 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:24.994096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e2b94-9af1-45ff-bdc3-bc5d7ce80864 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:24.994372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e2b94-9af1-45ff-bdc3-bc5d7ce80864 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:24.995141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e2b94-9af1-45ff-bdc3-bc5d7ce80864 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:24.995497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e2b94-9af1-45ff-bdc3-bc5d7ce80864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:24.997892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e2b94-9af1-45ff-bdc3-bc5d7ce80864 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:25.011294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 159/314] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:25.018732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e2b94-9af1-45ff-bdc3-bc5d7ce80864 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:25.099449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:25.107831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22366493-86b5-4baa-9ac0-a72de0d1434a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:25.147480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e2b94-9af1-45ff-bdc3-bc5d7ce80864 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:25.158819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e181e3-e46a-4341-90b0-85424d9f4c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:25.159979 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e181e3-e46a-4341-90b0-85424d9f4c57 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:25.160474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e181e3-e46a-4341-90b0-85424d9f4c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:25.160907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e181e3-e46a-4341-90b0-85424d9f4c57 None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:25.162358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:25.163535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e181e3-e46a-4341-90b0-85424d9f4c57 None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:25.165157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e181e3-e46a-4341-90b0-85424d9f4c57 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:25.167056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 156/315] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:24 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:25.175692 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e181e3-e46a-4341-90b0-85424d9f4c57 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:25.191563 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927c3de-706e-4b28-a3fa-35786ff1941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:25.192603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927c3de-706e-4b28-a3fa-35786ff1941a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:25.192960 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927c3de-706e-4b28-a3fa-35786ff1941a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:25.193383 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927c3de-706e-4b28-a3fa-35786ff1941a None admin] PATH_INFO: `/v3/users/d96af93a0b0749b49d8de5365f95ed02` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:25.207968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927c3de-706e-4b28-a3fa-35786ff1941a None admin] RBAC: Authorizing `identity:get_user(user_id=d96af93a0b0749b49d8de5365f95ed02)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:25.209664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927c3de-706e-4b28-a3fa-35786ff1941a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:25.211835 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 160/316] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:25 2022] GET /identity/v3/users/d96af93a0b0749b49d8de5365f95ed02 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:25.217295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927c3de-706e-4b28-a3fa-35786ff1941a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:25.315622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e181e3-e46a-4341-90b0-85424d9f4c57 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:25.353481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770eec4-df11-41c1-bb5a-134b3f5b551d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:25.354145 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770eec4-df11-41c1-bb5a-134b3f5b551d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:25.354431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770eec4-df11-41c1-bb5a-134b3f5b551d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:25.355079 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770eec4-df11-41c1-bb5a-134b3f5b551d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:25.356224 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770eec4-df11-41c1-bb5a-134b3f5b551d None admin] RBAC: Adding query filter params (role.id=45c107a1713445dcbcc66380d2666ae5, scope.project.id=e9135a691446476da5eef60527399dcc, user.id=d4373b035f48465088f9416f24447fdf) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:25.356544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770eec4-df11-41c1-bb5a-134b3f5b551d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:25.358111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770eec4-df11-41c1-bb5a-134b3f5b551d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:25.358613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927c3de-706e-4b28-a3fa-35786ff1941a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:25.371206 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 157/317] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:25 2022] GET /identity/v3/role_assignments?user.id=d4373b035f48465088f9416f24447fdf&scope.project.id=e9135a691446476da5eef60527399dcc&role.id=45c107a1713445dcbcc66380d2666ae5 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:25.402328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaabc26-9564-4768-b1f9-b34b47248452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:25.402999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaabc26-9564-4768-b1f9-b34b47248452 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:25.403308 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaabc26-9564-4768-b1f9-b34b47248452 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:25.403583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaabc26-9564-4768-b1f9-b34b47248452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:25.404430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaabc26-9564-4768-b1f9-b34b47248452 None admin] RBAC: Adding query filter params (role.id=45c107a1713445dcbcc66380d2666ae5, user.id=d96af93a0b0749b49d8de5365f95ed02, scope.system=all) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:25.404744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaabc26-9564-4768-b1f9-b34b47248452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:25.406220 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaabc26-9564-4768-b1f9-b34b47248452 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:25.413020 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 161/318] 10.222.0.33 () {56 vars in 1308 bytes} [Wed Jul 6 20:28:25 2022] GET /identity/v3/role_assignments?user.id=d96af93a0b0749b49d8de5365f95ed02&scope.system=all&role.id=45c107a1713445dcbcc66380d2666ae5 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:27.038770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b63717-4479-48a8-81f2-84f2f5892d73 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:27.039528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b63717-4479-48a8-81f2-84f2f5892d73 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:27.039528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b63717-4479-48a8-81f2-84f2f5892d73 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:27.040794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 158/319] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:28:27.045818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15851bf4-641a-455e-83d0-3862818462b2 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:27.046191 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15851bf4-641a-455e-83d0-3862818462b2 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:27.046384 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15851bf4-641a-455e-83d0-3862818462b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:27.064277 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-15851bf4-641a-455e-83d0-3862818462b2 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:27.065156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da7ea1-7620-48c1-936e-c626b378cf6e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:27.065451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da7ea1-7620-48c1-936e-c626b378cf6e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:27.065548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-15851bf4-641a-455e-83d0-3862818462b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:27.065735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da7ea1-7620-48c1-936e-c626b378cf6e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:27.067264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 159/320] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:28:27.071957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530a8a9-9f3e-44cb-9dac-7b7297a6f19a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:27.072253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530a8a9-9f3e-44cb-9dac-7b7297a6f19a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:27.072538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530a8a9-9f3e-44cb-9dac-7b7297a6f19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:27.090251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2530a8a9-9f3e-44cb-9dac-7b7297a6f19a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:27.091485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2530a8a9-9f3e-44cb-9dac-7b7297a6f19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:27.093952 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:27.117151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:27.147660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 162/321] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:27.163150 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15851bf4-641a-455e-83d0-3862818462b2 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:27.165345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 160/322] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:27.188462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530a8a9-9f3e-44cb-9dac-7b7297a6f19a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:27.278005 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15851bf4-641a-455e-83d0-3862818462b2 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:27.304750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530a8a9-9f3e-44cb-9dac-7b7297a6f19a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:27.316300 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce06c1f-1b18-4444-aa1a-3b3bedaaa691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:27.317105 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce06c1f-1b18-4444-aa1a-3b3bedaaa691 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:27.317391 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce06c1f-1b18-4444-aa1a-3b3bedaaa691 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:27.317669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce06c1f-1b18-4444-aa1a-3b3bedaaa691 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:27.327857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce06c1f-1b18-4444-aa1a-3b3bedaaa691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-9ce06c1f-1b18-4444-aa1a-3b3bedaaa691 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:27.335559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:27.336448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:27.337238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:27.337238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:27.337238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:27.337238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:27.337238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:27.337238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:27.337238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:27.337238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:27.337238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:27.337238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:27.337238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:27.337238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:27.337238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 163/323] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:27.342801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce06c1f-1b18-4444-aa1a-3b3bedaaa691 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:27.352530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9a68a-8d2c-4307-8ddf-737b74e16c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:27.353576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a68a-8d2c-4307-8ddf-737b74e16c50 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:27.354010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a68a-8d2c-4307-8ddf-737b74e16c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:27.354454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a68a-8d2c-4307-8ddf-737b74e16c50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:27.355813 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9a68a-8d2c-4307-8ddf-737b74e16c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:27.357443 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9a68a-8d2c-4307-8ddf-737b74e16c50 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:27.360764 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 161/324] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:27.366873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9a68a-8d2c-4307-8ddf-737b74e16c50 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:27.370739 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:27.396345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:27.455880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce06c1f-1b18-4444-aa1a-3b3bedaaa691 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:27.474666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9a68a-8d2c-4307-8ddf-737b74e16c50 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:27.489207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cf097-6e81-4c17-baf0-932d6105f933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:27.489871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cf097-6e81-4c17-baf0-932d6105f933 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:27.490156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cf097-6e81-4c17-baf0-932d6105f933 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:27.490434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cf097-6e81-4c17-baf0-932d6105f933 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:27.491193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cf097-6e81-4c17-baf0-932d6105f933 None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:27.491527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cf097-6e81-4c17-baf0-932d6105f933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:27.492923 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cf097-6e81-4c17-baf0-932d6105f933 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:27.501590 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 164/325] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:27.502996 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae24a-647b-4864-971e-c20ea1bfde22 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:27.503311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae24a-647b-4864-971e-c20ea1bfde22 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:27.503595 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae24a-647b-4864-971e-c20ea1bfde22 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:27.504986 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 165/326] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:27.507993 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ae24a-647b-4864-971e-c20ea1bfde22 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:27.509381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945453a-2165-4a11-8dba-20d4a8a48925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:27.510053 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945453a-2165-4a11-8dba-20d4a8a48925 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:27.510349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945453a-2165-4a11-8dba-20d4a8a48925 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:27.510631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945453a-2165-4a11-8dba-20d4a8a48925 None admin] PATH_INFO: `/v3/groups` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:27.511356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945453a-2165-4a11-8dba-20d4a8a48925 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:27.512817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945453a-2165-4a11-8dba-20d4a8a48925 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:27.530988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 162/327] 10.222.0.33 () {60 vars in 1134 bytes} [Wed Jul 6 20:28:27 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:28:27.532447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592586b8-aae0-4095-a525-ab21e2d0c284 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:27.532740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592586b8-aae0-4095-a525-ab21e2d0c284 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:27.533020 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592586b8-aae0-4095-a525-ab21e2d0c284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:27.553114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-592586b8-aae0-4095-a525-ab21e2d0c284 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:27.554370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-592586b8-aae0-4095-a525-ab21e2d0c284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:27.605832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:27.626498 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ae24a-647b-4864-971e-c20ea1bfde22 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:27.642856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 163/328] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:27.665479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592586b8-aae0-4095-a525-ab21e2d0c284 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:27.670674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb3bc7-a758-4215-897f-d78449770af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:27.671653 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb3bc7-a758-4215-897f-d78449770af1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:27.671935 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb3bc7-a758-4215-897f-d78449770af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:27.672209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb3bc7-a758-4215-897f-d78449770af1 None admin] PATH_INFO: `/v3/users/e58d3eea598a4549a3fccefde8afdfa0` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:27.673534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb3bc7-a758-4215-897f-d78449770af1 None admin] RBAC: Authorizing `identity:get_user(user_id=e58d3eea598a4549a3fccefde8afdfa0)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:27.675636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb3bc7-a758-4215-897f-d78449770af1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:27.680040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 166/329] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:27 2022] GET /identity/v3/users/e58d3eea598a4549a3fccefde8afdfa0 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:27.683536 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb3bc7-a758-4215-897f-d78449770af1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:27.691507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:27.802890 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb3bc7-a758-4215-897f-d78449770af1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:27.806926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592586b8-aae0-4095-a525-ab21e2d0c284 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:27.847435 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c647193-07f7-444d-847c-ed65c69dde16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:27.848056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c647193-07f7-444d-847c-ed65c69dde16 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:27.848342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c647193-07f7-444d-847c-ed65c69dde16 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:27.848618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c647193-07f7-444d-847c-ed65c69dde16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:27.849459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c647193-07f7-444d-847c-ed65c69dde16 None admin] RBAC: Adding query filter params (role.id=e9451c79645545d78e667c61eece4ec8, user.id=e58d3eea598a4549a3fccefde8afdfa0, scope.system=all) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:27.849771 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c647193-07f7-444d-847c-ed65c69dde16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:27.851246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c647193-07f7-444d-847c-ed65c69dde16 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:27.853898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f2709-5b86-46c5-9f89-d70bde220c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:27.855028 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f2709-5b86-46c5-9f89-d70bde220c23 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:27.855602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f2709-5b86-46c5-9f89-d70bde220c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:27.856372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f2709-5b86-46c5-9f89-d70bde220c23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:27.865409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 167/330] 10.222.0.33 () {56 vars in 1308 bytes} [Wed Jul 6 20:28:27 2022] GET /identity/v3/role_assignments?user.id=e58d3eea598a4549a3fccefde8afdfa0&scope.system=all&role.id=e9451c79645545d78e667c61eece4ec8 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:27.868446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f2709-5b86-46c5-9f89-d70bde220c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-872f2709-5b86-46c5-9f89-d70bde220c23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:27.876429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:27.877497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:27.878504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:27.878504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:27.878504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:27.878504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:27.878504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:27.878504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:27.878504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:27.878504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:27.878504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:27.878504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:27.878504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:27.878504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:27.878504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 164/331] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:27.885275 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c647193-07f7-444d-847c-ed65c69dde16 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:27.907734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:28.007737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c647193-07f7-444d-847c-ed65c69dde16 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:28.046398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1e0a3-3b2a-4747-ade4-b8ad98608668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:28.048623 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1e0a3-3b2a-4747-ade4-b8ad98608668 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:28.049247 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1e0a3-3b2a-4747-ade4-b8ad98608668 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:28.049728 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1e0a3-3b2a-4747-ade4-b8ad98608668 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:28.050675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1e0a3-3b2a-4747-ade4-b8ad98608668 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:28.051218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1e0a3-3b2a-4747-ade4-b8ad98608668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:28.052800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1e0a3-3b2a-4747-ade4-b8ad98608668 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:28.062353 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 168/332] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:28.068302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f2709-5b86-46c5-9f89-d70bde220c23 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:28.156007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:28.181326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f2709-5b86-46c5-9f89-d70bde220c23 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:28.216673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc2f13-6c39-404b-8062-9309b2ba0810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:28.217951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc2f13-6c39-404b-8062-9309b2ba0810 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:28.218454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc2f13-6c39-404b-8062-9309b2ba0810 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:28.218927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc2f13-6c39-404b-8062-9309b2ba0810 None admin] PATH_INFO: `/v3/users/d96af93a0b0749b49d8de5365f95ed02` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:28.220917 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc2f13-6c39-404b-8062-9309b2ba0810 None admin] RBAC: Authorizing `identity:get_user(user_id=d96af93a0b0749b49d8de5365f95ed02)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:28.222627 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc2f13-6c39-404b-8062-9309b2ba0810 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:28.224692 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 165/333] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:28 2022] GET /identity/v3/users/d96af93a0b0749b49d8de5365f95ed02 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:28.230045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1e0a3-3b2a-4747-ade4-b8ad98608668 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:28.311892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:28.344012 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1e0a3-3b2a-4747-ade4-b8ad98608668 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:28.379636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc7cc4-35b4-471a-837c-40887b52ad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:28.380509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc7cc4-35b4-471a-837c-40887b52ad37 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:28.380790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc7cc4-35b4-471a-837c-40887b52ad37 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:28.381068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc7cc4-35b4-471a-837c-40887b52ad37 None admin] PATH_INFO: `/v3/system/users/d96af93a0b0749b49d8de5365f95ed02/roles/45c107a1713445dcbcc66380d2666ae5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:28.384360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc7cc4-35b4-471a-837c-40887b52ad37 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d96af93a0b0749b49d8de5365f95ed02, role_id=45c107a1713445dcbcc66380d2666ae5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:28.385749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc7cc4-35b4-471a-837c-40887b52ad37 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:28.398090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 169/334] 10.222.0.33 () {58 vars in 1334 bytes} [Wed Jul 6 20:28:28 2022] PUT /identity/v3/system/users/d96af93a0b0749b49d8de5365f95ed02/roles/45c107a1713445dcbcc66380d2666ae5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:28:30.082273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bfd4c-3ce7-4497-87ff-1caf34f62a9d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:30.082808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bfd4c-3ce7-4497-87ff-1caf34f62a9d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:30.082808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bfd4c-3ce7-4497-87ff-1caf34f62a9d None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:30.084225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 166/335] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:30.092209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca8598-ac39-4a2d-a91d-76be7054adea None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:30.092652 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca8598-ac39-4a2d-a91d-76be7054adea None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:30.092870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca8598-ac39-4a2d-a91d-76be7054adea None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:30.094501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 170/336] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:30.098638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7ef84-b826-4682-8b88-48f467c6ebe9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:30.098932 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7ef84-b826-4682-8b88-48f467c6ebe9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:30.099246 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7ef84-b826-4682-8b88-48f467c6ebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:30.105389 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c729af-ea87-4b07-a05d-ea9432e1a12d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:30.105680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c729af-ea87-4b07-a05d-ea9432e1a12d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:30.105958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c729af-ea87-4b07-a05d-ea9432e1a12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:30.125083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-23c7ef84-b826-4682-8b88-48f467c6ebe9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:30.127205 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-23c7ef84-b826-4682-8b88-48f467c6ebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:30.147385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-13c729af-ea87-4b07-a05d-ea9432e1a12d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:30.148612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-13c729af-ea87-4b07-a05d-ea9432e1a12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:30.270467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 167/337] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:30.280284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 171/338] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:30.304877 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7ef84-b826-4682-8b88-48f467c6ebe9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:30.318749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c729af-ea87-4b07-a05d-ea9432e1a12d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:30.437721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:30.449793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:30.487404 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7ef84-b826-4682-8b88-48f467c6ebe9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:30.508992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c729af-ea87-4b07-a05d-ea9432e1a12d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:30.551358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d21480-1bb2-4d0a-b522-90e6178fe551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:30.553172 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d21480-1bb2-4d0a-b522-90e6178fe551 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:30.553720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d21480-1bb2-4d0a-b522-90e6178fe551 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:30.554294 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d21480-1bb2-4d0a-b522-90e6178fe551 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:30.581633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d21480-1bb2-4d0a-b522-90e6178fe551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:30.599196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc8520-df31-4c9f-8ce1-398d4d312be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:30.599196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc8520-df31-4c9f-8ce1-398d4d312be7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:30.599196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc8520-df31-4c9f-8ce1-398d4d312be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:30.599196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc8520-df31-4c9f-8ce1-398d4d312be7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-93d21480-1bb2-4d0a-b522-90e6178fe551 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:30.602567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:30.603457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:30.604249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:30.604249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:30.604249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:30.604249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:30.604249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:30.604249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:30.604249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:30.604249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:30.604249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:30.604249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:30.604249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:30.604249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:30.607087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 168/339] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:28:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:30.615759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d21480-1bb2-4d0a-b522-90e6178fe551 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:30.636197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc8520-df31-4c9f-8ce1-398d4d312be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-61bc8520-df31-4c9f-8ce1-398d4d312be7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:30.649892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:30.651059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:30.652046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:30.652046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:30.652046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:30.652046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:30.652046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:30.652046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:30.652046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:30.652046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:30.652046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:30.652046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:30.652046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:30.652046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:30.652654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 172/340] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:30.658829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc8520-df31-4c9f-8ce1-398d4d312be7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:30.826980 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d21480-1bb2-4d0a-b522-90e6178fe551 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:30.849170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc8520-df31-4c9f-8ce1-398d4d312be7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:30.899542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:30.903377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd182d-b212-4797-ab97-910e8b6ed6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:30.904217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd182d-b212-4797-ab97-910e8b6ed6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:30.904339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd182d-b212-4797-ab97-910e8b6ed6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:30.904617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd182d-b212-4797-ab97-910e8b6ed6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:30.905382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd182d-b212-4797-ab97-910e8b6ed6a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:30.905692 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd182d-b212-4797-ab97-910e8b6ed6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:30.908012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd182d-b212-4797-ab97-910e8b6ed6a3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:30.911161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:30.930207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b59a78-c755-4a74-a605-12b10ff0f0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:30.930904 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b59a78-c755-4a74-a605-12b10ff0f0da None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:30.931209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b59a78-c755-4a74-a605-12b10ff0f0da None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:30.931490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b59a78-c755-4a74-a605-12b10ff0f0da None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:30.932256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b59a78-c755-4a74-a605-12b10ff0f0da None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:30.932569 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b59a78-c755-4a74-a605-12b10ff0f0da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:30.933980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b59a78-c755-4a74-a605-12b10ff0f0da None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:30.936400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 169/341] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:30.938322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104805a9-6c9d-41db-909d-47d2fb8d4800 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:30.938616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104805a9-6c9d-41db-909d-47d2fb8d4800 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:30.938899 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104805a9-6c9d-41db-909d-47d2fb8d4800 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:30.940308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 170/342] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:30.948962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2cee6-d649-4d5a-9af5-96875fcfee1c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:30.949268 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2cee6-d649-4d5a-9af5-96875fcfee1c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:30.949527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2cee6-d649-4d5a-9af5-96875fcfee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:30.968429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 173/343] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:30.970003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b59a78-c755-4a74-a605-12b10ff0f0da None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:30.988393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-61b2cee6-d649-4d5a-9af5-96875fcfee1c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:30.990505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-61b2cee6-d649-4d5a-9af5-96875fcfee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:31.124527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b59a78-c755-4a74-a605-12b10ff0f0da None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:31.148811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 171/344] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:31.151776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2cee6-d649-4d5a-9af5-96875fcfee1c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:31.211633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734a2ac-6dbe-48e3-a81d-c136e6fc52a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:31.212665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734a2ac-6dbe-48e3-a81d-c136e6fc52a3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:31.213152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734a2ac-6dbe-48e3-a81d-c136e6fc52a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:31.213619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734a2ac-6dbe-48e3-a81d-c136e6fc52a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:31.309391 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:31.327093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734a2ac-6dbe-48e3-a81d-c136e6fc52a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:31.327505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2cee6-d649-4d5a-9af5-96875fcfee1c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:31.329372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734a2ac-6dbe-48e3-a81d-c136e6fc52a3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:31.372922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:31.397171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565940a8-200a-46d6-861d-c633811829e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:31.398102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565940a8-200a-46d6-861d-c633811829e8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:31.398595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565940a8-200a-46d6-861d-c633811829e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:31.399071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565940a8-200a-46d6-861d-c633811829e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:31.447227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 174/345] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:31.448447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734a2ac-6dbe-48e3-a81d-c136e6fc52a3 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:31.490620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565940a8-200a-46d6-861d-c633811829e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:31.492652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565940a8-200a-46d6-861d-c633811829e8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:31.553024 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:31.568927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734a2ac-6dbe-48e3-a81d-c136e6fc52a3 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:31.602803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 172/346] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:31.603698 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565940a8-200a-46d6-861d-c633811829e8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:31.611195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75237-4a1d-4e83-a76b-d3444f13b331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:31.611195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75237-4a1d-4e83-a76b-d3444f13b331 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:31.611195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75237-4a1d-4e83-a76b-d3444f13b331 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:31.611195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75237-4a1d-4e83-a76b-d3444f13b331 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:31.620586 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75237-4a1d-4e83-a76b-d3444f13b331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-76d75237-4a1d-4e83-a76b-d3444f13b331 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:31.629514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:31.630535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:31.631402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:31.631402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:31.631402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:31.631402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:31.631402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:31.631402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:31.631402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:31.631402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:31.631402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:31.631402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:31.631402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:31.631402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:31.631402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 175/347] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:31.632080 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75237-4a1d-4e83-a76b-d3444f13b331 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:31.632538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:31.747660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75237-4a1d-4e83-a76b-d3444f13b331 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:31.752673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565940a8-200a-46d6-861d-c633811829e8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:31.788676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7de86-92cf-4451-9858-6d9351d916a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:31.790058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7de86-92cf-4451-9858-6d9351d916a7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:31.790596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7de86-92cf-4451-9858-6d9351d916a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:31.791080 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7de86-92cf-4451-9858-6d9351d916a7 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:31.791942 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb203678-3f3d-4167-b460-11bff4f9898c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:31.792740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7de86-92cf-4451-9858-6d9351d916a7 None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:31.792866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb203678-3f3d-4167-b460-11bff4f9898c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:31.793144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb203678-3f3d-4167-b460-11bff4f9898c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:31.793415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb203678-3f3d-4167-b460-11bff4f9898c None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:31.794670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb203678-3f3d-4167-b460-11bff4f9898c None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:31.795008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7de86-92cf-4451-9858-6d9351d916a7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:31.796132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb203678-3f3d-4167-b460-11bff4f9898c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:31.797932 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 176/348] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:31 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:31.798840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7de86-92cf-4451-9858-6d9351d916a7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:31.807190 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 173/349] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:31 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:31.807190 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb203678-3f3d-4167-b460-11bff4f9898c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:31.838449 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:31.916623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:31.923720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb203678-3f3d-4167-b460-11bff4f9898c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:31.961432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63856bc1-5824-40e0-a48d-5ceec460d289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:31.962298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856bc1-5824-40e0-a48d-5ceec460d289 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:31.962584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856bc1-5824-40e0-a48d-5ceec460d289 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:31.962858 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856bc1-5824-40e0-a48d-5ceec460d289 None admin] PATH_INFO: `/v3/groups/d074030120884d3da3376ffa5354a80c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:31.967692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7de86-92cf-4451-9858-6d9351d916a7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:31.970740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63856bc1-5824-40e0-a48d-5ceec460d289 None admin] RBAC: Authorizing `identity:get_group(group_id=d074030120884d3da3376ffa5354a80c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:31.972222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63856bc1-5824-40e0-a48d-5ceec460d289 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:31.978010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 174/350] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:31 2022] GET /identity/v3/groups/d074030120884d3da3376ffa5354a80c => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:31.979252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63856bc1-5824-40e0-a48d-5ceec460d289 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:32.016730 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b16969-505b-4594-81aa-39a67e4b0c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:32.017330 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b16969-505b-4594-81aa-39a67e4b0c59 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:32.017615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b16969-505b-4594-81aa-39a67e4b0c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:32.017892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b16969-505b-4594-81aa-39a67e4b0c59 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:32.018646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b16969-505b-4594-81aa-39a67e4b0c59 None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:32.018953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b16969-505b-4594-81aa-39a67e4b0c59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:32.020621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b16969-505b-4594-81aa-39a67e4b0c59 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:32.035205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 177/351] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:32.035205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e61571-007d-4924-b036-35918184a1f0 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:32.035205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e61571-007d-4924-b036-35918184a1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:32.035205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e61571-007d-4924-b036-35918184a1f0 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:32.035959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 178/352] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:32.037021 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0787f-1b5b-4304-b8b4-eedfdd74d25e None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:32.037302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0787f-1b5b-4304-b8b4-eedfdd74d25e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:32.037577 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0787f-1b5b-4304-b8b4-eedfdd74d25e None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:32.038839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 179/353] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:32.039559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0787f-1b5b-4304-b8b4-eedfdd74d25e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:32.112337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63856bc1-5824-40e0-a48d-5ceec460d289 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:32.152627 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:32.157167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0464168-d6a0-4f68-979f-817d718bafb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:32.158242 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0464168-d6a0-4f68-979f-817d718bafb7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:32.158542 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0464168-d6a0-4f68-979f-817d718bafb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:32.158811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0464168-d6a0-4f68-979f-817d718bafb7 None admin] PATH_INFO: `/v3/groups/d074030120884d3da3376ffa5354a80c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:32.162175 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0464168-d6a0-4f68-979f-817d718bafb7 None admin] RBAC: Authorizing `identity:get_group(group_id=d074030120884d3da3376ffa5354a80c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:32.163695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0464168-d6a0-4f68-979f-817d718bafb7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:32.165823 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 175/354] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:31 2022] GET /identity/v3/groups/d074030120884d3da3376ffa5354a80c => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:32.166906 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0464168-d6a0-4f68-979f-817d718bafb7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:32.184023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0787f-1b5b-4304-b8b4-eedfdd74d25e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:32.209856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:32.235729 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8421ed-0beb-4b2b-92e3-7581ed8fbefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:32.236395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8421ed-0beb-4b2b-92e3-7581ed8fbefb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:32.236679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8421ed-0beb-4b2b-92e3-7581ed8fbefb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:32.236962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8421ed-0beb-4b2b-92e3-7581ed8fbefb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:32.237799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8421ed-0beb-4b2b-92e3-7581ed8fbefb None admin] RBAC: Adding query filter params (group.id=d074030120884d3da3376ffa5354a80c, role.id=e9451c79645545d78e667c61eece4ec8, scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:32.238117 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8421ed-0beb-4b2b-92e3-7581ed8fbefb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:32.240072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8421ed-0beb-4b2b-92e3-7581ed8fbefb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:32.245718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 180/355] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jul 6 20:28:32 2022] GET /identity/v3/role_assignments?group.id=d074030120884d3da3376ffa5354a80c&scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b&role.id=e9451c79645545d78e667c61eece4ec8 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:32.246922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ccf2-ac8a-4e8d-ad37-da29a387b124 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:32.248566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ccf2-ac8a-4e8d-ad37-da29a387b124 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:32.248874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ccf2-ac8a-4e8d-ad37-da29a387b124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:32.275968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-bc49ccf2-ac8a-4e8d-ad37-da29a387b124 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:32.277129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-bc49ccf2-ac8a-4e8d-ad37-da29a387b124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:32.332274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0464168-d6a0-4f68-979f-817d718bafb7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:32.365910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 181/356] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:32.368285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1af5c1-fbc6-41f7-b317-a2149681722d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:32.368285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1af5c1-fbc6-41f7-b317-a2149681722d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:32.373332 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925233b6-f269-4f26-b490-c5c6202dacd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:32.374298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925233b6-f269-4f26-b490-c5c6202dacd3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:32.374774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925233b6-f269-4f26-b490-c5c6202dacd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:32.375327 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1af5c1-fbc6-41f7-b317-a2149681722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:32.375605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925233b6-f269-4f26-b490-c5c6202dacd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:32.399239 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3d1af5c1-fbc6-41f7-b317-a2149681722d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:32.400488 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3d1af5c1-fbc6-41f7-b317-a2149681722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:32.463994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925233b6-f269-4f26-b490-c5c6202dacd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:32.465937 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925233b6-f269-4f26-b490-c5c6202dacd3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:32.495213 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 182/357] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:32.495213 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1af5c1-fbc6-41f7-b317-a2149681722d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:32.495952 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:32.499503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:32.607588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 176/358] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:32.609008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa7dce-db50-4a40-b69d-af57d5d06886 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:32.609297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa7dce-db50-4a40-b69d-af57d5d06886 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:32.610141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa7dce-db50-4a40-b69d-af57d5d06886 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:32.611647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 177/359] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:32.612177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa7dce-db50-4a40-b69d-af57d5d06886 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:32.650888 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1af5c1-fbc6-41f7-b317-a2149681722d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:32.696652 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5cb14-b91d-468e-99e4-d6856bc8b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:32.697318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5cb14-b91d-468e-99e4-d6856bc8b16b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:32.697606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5cb14-b91d-468e-99e4-d6856bc8b16b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:32.697880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5cb14-b91d-468e-99e4-d6856bc8b16b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:32.698722 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5cb14-b91d-468e-99e4-d6856bc8b16b None admin] RBAC: Adding query filter params (group.id=d074030120884d3da3376ffa5354a80c, role.id=4f0522c790e94492976ef2674f85ad66, scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:32.699062 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5cb14-b91d-468e-99e4-d6856bc8b16b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:32.700551 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5cb14-b91d-468e-99e4-d6856bc8b16b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:32.709464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 183/360] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jul 6 20:28:32 2022] GET /identity/v3/role_assignments?group.id=d074030120884d3da3376ffa5354a80c&scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b&role.id=4f0522c790e94492976ef2674f85ad66 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:32.710296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5cb14-b91d-468e-99e4-d6856bc8b16b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:32.752611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa7dce-db50-4a40-b69d-af57d5d06886 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:32.791512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:32.801759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:32.804651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb5102-e1dd-405c-9e32-cd009bb8e162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:32.805484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb5102-e1dd-405c-9e32-cd009bb8e162 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:32.805875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb5102-e1dd-405c-9e32-cd009bb8e162 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:32.806154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb5102-e1dd-405c-9e32-cd009bb8e162 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:32.828393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb5102-e1dd-405c-9e32-cd009bb8e162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-79cb5102-e1dd-405c-9e32-cd009bb8e162 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:32.841427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:32.843619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 178/361] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:32.845562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb5102-e1dd-405c-9e32-cd009bb8e162 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:32.876038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5cb14-b91d-468e-99e4-d6856bc8b16b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:32.935859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195b785-d9ff-4fee-8f73-d800e02fb733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:32.938982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195b785-d9ff-4fee-8f73-d800e02fb733 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:32.938982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195b785-d9ff-4fee-8f73-d800e02fb733 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:32.939878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195b785-d9ff-4fee-8f73-d800e02fb733 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:32.963959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195b785-d9ff-4fee-8f73-d800e02fb733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-8195b785-d9ff-4fee-8f73-d800e02fb733 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:32.976732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:32.977871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:32.978859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:32.978859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:32.978859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:32.978859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:32.978859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:32.978859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:32.978859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:32.978859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:32.978859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:32.978859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:32.978859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:32.978859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:32.987680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 184/362] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:28:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:32.987680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0cf42-f1ab-4ecf-9678-b9fc415b33ce None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:32.987680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0cf42-f1ab-4ecf-9678-b9fc415b33ce None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:32.987680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0cf42-f1ab-4ecf-9678-b9fc415b33ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:33.000269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb5102-e1dd-405c-9e32-cd009bb8e162 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:33.008120 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8bb0cf42-f1ab-4ecf-9678-b9fc415b33ce None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:33.009380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8bb0cf42-f1ab-4ecf-9678-b9fc415b33ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:33.043090 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c3d3a-9dea-4a0a-863a-5d30a30a2a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:33.044446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c3d3a-9dea-4a0a-863a-5d30a30a2a77 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:33.044936 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c3d3a-9dea-4a0a-863a-5d30a30a2a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:33.045536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c3d3a-9dea-4a0a-863a-5d30a30a2a77 None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:33.048516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c3d3a-9dea-4a0a-863a-5d30a30a2a77 None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:33.050430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c3d3a-9dea-4a0a-863a-5d30a30a2a77 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:33.052787 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 179/363] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:32 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:33.053767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c3d3a-9dea-4a0a-863a-5d30a30a2a77 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:33.092230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 185/364] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:33.092230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0cf42-f1ab-4ecf-9678-b9fc415b33ce None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:33.134392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:33.148831 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:33.200251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c3d3a-9dea-4a0a-863a-5d30a30a2a77 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:33.200749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0cf42-f1ab-4ecf-9678-b9fc415b33ce None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:33.241595 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db5844-4015-4d61-aeef-fb3d67655433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:33.242643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db5844-4015-4d61-aeef-fb3d67655433 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:33.243126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db5844-4015-4d61-aeef-fb3d67655433 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:33.243644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db5844-4015-4d61-aeef-fb3d67655433 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:33.244600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db5844-4015-4d61-aeef-fb3d67655433 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:33.245127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db5844-4015-4d61-aeef-fb3d67655433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:33.246718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db5844-4015-4d61-aeef-fb3d67655433 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:33.248252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb8f7d-0fac-407b-b6a2-8c52a18e2d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:33.249254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb8f7d-0fac-407b-b6a2-8c52a18e2d84 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:33.250008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb8f7d-0fac-407b-b6a2-8c52a18e2d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:33.250450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb8f7d-0fac-407b-b6a2-8c52a18e2d84 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:33.251431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb8f7d-0fac-407b-b6a2-8c52a18e2d84 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:33.251844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb8f7d-0fac-407b-b6a2-8c52a18e2d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:33.253372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb8f7d-0fac-407b-b6a2-8c52a18e2d84 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:33.262570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 186/365] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:33.262984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 180/366] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:33.263835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb8f7d-0fac-407b-b6a2-8c52a18e2d84 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:33.264386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db5844-4015-4d61-aeef-fb3d67655433 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:33.386028 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db5844-4015-4d61-aeef-fb3d67655433 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:33.399964 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb8f7d-0fac-407b-b6a2-8c52a18e2d84 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:33.410592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:33.424707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:33.430671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedf504-b711-4297-8381-c8340ba8ca45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:33.431688 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedf504-b711-4297-8381-c8340ba8ca45 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:33.432094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedf504-b711-4297-8381-c8340ba8ca45 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:33.432505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedf504-b711-4297-8381-c8340ba8ca45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:33.442987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77f937-147d-47ad-b8c2-0a5492e1a08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:33.443900 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77f937-147d-47ad-b8c2-0a5492e1a08e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:33.444288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77f937-147d-47ad-b8c2-0a5492e1a08e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:33.444664 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77f937-147d-47ad-b8c2-0a5492e1a08e None admin] PATH_INFO: `/v3/groups/d074030120884d3da3376ffa5354a80c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:33.445971 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77f937-147d-47ad-b8c2-0a5492e1a08e None admin] RBAC: Authorizing `identity:get_group(group_id=d074030120884d3da3376ffa5354a80c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:33.447635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedf504-b711-4297-8381-c8340ba8ca45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:33.447769 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77f937-147d-47ad-b8c2-0a5492e1a08e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:33.449734 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 181/367] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:33 2022] GET /identity/v3/groups/d074030120884d3da3376ffa5354a80c => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:33.450595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77f937-147d-47ad-b8c2-0a5492e1a08e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-3cedf504-b711-4297-8381-c8340ba8ca45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:33.456839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:33.457946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:33.458915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:33.458915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:33.458915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:33.458915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:33.458915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:33.458915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:33.458915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:33.458915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:33.458915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:33.458915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:33.458915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:33.458915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:33.466504 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 187/368] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:28:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:33.467952 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedf504-b711-4297-8381-c8340ba8ca45 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:33.568104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77f937-147d-47ad-b8c2-0a5492e1a08e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:33.583847 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedf504-b711-4297-8381-c8340ba8ca45 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:33.608530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942a99f-0e10-41d6-8ffb-f009ff3225b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:33.609186 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942a99f-0e10-41d6-8ffb-f009ff3225b3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:33.609526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942a99f-0e10-41d6-8ffb-f009ff3225b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:33.610416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942a99f-0e10-41d6-8ffb-f009ff3225b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:33.625772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782972fb-7e5f-4c55-a91e-ab79ad733bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:33.626697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782972fb-7e5f-4c55-a91e-ab79ad733bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:33.627036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782972fb-7e5f-4c55-a91e-ab79ad733bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:33.627363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782972fb-7e5f-4c55-a91e-ab79ad733bc1 None admin] PATH_INFO: `/v3/users/d96af93a0b0749b49d8de5365f95ed02` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:33.628580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782972fb-7e5f-4c55-a91e-ab79ad733bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=d96af93a0b0749b49d8de5365f95ed02)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:33.630014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782972fb-7e5f-4c55-a91e-ab79ad733bc1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:33.636580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 188/369] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:28:33 2022] GET /identity/v3/users/d96af93a0b0749b49d8de5365f95ed02 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:33.637414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782972fb-7e5f-4c55-a91e-ab79ad733bc1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:33.688940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942a99f-0e10-41d6-8ffb-f009ff3225b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:33.689702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:33.691083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942a99f-0e10-41d6-8ffb-f009ff3225b3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:33.694085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:33.751045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782972fb-7e5f-4c55-a91e-ab79ad733bc1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:33.787471 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73012d71-3cc8-412a-902e-2bfce306ec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:33.788142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73012d71-3cc8-412a-902e-2bfce306ec8c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:33.788426 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73012d71-3cc8-412a-902e-2bfce306ec8c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:33.788776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73012d71-3cc8-412a-902e-2bfce306ec8c None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:33.789531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73012d71-3cc8-412a-902e-2bfce306ec8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:33.789840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73012d71-3cc8-412a-902e-2bfce306ec8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:33.791278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73012d71-3cc8-412a-902e-2bfce306ec8c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:33.801625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 182/370] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:33.802488 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942a99f-0e10-41d6-8ffb-f009ff3225b3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:33.806290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 189/371] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:33.807217 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73012d71-3cc8-412a-902e-2bfce306ec8c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:33.914006 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942a99f-0e10-41d6-8ffb-f009ff3225b3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:33.918027 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73012d71-3cc8-412a-902e-2bfce306ec8c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:33.923566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:33.928166 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:33.955489 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a040e-a1b6-4b7d-8043-4eee2168c6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:33.955934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71641504-19f8-4238-bbfb-58d2c4d3a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:33.956603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71641504-19f8-4238-bbfb-58d2c4d3a140 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:33.956723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a040e-a1b6-4b7d-8043-4eee2168c6fd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:33.956887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71641504-19f8-4238-bbfb-58d2c4d3a140 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:33.957165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71641504-19f8-4238-bbfb-58d2c4d3a140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:33.957439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a040e-a1b6-4b7d-8043-4eee2168c6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:33.957855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a040e-a1b6-4b7d-8043-4eee2168c6fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:33.958006 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71641504-19f8-4238-bbfb-58d2c4d3a140 None admin] RBAC: Adding query filter params (group.id=d074030120884d3da3376ffa5354a80c, role.id=e9451c79645545d78e667c61eece4ec8, scope.project.id=e9135a691446476da5eef60527399dcc) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:33.958316 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71641504-19f8-4238-bbfb-58d2c4d3a140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:33.959113 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a040e-a1b6-4b7d-8043-4eee2168c6fd None admin] RBAC: Adding query filter params (role.id=45c107a1713445dcbcc66380d2666ae5, user.id=d96af93a0b0749b49d8de5365f95ed02, scope.system=all) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:33.959592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a040e-a1b6-4b7d-8043-4eee2168c6fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:33.959798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71641504-19f8-4238-bbfb-58d2c4d3a140 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:33.961354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a040e-a1b6-4b7d-8043-4eee2168c6fd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:33.967923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 183/372] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jul 6 20:28:33 2022] GET /identity/v3/role_assignments?group.id=d074030120884d3da3376ffa5354a80c&scope.project.id=e9135a691446476da5eef60527399dcc&role.id=e9451c79645545d78e667c61eece4ec8 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:33.967923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71641504-19f8-4238-bbfb-58d2c4d3a140 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:33.988966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 190/373] 10.222.0.33 () {56 vars in 1308 bytes} [Wed Jul 6 20:28:33 2022] GET /identity/v3/role_assignments?user.id=d96af93a0b0749b49d8de5365f95ed02&scope.system=all&role.id=45c107a1713445dcbcc66380d2666ae5 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:33.989673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a040e-a1b6-4b7d-8043-4eee2168c6fd None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:34.135146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71641504-19f8-4238-bbfb-58d2c4d3a140 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:34.179257 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cae43f-79fb-4fcd-971b-a4fdd29c93ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:34.180253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae43f-79fb-4fcd-971b-a4fdd29c93ee None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:34.180545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae43f-79fb-4fcd-971b-a4fdd29c93ee None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:34.180823 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae43f-79fb-4fcd-971b-a4fdd29c93ee None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:34.182265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cae43f-79fb-4fcd-971b-a4fdd29c93ee None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:34.183823 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cae43f-79fb-4fcd-971b-a4fdd29c93ee None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:34.185944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 184/374] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:33 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:34.192512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cae43f-79fb-4fcd-971b-a4fdd29c93ee None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:34.229560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a040e-a1b6-4b7d-8043-4eee2168c6fd None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:34.243566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:34.292922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b4f86-7876-465e-92ce-2e85711f4fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:34.293607 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b4f86-7876-465e-92ce-2e85711f4fdf None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:34.293906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b4f86-7876-465e-92ce-2e85711f4fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:34.294183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b4f86-7876-465e-92ce-2e85711f4fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:34.317187 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cae43f-79fb-4fcd-971b-a4fdd29c93ee None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:34.345121 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:34.365839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7293a1-73b7-4b78-9214-16bb593c945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:34.367159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7293a1-73b7-4b78-9214-16bb593c945c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:34.367603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7293a1-73b7-4b78-9214-16bb593c945c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:34.368039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7293a1-73b7-4b78-9214-16bb593c945c None admin] PATH_INFO: `/v3/groups/d074030120884d3da3376ffa5354a80c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:34.370671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7293a1-73b7-4b78-9214-16bb593c945c None admin] RBAC: Authorizing `identity:get_group(group_id=d074030120884d3da3376ffa5354a80c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:34.372394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7293a1-73b7-4b78-9214-16bb593c945c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:34.374653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 185/375] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:34 2022] GET /identity/v3/groups/d074030120884d3da3376ffa5354a80c => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:34.380139 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7293a1-73b7-4b78-9214-16bb593c945c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:34.404232 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b4f86-7876-465e-92ce-2e85711f4fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:34.405863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b4f86-7876-465e-92ce-2e85711f4fdf None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:34.495656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:34.511423 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7293a1-73b7-4b78-9214-16bb593c945c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:34.550119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 191/376] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:34.555348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b4f86-7876-465e-92ce-2e85711f4fdf None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:34.565647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e8d75-7448-4e10-9845-70260de974f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:34.566798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e8d75-7448-4e10-9845-70260de974f4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:34.567387 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e8d75-7448-4e10-9845-70260de974f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:34.567674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e8d75-7448-4e10-9845-70260de974f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:34.568522 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e8d75-7448-4e10-9845-70260de974f4 None admin] RBAC: Adding query filter params (group.id=d074030120884d3da3376ffa5354a80c, role.id=4f0522c790e94492976ef2674f85ad66, scope.project.id=e9135a691446476da5eef60527399dcc) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:34.568839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e8d75-7448-4e10-9845-70260de974f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:34.570301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e8d75-7448-4e10-9845-70260de974f4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:34.577026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 186/377] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jul 6 20:28:34 2022] GET /identity/v3/role_assignments?group.id=d074030120884d3da3376ffa5354a80c&scope.project.id=e9135a691446476da5eef60527399dcc&role.id=4f0522c790e94492976ef2674f85ad66 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:34.641318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:34.670942 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79af8f6-4b73-4696-b6bb-aaed0aa97026 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:34.671516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79af8f6-4b73-4696-b6bb-aaed0aa97026 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:34.672490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79af8f6-4b73-4696-b6bb-aaed0aa97026 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:34.674708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 187/378] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:34.680410 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a02f4-12c6-4175-b4fe-c980518db41e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:34.680690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a02f4-12c6-4175-b4fe-c980518db41e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:34.680969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a02f4-12c6-4175-b4fe-c980518db41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:34.691117 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b4f86-7876-465e-92ce-2e85711f4fdf None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:34.723836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ad8a02f4-12c6-4175-b4fe-c980518db41e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:34.725045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ad8a02f4-12c6-4175-b4fe-c980518db41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:34.739492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9d297-8338-43f9-a51d-a141b7db57b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:34.740477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d297-8338-43f9-a51d-a141b7db57b4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:34.740657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d297-8338-43f9-a51d-a141b7db57b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:34.740930 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d297-8338-43f9-a51d-a141b7db57b4 None admin] PATH_INFO: `/v3/projects/371b1675f3c34bee9789abbf8b4d7fc5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:34.748218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9d297-8338-43f9-a51d-a141b7db57b4 None admin] RBAC: Authorizing `identity:get_project(project_id=371b1675f3c34bee9789abbf8b4d7fc5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:34.749630 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9d297-8338-43f9-a51d-a141b7db57b4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:34.752462 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 192/379] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:34 2022] GET /identity/v3/projects/371b1675f3c34bee9789abbf8b4d7fc5 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:34.758257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9d297-8338-43f9-a51d-a141b7db57b4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:34.816659 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 188/380] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:34.840341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a02f4-12c6-4175-b4fe-c980518db41e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:34.938119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:34.966514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a02f4-12c6-4175-b4fe-c980518db41e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:34.992087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9d297-8338-43f9-a51d-a141b7db57b4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:35.016231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e47720-f8e9-4049-a917-536d49903fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:35.017025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e47720-f8e9-4049-a917-536d49903fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:35.017308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e47720-f8e9-4049-a917-536d49903fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:35.017585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e47720-f8e9-4049-a917-536d49903fe5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:35.032441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda6f66-69e3-4dfa-b25b-5f47de0d36ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:35.033320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda6f66-69e3-4dfa-b25b-5f47de0d36ff None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:35.033607 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda6f66-69e3-4dfa-b25b-5f47de0d36ff None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:35.033891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda6f66-69e3-4dfa-b25b-5f47de0d36ff None admin] PATH_INFO: `/v3/groups/43a0559a38ae487fb7134faf6b125618` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:35.039025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e47720-f8e9-4049-a917-536d49903fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:35.041792 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda6f66-69e3-4dfa-b25b-5f47de0d36ff None admin] RBAC: Authorizing `identity:get_group(group_id=43a0559a38ae487fb7134faf6b125618)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:35.043407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda6f66-69e3-4dfa-b25b-5f47de0d36ff None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:35.045109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 193/381] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:34 2022] GET /identity/v3/groups/43a0559a38ae487fb7134faf6b125618 => generated 229 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:35.047477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:35.051682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda6f66-69e3-4dfa-b25b-5f47de0d36ff None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-43e47720-f8e9-4049-a917-536d49903fe5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:35.053676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:35.054640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:35.055518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:35.055518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:35.055518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:35.055518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:35.055518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:35.055518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:35.055518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:35.055518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:35.055518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:35.055518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:35.055518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:35.055518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:35.055518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 189/382] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:35.063800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e47720-f8e9-4049-a917-536d49903fe5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:35.173484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda6f66-69e3-4dfa-b25b-5f47de0d36ff None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:35.210937 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e47720-f8e9-4049-a917-536d49903fe5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:35.221648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c38218-f1ea-4576-8e01-621413325da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:35.222374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c38218-f1ea-4576-8e01-621413325da4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:35.222779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c38218-f1ea-4576-8e01-621413325da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:35.223073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c38218-f1ea-4576-8e01-621413325da4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:35.223958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c38218-f1ea-4576-8e01-621413325da4 None admin] RBAC: Adding query filter params (group.id=43a0559a38ae487fb7134faf6b125618, role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=371b1675f3c34bee9789abbf8b4d7fc5) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:35.224277 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c38218-f1ea-4576-8e01-621413325da4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:35.225801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c38218-f1ea-4576-8e01-621413325da4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:35.239634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 194/383] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jul 6 20:28:35 2022] GET /identity/v3/role_assignments?group.id=43a0559a38ae487fb7134faf6b125618&scope.project.id=371b1675f3c34bee9789abbf8b4d7fc5&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:35.257180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ed3ce-0320-4494-9b6d-257634b16ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:35.257885 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ed3ce-0320-4494-9b6d-257634b16ead None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:35.258168 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ed3ce-0320-4494-9b6d-257634b16ead None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:35.258446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ed3ce-0320-4494-9b6d-257634b16ead None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:35.263349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ed3ce-0320-4494-9b6d-257634b16ead None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:35.264467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ed3ce-0320-4494-9b6d-257634b16ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:35.265282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ed3ce-0320-4494-9b6d-257634b16ead None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:35.272257 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:35.284356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 190/384] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:35.289705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c38218-f1ea-4576-8e01-621413325da4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:35.389177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:35.444825 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c38218-f1ea-4576-8e01-621413325da4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:35.462303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1fdc9-2112-4abe-9ab0-36a4354ed353 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:35.462660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1fdc9-2112-4abe-9ab0-36a4354ed353 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:35.462857 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1fdc9-2112-4abe-9ab0-36a4354ed353 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:35.464286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 191/385] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:35.472606 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c88e-d556-4c0b-8c75-4fe5b102fe17 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:35.472910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c88e-d556-4c0b-8c75-4fe5b102fe17 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:35.473169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c88e-d556-4c0b-8c75-4fe5b102fe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:35.488821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d09c43-8997-4868-a91c-8885bb405bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:35.490264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d09c43-8997-4868-a91c-8885bb405bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:35.490571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d09c43-8997-4868-a91c-8885bb405bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:35.490855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d09c43-8997-4868-a91c-8885bb405bf0 None admin] PATH_INFO: `/v3/groups/d074030120884d3da3376ffa5354a80c` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:35.494449 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d09c43-8997-4868-a91c-8885bb405bf0 None admin] RBAC: Authorizing `identity:get_group(group_id=d074030120884d3da3376ffa5354a80c)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:35.495955 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d09c43-8997-4868-a91c-8885bb405bf0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:35.498000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 195/386] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:35 2022] GET /identity/v3/groups/d074030120884d3da3376ffa5354a80c => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:35.498111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6ad7c88e-d556-4c0b-8c75-4fe5b102fe17 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:35.499336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6ad7c88e-d556-4c0b-8c75-4fe5b102fe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:35.508184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d09c43-8997-4868-a91c-8885bb405bf0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:35.610123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 192/387] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:35.622368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d09c43-8997-4868-a91c-8885bb405bf0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:35.648444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7c88e-d556-4c0b-8c75-4fe5b102fe17 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:35.659086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:35.666856 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe271a-c86c-4f2d-9ee1-ed32e863bbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:35.667837 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe271a-c86c-4f2d-9ee1-ed32e863bbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:35.668182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe271a-c86c-4f2d-9ee1-ed32e863bbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:35.668473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe271a-c86c-4f2d-9ee1-ed32e863bbd2 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:35.669725 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe271a-c86c-4f2d-9ee1-ed32e863bbd2 None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:35.671272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe271a-c86c-4f2d-9ee1-ed32e863bbd2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:35.674631 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 196/388] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:35 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:35.680233 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe271a-c86c-4f2d-9ee1-ed32e863bbd2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:35.797571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe271a-c86c-4f2d-9ee1-ed32e863bbd2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:35.838257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086e9c3-50d7-48d0-8dbc-f82be5800686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:35.839070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086e9c3-50d7-48d0-8dbc-f82be5800686 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:35.839391 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086e9c3-50d7-48d0-8dbc-f82be5800686 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:35.839675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086e9c3-50d7-48d0-8dbc-f82be5800686 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b/groups/d074030120884d3da3376ffa5354a80c/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:35.841654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086e9c3-50d7-48d0-8dbc-f82be5800686 None admin] RBAC: Authorizing `identity:create_grant(project_id=d676d249fb5d4c0fa1addc459fc2e34b, group_id=d074030120884d3da3376ffa5354a80c, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:35.843109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086e9c3-50d7-48d0-8dbc-f82be5800686 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:35.862118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 197/389] 10.222.0.33 () {58 vars in 1442 bytes} [Wed Jul 6 20:28:35 2022] PUT /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b/groups/d074030120884d3da3376ffa5354a80c/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:28:35.924417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7c88e-d556-4c0b-8c75-4fe5b102fe17 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:35.966972 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:35.983952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe1252-7578-491b-af26-cb88fa3be6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:35.984897 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1252-7578-491b-af26-cb88fa3be6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:35.985187 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1252-7578-491b-af26-cb88fa3be6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:35.985464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1252-7578-491b-af26-cb88fa3be6c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:36.012237 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe1252-7578-491b-af26-cb88fa3be6c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5ebe1252-7578-491b-af26-cb88fa3be6c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:36.029544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:36.030490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:36.031536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:36.031536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:36.031536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:36.031536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:36.031536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:36.031536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:36.031536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:36.031536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:36.031536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:36.031536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:36.031536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:36.031536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:36.031536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 193/390] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:28:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:36.037287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086e9c3-50d7-48d0-8dbc-f82be5800686 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:36.124587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:36.180248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086e9c3-50d7-48d0-8dbc-f82be5800686 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:36.222936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094beb7-0764-4265-a2e7-6f4a3811d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:36.223719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094beb7-0764-4265-a2e7-6f4a3811d188 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:36.224008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094beb7-0764-4265-a2e7-6f4a3811d188 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:36.224340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094beb7-0764-4265-a2e7-6f4a3811d188 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:36.225109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094beb7-0764-4265-a2e7-6f4a3811d188 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:36.225426 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094beb7-0764-4265-a2e7-6f4a3811d188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:36.226823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094beb7-0764-4265-a2e7-6f4a3811d188 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:36.236975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 198/391] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:36.242064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe1252-7578-491b-af26-cb88fa3be6c7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:36.397551 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe1252-7578-491b-af26-cb88fa3be6c7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:36.444341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1cccc-8f2b-4e8b-83ab-495e21d57d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:36.445198 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1cccc-8f2b-4e8b-83ab-495e21d57d94 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:36.445481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1cccc-8f2b-4e8b-83ab-495e21d57d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:36.445754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1cccc-8f2b-4e8b-83ab-495e21d57d94 None admin] PATH_INFO: `/v3/groups/d074030120884d3da3376ffa5354a80c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:36.451878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1cccc-8f2b-4e8b-83ab-495e21d57d94 None admin] RBAC: Authorizing `identity:get_group(group_id=d074030120884d3da3376ffa5354a80c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:36.453751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1cccc-8f2b-4e8b-83ab-495e21d57d94 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:36.455561 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 194/392] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:36 2022] GET /identity/v3/groups/d074030120884d3da3376ffa5354a80c => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:36.461039 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094beb7-0764-4265-a2e7-6f4a3811d188 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:36.611772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094beb7-0764-4265-a2e7-6f4a3811d188 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:36.639096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:36.657547 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c72f0-1675-4fa3-b1ec-13175daf85aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:36.657852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c72f0-1675-4fa3-b1ec-13175daf85aa None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:36.658045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c72f0-1675-4fa3-b1ec-13175daf85aa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:36.658328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c72f0-1675-4fa3-b1ec-13175daf85aa None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:36.659589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c72f0-1675-4fa3-b1ec-13175daf85aa None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:36.661044 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c72f0-1675-4fa3-b1ec-13175daf85aa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:36.663044 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 199/393] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:36 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:36.668759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1cccc-8f2b-4e8b-83ab-495e21d57d94 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:36.738071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:36.789737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1cccc-8f2b-4e8b-83ab-495e21d57d94 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:36.833357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c56cb9-c329-42c0-9b44-21d904c7cc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:36.834254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c56cb9-c329-42c0-9b44-21d904c7cc2c None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:36.834538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c56cb9-c329-42c0-9b44-21d904c7cc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:36.834814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c56cb9-c329-42c0-9b44-21d904c7cc2c None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b/groups/d074030120884d3da3376ffa5354a80c/roles/4f0522c790e94492976ef2674f85ad66` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:36.839201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c56cb9-c329-42c0-9b44-21d904c7cc2c None admin] RBAC: Authorizing `identity:create_grant(project_id=d676d249fb5d4c0fa1addc459fc2e34b, group_id=d074030120884d3da3376ffa5354a80c, role_id=4f0522c790e94492976ef2674f85ad66)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:36.840661 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c56cb9-c329-42c0-9b44-21d904c7cc2c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:36.868305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 195/394] 10.222.0.33 () {58 vars in 1442 bytes} [Wed Jul 6 20:28:36 2022] PUT /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b/groups/d074030120884d3da3376ffa5354a80c/roles/4f0522c790e94492976ef2674f85ad66 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:28:36.953877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1214e4c-3d53-4225-8b2e-84d9918387f1 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:36.954060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1214e4c-3d53-4225-8b2e-84d9918387f1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:36.954352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1214e4c-3d53-4225-8b2e-84d9918387f1 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:36.956250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 200/395] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:36.964880 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696278e2-c921-453f-82cd-f0635139d2fe None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:36.965206 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696278e2-c921-453f-82cd-f0635139d2fe None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:36.965492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696278e2-c921-453f-82cd-f0635139d2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:36.988524 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-696278e2-c921-453f-82cd-f0635139d2fe None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:36.989841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-696278e2-c921-453f-82cd-f0635139d2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:37.074956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 196/396] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:37.107361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1214e4c-3d53-4225-8b2e-84d9918387f1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:37.222669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1214e4c-3d53-4225-8b2e-84d9918387f1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:37.260456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad5f4a-6e74-4190-9aec-e512b07ba91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:37.261257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad5f4a-6e74-4190-9aec-e512b07ba91b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:37.261536 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad5f4a-6e74-4190-9aec-e512b07ba91b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:37.261805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad5f4a-6e74-4190-9aec-e512b07ba91b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:37.278494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad5f4a-6e74-4190-9aec-e512b07ba91b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-fcad5f4a-6e74-4190-9aec-e512b07ba91b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:37.290230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:37.291141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:37.293464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:37.293464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:37.293464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:37.293464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:37.293464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:37.293464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:37.293464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:37.293464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:37.293464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:37.293464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:37.293464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:37.293464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:37.293464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 201/397] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:37.297465 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696278e2-c921-453f-82cd-f0635139d2fe None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:37.373874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:37.426218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd19702-d4ce-4e9a-92ac-9b4c59f7fdfe None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:37.426523 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd19702-d4ce-4e9a-92ac-9b4c59f7fdfe None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:37.426779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd19702-d4ce-4e9a-92ac-9b4c59f7fdfe None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:37.428254 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 202/398] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:28:37.433949 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3b2e4-628e-4b16-824a-b9e279bb8115 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:37.434235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3b2e4-628e-4b16-824a-b9e279bb8115 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:37.434510 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3b2e4-628e-4b16-824a-b9e279bb8115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:37.450230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696278e2-c921-453f-82cd-f0635139d2fe None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:37.458395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-54b3b2e4-628e-4b16-824a-b9e279bb8115 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:37.459748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-54b3b2e4-628e-4b16-824a-b9e279bb8115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:37.518340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b618f-2af0-4437-a624-7c72ff9522bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:37.518947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b618f-2af0-4437-a624-7c72ff9522bf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:37.519415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b618f-2af0-4437-a624-7c72ff9522bf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:37.519953 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b618f-2af0-4437-a624-7c72ff9522bf None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:37.520713 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b618f-2af0-4437-a624-7c72ff9522bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:37.521023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b618f-2af0-4437-a624-7c72ff9522bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:37.522416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b618f-2af0-4437-a624-7c72ff9522bf None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:37.543691 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 197/399] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:37.547794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:37.552231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b618f-2af0-4437-a624-7c72ff9522bf None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:37.610622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 203/400] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:37.649393 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3b2e4-628e-4b16-824a-b9e279bb8115 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:37.725538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b618f-2af0-4437-a624-7c72ff9522bf None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:37.737356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:37.785803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43022dc4-0ebd-45b8-b394-e6ab1944ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:37.786591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43022dc4-0ebd-45b8-b394-e6ab1944ae3f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:37.786879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43022dc4-0ebd-45b8-b394-e6ab1944ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:37.787155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43022dc4-0ebd-45b8-b394-e6ab1944ae3f None admin] PATH_INFO: `/v3/groups/d074030120884d3da3376ffa5354a80c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:37.788626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43022dc4-0ebd-45b8-b394-e6ab1944ae3f None admin] RBAC: Authorizing `identity:get_group(group_id=d074030120884d3da3376ffa5354a80c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:37.790105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43022dc4-0ebd-45b8-b394-e6ab1944ae3f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:37.793905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 198/401] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:37 2022] GET /identity/v3/groups/d074030120884d3da3376ffa5354a80c => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:37.801993 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43022dc4-0ebd-45b8-b394-e6ab1944ae3f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:37.820537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3b2e4-628e-4b16-824a-b9e279bb8115 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:37.882018 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65814b9a-cf3a-479a-a401-5b5955764b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:37.882849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65814b9a-cf3a-479a-a401-5b5955764b6c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:37.883133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65814b9a-cf3a-479a-a401-5b5955764b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:37.883432 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65814b9a-cf3a-479a-a401-5b5955764b6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:37.908501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65814b9a-cf3a-479a-a401-5b5955764b6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-65814b9a-cf3a-479a-a401-5b5955764b6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:37.920809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:37.921769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:37.923219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:37.923219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:37.923219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:37.923219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:37.923219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:37.923219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:37.923219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:37.923219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:37.923219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:37.923219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:37.923219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:37.923219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:37.926924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 204/402] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:28:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:37.927988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65814b9a-cf3a-479a-a401-5b5955764b6c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:37.936965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43022dc4-0ebd-45b8-b394-e6ab1944ae3f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:37.972827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d9426-9552-4ff6-a6cd-9e456175f780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:37.973921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9426-9552-4ff6-a6cd-9e456175f780 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:37.974344 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9426-9552-4ff6-a6cd-9e456175f780 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:37.974789 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9426-9552-4ff6-a6cd-9e456175f780 None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:37.976156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d9426-9552-4ff6-a6cd-9e456175f780 None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:37.977759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d9426-9552-4ff6-a6cd-9e456175f780 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:37.979958 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 199/403] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:37 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:37.987524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:37.991945 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d9426-9552-4ff6-a6cd-9e456175f780 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:38.070503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:38.091676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65814b9a-cf3a-479a-a401-5b5955764b6c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:38.131149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d9426-9552-4ff6-a6cd-9e456175f780 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:38.135531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495af98-b04a-42b1-8fb3-83acb4ab7263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:38.136205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495af98-b04a-42b1-8fb3-83acb4ab7263 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:38.136491 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495af98-b04a-42b1-8fb3-83acb4ab7263 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:38.136770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495af98-b04a-42b1-8fb3-83acb4ab7263 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:38.137523 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495af98-b04a-42b1-8fb3-83acb4ab7263 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:38.137833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495af98-b04a-42b1-8fb3-83acb4ab7263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:38.139256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495af98-b04a-42b1-8fb3-83acb4ab7263 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:38.154529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 205/404] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:38.154529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635333f-280a-429f-a43d-41e455fefa79 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:38.154529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635333f-280a-429f-a43d-41e455fefa79 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:38.154529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635333f-280a-429f-a43d-41e455fefa79 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:38.154529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 206/405] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:38.155516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635333f-280a-429f-a43d-41e455fefa79 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:38.177827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f588552-6a9b-4e03-93a2-bdb41097aa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:38.178719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f588552-6a9b-4e03-93a2-bdb41097aa52 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:38.179006 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f588552-6a9b-4e03-93a2-bdb41097aa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:38.179321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f588552-6a9b-4e03-93a2-bdb41097aa52 None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc/groups/d074030120884d3da3376ffa5354a80c/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:38.181507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f588552-6a9b-4e03-93a2-bdb41097aa52 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9135a691446476da5eef60527399dcc, group_id=d074030120884d3da3376ffa5354a80c, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:38.182962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f588552-6a9b-4e03-93a2-bdb41097aa52 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:38.203234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 200/406] 10.222.0.33 () {58 vars in 1442 bytes} [Wed Jul 6 20:28:37 2022] PUT /identity/v3/projects/e9135a691446476da5eef60527399dcc/groups/d074030120884d3da3376ffa5354a80c/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:28:38.203234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a644b3-ccd2-47b8-82ad-021f4e4dd803 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:38.203234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a644b3-ccd2-47b8-82ad-021f4e4dd803 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:38.203234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a644b3-ccd2-47b8-82ad-021f4e4dd803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:38.220994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-68a644b3-ccd2-47b8-82ad-021f4e4dd803 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:38.224343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-68a644b3-ccd2-47b8-82ad-021f4e4dd803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:38.347754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:38.349540 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635333f-280a-429f-a43d-41e455fefa79 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:38.379309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 201/407] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:38.400417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263255d-b4b8-41c5-a91c-4c73f7f21cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:38.401715 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263255d-b4b8-41c5-a91c-4c73f7f21cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:38.402193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263255d-b4b8-41c5-a91c-4c73f7f21cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:38.402673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263255d-b4b8-41c5-a91c-4c73f7f21cd0 None admin] PATH_INFO: `/v3/groups/d074030120884d3da3376ffa5354a80c` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:38.404172 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263255d-b4b8-41c5-a91c-4c73f7f21cd0 None admin] RBAC: Authorizing `identity:get_group(group_id=d074030120884d3da3376ffa5354a80c)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:38.405832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263255d-b4b8-41c5-a91c-4c73f7f21cd0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:38.408149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 207/408] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:38 2022] GET /identity/v3/groups/d074030120884d3da3376ffa5354a80c => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:38.411703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a644b3-ccd2-47b8-82ad-021f4e4dd803 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:38.427109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263255d-b4b8-41c5-a91c-4c73f7f21cd0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:38.455615 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:38.546410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263255d-b4b8-41c5-a91c-4c73f7f21cd0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:38.554999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a644b3-ccd2-47b8-82ad-021f4e4dd803 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:38.589619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258d502-4cc8-42ab-a024-29d68aded086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:38.591005 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d502-4cc8-42ab-a024-29d68aded086 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:38.591542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d502-4cc8-42ab-a024-29d68aded086 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:38.592036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d502-4cc8-42ab-a024-29d68aded086 None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:38.595263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258d502-4cc8-42ab-a024-29d68aded086 None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:38.597067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258d502-4cc8-42ab-a024-29d68aded086 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:38.599464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 208/409] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:38 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:38.605225 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258d502-4cc8-42ab-a024-29d68aded086 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:38.616400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ebced-cb2a-4e19-8e4e-8a2040c58205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:38.617208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ebced-cb2a-4e19-8e4e-8a2040c58205 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:38.617498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ebced-cb2a-4e19-8e4e-8a2040c58205 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:38.617774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ebced-cb2a-4e19-8e4e-8a2040c58205 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:38.639360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ebced-cb2a-4e19-8e4e-8a2040c58205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-860ebced-cb2a-4e19-8e4e-8a2040c58205 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:38.652775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:38.653728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:38.654547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:38.654547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:38.654547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:38.654547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:38.654547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:38.654547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:38.654547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:38.654547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:38.654547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:38.654547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:38.654547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:38.654547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:38.654547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 202/410] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:38.659612 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b85ac-0a13-465c-aa5d-a943aa9d87cd None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:38.659917 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b85ac-0a13-465c-aa5d-a943aa9d87cd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:38.660180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b85ac-0a13-465c-aa5d-a943aa9d87cd None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:38.661803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 203/411] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:38.663498 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:38.667870 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b85ac-0a13-465c-aa5d-a943aa9d87cd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:38.739318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258d502-4cc8-42ab-a024-29d68aded086 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:38.784346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6dc444-0edc-4bf3-a7df-87c20feb7df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:38.785259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dc444-0edc-4bf3-a7df-87c20feb7df0 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:38.785539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dc444-0edc-4bf3-a7df-87c20feb7df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:38.785867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dc444-0edc-4bf3-a7df-87c20feb7df0 None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc/groups/d074030120884d3da3376ffa5354a80c/roles/4f0522c790e94492976ef2674f85ad66` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:38.788309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6dc444-0edc-4bf3-a7df-87c20feb7df0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9135a691446476da5eef60527399dcc, group_id=d074030120884d3da3376ffa5354a80c, role_id=4f0522c790e94492976ef2674f85ad66)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:38.789885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6dc444-0edc-4bf3-a7df-87c20feb7df0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:38.794171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:38.803713 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b85ac-0a13-465c-aa5d-a943aa9d87cd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:38.816765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 209/412] 10.222.0.33 () {58 vars in 1442 bytes} [Wed Jul 6 20:28:38 2022] PUT /identity/v3/projects/e9135a691446476da5eef60527399dcc/groups/d074030120884d3da3376ffa5354a80c/roles/4f0522c790e94492976ef2674f85ad66 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:28:38.816765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79891044-988e-451f-b755-c59de58b00a7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:38.816765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79891044-988e-451f-b755-c59de58b00a7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:38.816765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79891044-988e-451f-b755-c59de58b00a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:38.837936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-79891044-988e-451f-b755-c59de58b00a7 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:38.839141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-79891044-988e-451f-b755-c59de58b00a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:38.872684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9349d58-41b1-4d03-a674-124a2655deed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:38.873975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349d58-41b1-4d03-a674-124a2655deed None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:38.874472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349d58-41b1-4d03-a674-124a2655deed None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:38.875541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349d58-41b1-4d03-a674-124a2655deed None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:38.876501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9349d58-41b1-4d03-a674-124a2655deed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:38.877127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9349d58-41b1-4d03-a674-124a2655deed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:38.878890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9349d58-41b1-4d03-a674-124a2655deed None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:38.905691 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 204/413] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:38.921040 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9349d58-41b1-4d03-a674-124a2655deed None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:38.969367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 210/414] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:39.023591 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79891044-988e-451f-b755-c59de58b00a7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:39.053980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:39.070549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9349d58-41b1-4d03-a674-124a2655deed None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:39.111303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c155f-5bf4-4d08-9a43-428f66a8eda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:39.112645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c155f-5bf4-4d08-9a43-428f66a8eda9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:39.113134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c155f-5bf4-4d08-9a43-428f66a8eda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:39.113632 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c155f-5bf4-4d08-9a43-428f66a8eda9 None admin] PATH_INFO: `/v3/groups/43a0559a38ae487fb7134faf6b125618` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:39.115140 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c155f-5bf4-4d08-9a43-428f66a8eda9 None admin] RBAC: Authorizing `identity:get_group(group_id=43a0559a38ae487fb7134faf6b125618)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:39.116925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c155f-5bf4-4d08-9a43-428f66a8eda9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:39.119308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 205/415] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:38 2022] GET /identity/v3/groups/43a0559a38ae487fb7134faf6b125618 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:39.124528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c155f-5bf4-4d08-9a43-428f66a8eda9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:39.136989 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79891044-988e-451f-b755-c59de58b00a7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:39.155625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:39.176814 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb58dc-0766-42ac-aeea-9f28dd16c0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:39.177613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb58dc-0766-42ac-aeea-9f28dd16c0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:39.177895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb58dc-0766-42ac-aeea-9f28dd16c0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:39.178168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb58dc-0766-42ac-aeea-9f28dd16c0f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:39.189915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb58dc-0766-42ac-aeea-9f28dd16c0f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-d1eb58dc-0766-42ac-aeea-9f28dd16c0f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:39.198436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:39.199399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:39.200209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:39.200209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:39.200209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:39.200209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:39.200209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:39.200209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:39.200209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:39.200209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:39.200209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:39.200209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:39.200209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:39.200209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:39.200209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 211/416] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:39.206850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb58dc-0766-42ac-aeea-9f28dd16c0f5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:39.242613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c155f-5bf4-4d08-9a43-428f66a8eda9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:39.281818 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b563d-0335-4a95-9330-d9fb2e6bc184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:39.283083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b563d-0335-4a95-9330-d9fb2e6bc184 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:39.283848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b563d-0335-4a95-9330-d9fb2e6bc184 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:39.284461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b563d-0335-4a95-9330-d9fb2e6bc184 None admin] PATH_INFO: `/v3/projects/371b1675f3c34bee9789abbf8b4d7fc5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:39.286052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b563d-0335-4a95-9330-d9fb2e6bc184 None admin] RBAC: Authorizing `identity:get_project(project_id=371b1675f3c34bee9789abbf8b4d7fc5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:39.287748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b563d-0335-4a95-9330-d9fb2e6bc184 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:39.290459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 206/417] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:39 2022] GET /identity/v3/projects/371b1675f3c34bee9789abbf8b4d7fc5 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:39.297826 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b563d-0335-4a95-9330-d9fb2e6bc184 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:39.300859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:39.317807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb58dc-0766-42ac-aeea-9f28dd16c0f5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:39.354771 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa413b-ec8b-4d5f-bd2a-cbc60cf3b535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:39.355419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa413b-ec8b-4d5f-bd2a-cbc60cf3b535 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:39.355712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa413b-ec8b-4d5f-bd2a-cbc60cf3b535 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:39.355992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa413b-ec8b-4d5f-bd2a-cbc60cf3b535 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:39.356735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa413b-ec8b-4d5f-bd2a-cbc60cf3b535 None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:39.357049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa413b-ec8b-4d5f-bd2a-cbc60cf3b535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:39.358418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa413b-ec8b-4d5f-bd2a-cbc60cf3b535 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:39.367929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 212/418] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:39.373329 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa413b-ec8b-4d5f-bd2a-cbc60cf3b535 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:39.404946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:39.413177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b563d-0335-4a95-9330-d9fb2e6bc184 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:39.456782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21074a-14d2-494a-a745-667e1f9daee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:39.458524 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21074a-14d2-494a-a745-667e1f9daee9 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:39.459028 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21074a-14d2-494a-a745-667e1f9daee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:39.459526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21074a-14d2-494a-a745-667e1f9daee9 None admin] PATH_INFO: `/v3/projects/371b1675f3c34bee9789abbf8b4d7fc5/groups/43a0559a38ae487fb7134faf6b125618/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:39.461813 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21074a-14d2-494a-a745-667e1f9daee9 None admin] RBAC: Authorizing `identity:create_grant(project_id=371b1675f3c34bee9789abbf8b4d7fc5, group_id=43a0559a38ae487fb7134faf6b125618, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:39.463680 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21074a-14d2-494a-a745-667e1f9daee9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:39.499247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 207/419] 10.222.0.33 () {58 vars in 1442 bytes} [Wed Jul 6 20:28:39 2022] PUT /identity/v3/projects/371b1675f3c34bee9789abbf8b4d7fc5/groups/43a0559a38ae487fb7134faf6b125618/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:28:39.512318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa413b-ec8b-4d5f-bd2a-cbc60cf3b535 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:39.555550 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50384ae6-ca4c-4d23-9b55-213840a984d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:39.556769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384ae6-ca4c-4d23-9b55-213840a984d2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:39.557262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384ae6-ca4c-4d23-9b55-213840a984d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:39.557742 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384ae6-ca4c-4d23-9b55-213840a984d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:39.581625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:39.641764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50384ae6-ca4c-4d23-9b55-213840a984d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:39.643268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50384ae6-ca4c-4d23-9b55-213840a984d2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:39.677354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65e557-0abf-4f76-bb18-1f49d8ac5a95 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:39.677646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65e557-0abf-4f76-bb18-1f49d8ac5a95 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:39.677837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65e557-0abf-4f76-bb18-1f49d8ac5a95 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:39.683297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 208/420] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:28:39.685242 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21e463-48e4-4355-a299-99f55045bed9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:39.685529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21e463-48e4-4355-a299-99f55045bed9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:39.685812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21e463-48e4-4355-a299-99f55045bed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:39.728341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3d21e463-48e4-4355-a299-99f55045bed9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:39.729569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3d21e463-48e4-4355-a299-99f55045bed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:39.764743 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 213/421] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:28:39.770918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50384ae6-ca4c-4d23-9b55-213840a984d2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:39.829294 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 209/422] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:39.843600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:39.857832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21e463-48e4-4355-a299-99f55045bed9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:39.909534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50384ae6-ca4c-4d23-9b55-213840a984d2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:39.975351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c91cc9-a14f-4064-acc2-7bf0aaed69eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:39.976136 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c91cc9-a14f-4064-acc2-7bf0aaed69eb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:39.976414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c91cc9-a14f-4064-acc2-7bf0aaed69eb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:39.976687 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c91cc9-a14f-4064-acc2-7bf0aaed69eb None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:39.979197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c91cc9-a14f-4064-acc2-7bf0aaed69eb None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:39.980663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c91cc9-a14f-4064-acc2-7bf0aaed69eb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:39.982537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 214/423] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:39 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:39.989058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c91cc9-a14f-4064-acc2-7bf0aaed69eb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:39.995514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:40.026518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21e463-48e4-4355-a299-99f55045bed9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:40.103850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6d116-8073-470b-adf5-600578e2d2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:40.104665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6d116-8073-470b-adf5-600578e2d2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:40.104945 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6d116-8073-470b-adf5-600578e2d2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:40.105217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6d116-8073-470b-adf5-600578e2d2e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:40.127089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6d116-8073-470b-adf5-600578e2d2e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-64a6d116-8073-470b-adf5-600578e2d2e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:40.142151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:40.143022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:40.143839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:40.143839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:40.143839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:40.143839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:40.143839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:40.143839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:40.143839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:40.143839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:40.143839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:40.143839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:40.143839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:40.143839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:40.144830 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 210/424] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:28:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:40.147533 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c91cc9-a14f-4064-acc2-7bf0aaed69eb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:40.149987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6d116-8073-470b-adf5-600578e2d2e3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:40.200258 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:40.213699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b3fa9-9ff9-4225-8b8b-f8fb76be1076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:40.215069 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b3fa9-9ff9-4225-8b8b-f8fb76be1076 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:40.215069 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b3fa9-9ff9-4225-8b8b-f8fb76be1076 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:40.215351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b3fa9-9ff9-4225-8b8b-f8fb76be1076 None admin] PATH_INFO: `/v3/groups/d074030120884d3da3376ffa5354a80c` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:40.217656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b3fa9-9ff9-4225-8b8b-f8fb76be1076 None admin] RBAC: Authorizing `identity:get_group(group_id=d074030120884d3da3376ffa5354a80c)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:40.220926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b3fa9-9ff9-4225-8b8b-f8fb76be1076 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:40.224628 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 215/425] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:39 2022] GET /identity/v3/groups/d074030120884d3da3376ffa5354a80c => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:40.233097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b3fa9-9ff9-4225-8b8b-f8fb76be1076 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:40.329791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6d116-8073-470b-adf5-600578e2d2e3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:40.351077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b3fa9-9ff9-4225-8b8b-f8fb76be1076 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:40.392659 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab819f4-0c82-4504-92de-3fe7820a05bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:40.393311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab819f4-0c82-4504-92de-3fe7820a05bf None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:40.393588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab819f4-0c82-4504-92de-3fe7820a05bf None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:40.394776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab819f4-0c82-4504-92de-3fe7820a05bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:40.395848 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab819f4-0c82-4504-92de-3fe7820a05bf None admin] RBAC: Adding query filter params (group.id=d074030120884d3da3376ffa5354a80c, role.id=e9451c79645545d78e667c61eece4ec8, scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:40.396160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab819f4-0c82-4504-92de-3fe7820a05bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:40.397591 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab819f4-0c82-4504-92de-3fe7820a05bf None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:40.409356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c22c89-a03b-42d6-a693-b190e286f90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:40.410031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c22c89-a03b-42d6-a693-b190e286f90b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:40.410314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c22c89-a03b-42d6-a693-b190e286f90b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:40.410593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c22c89-a03b-42d6-a693-b190e286f90b None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:40.411363 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c22c89-a03b-42d6-a693-b190e286f90b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:40.411671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c22c89-a03b-42d6-a693-b190e286f90b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:40.413049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c22c89-a03b-42d6-a693-b190e286f90b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:40.416221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 216/426] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jul 6 20:28:40 2022] GET /identity/v3/role_assignments?group.id=d074030120884d3da3376ffa5354a80c&scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b&role.id=e9451c79645545d78e667c61eece4ec8 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:40.430511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 211/427] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:40.435997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab819f4-0c82-4504-92de-3fe7820a05bf None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:40.495910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:40.552780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab819f4-0c82-4504-92de-3fe7820a05bf None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:40.598781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128af289-0dba-407a-a134-c4639e9d00fb None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:40.599368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128af289-0dba-407a-a134-c4639e9d00fb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:40.599368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128af289-0dba-407a-a134-c4639e9d00fb None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:40.599498 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa0c81-3370-400d-87b2-d55fc079a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:40.600055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa0c81-3370-400d-87b2-d55fc079a699 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:40.600340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa0c81-3370-400d-87b2-d55fc079a699 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:40.600613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa0c81-3370-400d-87b2-d55fc079a699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:40.601061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 212/428] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:28:40.606450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13314dd3-3ce4-4932-a52c-5b5d532fb8d0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:40.606738 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13314dd3-3ce4-4932-a52c-5b5d532fb8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:40.607019 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13314dd3-3ce4-4932-a52c-5b5d532fb8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:40.623547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:40.626854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-13314dd3-3ce4-4932-a52c-5b5d532fb8d0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:40.628635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-13314dd3-3ce4-4932-a52c-5b5d532fb8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:40.719423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa0c81-3370-400d-87b2-d55fc079a699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:40.719927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 213/429] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:40.721026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa0c81-3370-400d-87b2-d55fc079a699 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:40.751913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13314dd3-3ce4-4932-a52c-5b5d532fb8d0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:40.804407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:40.864329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13314dd3-3ce4-4932-a52c-5b5d532fb8d0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:40.869803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 217/430] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:40.876239 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa0c81-3370-400d-87b2-d55fc079a699 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:40.912451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722aeae-ee33-4046-906d-7003a109b722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:40.913750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722aeae-ee33-4046-906d-7003a109b722 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:40.914227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722aeae-ee33-4046-906d-7003a109b722 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:40.914691 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722aeae-ee33-4046-906d-7003a109b722 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:40.918009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:40.927727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722aeae-ee33-4046-906d-7003a109b722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9722aeae-ee33-4046-906d-7003a109b722 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:40.936892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:40.937798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:40.938672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:40.938672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:40.938672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:40.938672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:40.938672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:40.938672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:40.938672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:40.938672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:40.938672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:40.938672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:40.938672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 20:28:40.938672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:40.946089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 214/431] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:40.947660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722aeae-ee33-4046-906d-7003a109b722 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:41.002444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa0c81-3370-400d-87b2-d55fc079a699 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:41.053660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847029ce-e952-4495-938e-f77ef9bc4c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:41.054532 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847029ce-e952-4495-938e-f77ef9bc4c62 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:41.054815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847029ce-e952-4495-938e-f77ef9bc4c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:41.055087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847029ce-e952-4495-938e-f77ef9bc4c62 None admin] PATH_INFO: `/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:41.057246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847029ce-e952-4495-938e-f77ef9bc4c62 None admin] RBAC: Authorizing `identity:get_project(project_id=d676d249fb5d4c0fa1addc459fc2e34b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:41.058701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847029ce-e952-4495-938e-f77ef9bc4c62 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:41.060781 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 218/432] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:40 2022] GET /identity/v3/projects/d676d249fb5d4c0fa1addc459fc2e34b => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:41.066533 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847029ce-e952-4495-938e-f77ef9bc4c62 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:41.099156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722aeae-ee33-4046-906d-7003a109b722 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:41.102943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:41.137460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79273ed2-fe53-4ae1-8056-4c1ba10898d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:41.138142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79273ed2-fe53-4ae1-8056-4c1ba10898d3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:41.138428 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79273ed2-fe53-4ae1-8056-4c1ba10898d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:41.138706 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79273ed2-fe53-4ae1-8056-4c1ba10898d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:41.139491 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79273ed2-fe53-4ae1-8056-4c1ba10898d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:41.139805 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79273ed2-fe53-4ae1-8056-4c1ba10898d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:41.141458 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79273ed2-fe53-4ae1-8056-4c1ba10898d3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:41.161868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 215/433] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:28:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:41.162953 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79273ed2-fe53-4ae1-8056-4c1ba10898d3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:41.216387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847029ce-e952-4495-938e-f77ef9bc4c62 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:41.236097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:41.257563 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb0571-32ac-4bcb-9e29-99169753b238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:41.258356 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb0571-32ac-4bcb-9e29-99169753b238 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:41.258640 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb0571-32ac-4bcb-9e29-99169753b238 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:41.258919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb0571-32ac-4bcb-9e29-99169753b238 None admin] PATH_INFO: `/v3/groups/d074030120884d3da3376ffa5354a80c` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:41.260278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb0571-32ac-4bcb-9e29-99169753b238 None admin] RBAC: Authorizing `identity:get_group(group_id=d074030120884d3da3376ffa5354a80c)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:41.261900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb0571-32ac-4bcb-9e29-99169753b238 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:41.264099 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 219/434] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:41 2022] GET /identity/v3/groups/d074030120884d3da3376ffa5354a80c => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:41.271872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb0571-32ac-4bcb-9e29-99169753b238 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:41.289610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79273ed2-fe53-4ae1-8056-4c1ba10898d3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:41.328656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdd56d-1218-4997-ad41-a25c09c0301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:41.329549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdd56d-1218-4997-ad41-a25c09c0301d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:41.330018 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdd56d-1218-4997-ad41-a25c09c0301d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:41.330471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdd56d-1218-4997-ad41-a25c09c0301d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:41.369172 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:41.386314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb0571-32ac-4bcb-9e29-99169753b238 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:41.412784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdd56d-1218-4997-ad41-a25c09c0301d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:41.414267 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdd56d-1218-4997-ad41-a25c09c0301d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:41.429287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3ccaf-b3c7-4005-9d15-b1058d5e30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:41.430408 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ccaf-b3c7-4005-9d15-b1058d5e30f8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:41.430979 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ccaf-b3c7-4005-9d15-b1058d5e30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:41.431491 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ccaf-b3c7-4005-9d15-b1058d5e30f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:41.432542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3ccaf-b3c7-4005-9d15-b1058d5e30f8 None admin] RBAC: Adding query filter params (group.id=d074030120884d3da3376ffa5354a80c, role.id=4f0522c790e94492976ef2674f85ad66, scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:41.433053 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3ccaf-b3c7-4005-9d15-b1058d5e30f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:41.434927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3ccaf-b3c7-4005-9d15-b1058d5e30f8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:41.443147 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 220/435] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jul 6 20:28:41 2022] GET /identity/v3/role_assignments?group.id=d074030120884d3da3376ffa5354a80c&scope.project.id=d676d249fb5d4c0fa1addc459fc2e34b&role.id=4f0522c790e94492976ef2674f85ad66 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:41.486014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:41.538910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 216/436] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:41.551227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3ccaf-b3c7-4005-9d15-b1058d5e30f8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:41.576157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6440bdd-959f-442e-ac51-434704d8d858 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:41.576500 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6440bdd-959f-442e-ac51-434704d8d858 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:41.576718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6440bdd-959f-442e-ac51-434704d8d858 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:41.582673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 217/437] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:41.584499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b0aae-07dc-4f7b-9fad-82ca7409cc4a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:41.584864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b0aae-07dc-4f7b-9fad-82ca7409cc4a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:41.585215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b0aae-07dc-4f7b-9fad-82ca7409cc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:41.603331 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fd8b0aae-07dc-4f7b-9fad-82ca7409cc4a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:41.604653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fd8b0aae-07dc-4f7b-9fad-82ca7409cc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:41.673971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3ccaf-b3c7-4005-9d15-b1058d5e30f8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:41.682119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 218/438] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:41.705684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b0aae-07dc-4f7b-9fad-82ca7409cc4a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:41.710145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdade45-d6da-4a1a-821c-5d9cf7c35715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:41.711043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdade45-d6da-4a1a-821c-5d9cf7c35715 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:41.711325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdade45-d6da-4a1a-821c-5d9cf7c35715 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:41.711609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdade45-d6da-4a1a-821c-5d9cf7c35715 None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:41.712824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdade45-d6da-4a1a-821c-5d9cf7c35715 None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:41.714456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdade45-d6da-4a1a-821c-5d9cf7c35715 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:41.716466 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 221/439] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:41 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:41.723950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdade45-d6da-4a1a-821c-5d9cf7c35715 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:41.744142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:41.821290 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:41.844835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b0aae-07dc-4f7b-9fad-82ca7409cc4a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:41.868716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdade45-d6da-4a1a-821c-5d9cf7c35715 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:41.891261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482527a-71c0-4582-80ab-369b6c1c994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:41.892841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482527a-71c0-4582-80ab-369b6c1c994f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:41.893210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482527a-71c0-4582-80ab-369b6c1c994f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:41.893522 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482527a-71c0-4582-80ab-369b6c1c994f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:41.911112 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482527a-71c0-4582-80ab-369b6c1c994f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:41.912362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de517af-fe93-4f73-b91a-7061699f1080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:41.913232 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de517af-fe93-4f73-b91a-7061699f1080 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:41.913586 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de517af-fe93-4f73-b91a-7061699f1080 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:41.913871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de517af-fe93-4f73-b91a-7061699f1080 None admin] PATH_INFO: `/v3/groups/d074030120884d3da3376ffa5354a80c` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:41.915069 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de517af-fe93-4f73-b91a-7061699f1080 None admin] RBAC: Authorizing `identity:get_group(group_id=d074030120884d3da3376ffa5354a80c)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:41.916567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de517af-fe93-4f73-b91a-7061699f1080 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:41.918362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 222/440] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:41 2022] GET /identity/v3/groups/d074030120884d3da3376ffa5354a80c => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-a482527a-71c0-4582-80ab-369b6c1c994f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:41.924556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:41.925440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:41.926225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:41.926225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:41.926225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:41.926225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:41.926225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:41.926225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:41.926225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:41.926225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:41.926225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:41.926225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:41.926225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:41.926225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:41.926816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de517af-fe93-4f73-b91a-7061699f1080 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:41.926893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 219/441] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:28:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:41.932984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482527a-71c0-4582-80ab-369b6c1c994f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:42.026295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:42.044822 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de517af-fe93-4f73-b91a-7061699f1080 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:42.047152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482527a-71c0-4582-80ab-369b6c1c994f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:42.082910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b34ab-54e0-41d1-9491-e7c988cce02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:42.083563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b34ab-54e0-41d1-9491-e7c988cce02c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:42.083853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b34ab-54e0-41d1-9491-e7c988cce02c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:42.084135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b34ab-54e0-41d1-9491-e7c988cce02c None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:42.084441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b47aec-4b89-4e1d-a9b7-1b50d90fb3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:42.084882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b34ab-54e0-41d1-9491-e7c988cce02c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:42.085093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b47aec-4b89-4e1d-a9b7-1b50d90fb3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:42.085199 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b34ab-54e0-41d1-9491-e7c988cce02c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:42.085377 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b47aec-4b89-4e1d-a9b7-1b50d90fb3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:42.085654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b47aec-4b89-4e1d-a9b7-1b50d90fb3a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:42.086481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b47aec-4b89-4e1d-a9b7-1b50d90fb3a7 None admin] RBAC: Adding query filter params (group.id=d074030120884d3da3376ffa5354a80c, role.id=e9451c79645545d78e667c61eece4ec8, scope.project.id=e9135a691446476da5eef60527399dcc) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:42.086583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b34ab-54e0-41d1-9491-e7c988cce02c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:42.086794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b47aec-4b89-4e1d-a9b7-1b50d90fb3a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:42.088246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b47aec-4b89-4e1d-a9b7-1b50d90fb3a7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:42.094619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 223/442] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jul 6 20:28:41 2022] GET /identity/v3/role_assignments?group.id=d074030120884d3da3376ffa5354a80c&scope.project.id=e9135a691446476da5eef60527399dcc&role.id=e9451c79645545d78e667c61eece4ec8 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:42.100327 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c477f-e7e3-416d-8a18-87c3e72a214b None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:42.100500 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 220/443] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:42.100606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c477f-e7e3-416d-8a18-87c3e72a214b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:42.100606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c477f-e7e3-416d-8a18-87c3e72a214b None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:42.100606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 224/444] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:42.101331 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b34ab-54e0-41d1-9491-e7c988cce02c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:42.103834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160d973-6100-44ee-a680-788375d2b267 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:42.104135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160d973-6100-44ee-a680-788375d2b267 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:42.104416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160d973-6100-44ee-a680-788375d2b267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:42.119605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:42.124040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-0160d973-6100-44ee-a680-788375d2b267 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:42.125967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0160d973-6100-44ee-a680-788375d2b267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:42.204206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 225/445] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:42.220438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b34ab-54e0-41d1-9491-e7c988cce02c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:42.227990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160d973-6100-44ee-a680-788375d2b267 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:42.260415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37f862-24f9-446b-ac88-84959dc0a6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:42.261327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37f862-24f9-446b-ac88-84959dc0a6fc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:42.261614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37f862-24f9-446b-ac88-84959dc0a6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:42.261891 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37f862-24f9-446b-ac88-84959dc0a6fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:42.313103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:42.339563 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160d973-6100-44ee-a680-788375d2b267 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:42.351334 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37f862-24f9-446b-ac88-84959dc0a6fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:42.352818 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37f862-24f9-446b-ac88-84959dc0a6fc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:42.366407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:42.383747 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f56eb3-c063-4795-8b25-cee99bf35271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:42.384549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f56eb3-c063-4795-8b25-cee99bf35271 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:42.384841 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f56eb3-c063-4795-8b25-cee99bf35271 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:42.385117 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f56eb3-c063-4795-8b25-cee99bf35271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:42.399076 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f56eb3-c063-4795-8b25-cee99bf35271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-11f56eb3-c063-4795-8b25-cee99bf35271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:42.408320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:42.409406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:42.410241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:42.410241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:42.410241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:42.410241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:42.410241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:42.410241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:42.410241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:42.410241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:42.410241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:42.410241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:42.410241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:28:42.410241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:42.410241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 226/446] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:28:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:42.415466 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f56eb3-c063-4795-8b25-cee99bf35271 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:42.470236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 221/447] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:28:42.475793 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37f862-24f9-446b-ac88-84959dc0a6fc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:42.523936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f56eb3-c063-4795-8b25-cee99bf35271 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:42.557506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375119bc-509d-4015-800c-3591042f6d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:42.558158 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375119bc-509d-4015-800c-3591042f6d18 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:42.558441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375119bc-509d-4015-800c-3591042f6d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:42.558716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375119bc-509d-4015-800c-3591042f6d18 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:42.559479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375119bc-509d-4015-800c-3591042f6d18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:42.559787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375119bc-509d-4015-800c-3591042f6d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:42.561150 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375119bc-509d-4015-800c-3591042f6d18 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:42.566206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:42.569969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 227/448] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:42.571673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37f862-24f9-446b-ac88-84959dc0a6fc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:42.575117 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375119bc-509d-4015-800c-3591042f6d18 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:42.582825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:42.607478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952f1a6-2495-40c0-b1d6-677842260b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:42.608271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f1a6-2495-40c0-b1d6-677842260b2c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:42.608549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f1a6-2495-40c0-b1d6-677842260b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:42.608949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f1a6-2495-40c0-b1d6-677842260b2c None admin] PATH_INFO: `/v3/projects/e9135a691446476da5eef60527399dcc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:42.610128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952f1a6-2495-40c0-b1d6-677842260b2c None admin] RBAC: Authorizing `identity:get_project(project_id=e9135a691446476da5eef60527399dcc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:42.611628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952f1a6-2495-40c0-b1d6-677842260b2c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:42.613318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 222/449] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:42 2022] GET /identity/v3/projects/e9135a691446476da5eef60527399dcc => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:42.618710 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952f1a6-2495-40c0-b1d6-677842260b2c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:42.676653 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375119bc-509d-4015-800c-3591042f6d18 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:42.709114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aeeda-a5a1-4462-89fe-8bd9d613c78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:42.709772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aeeda-a5a1-4462-89fe-8bd9d613c78a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:42.710314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aeeda-a5a1-4462-89fe-8bd9d613c78a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:42.710314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aeeda-a5a1-4462-89fe-8bd9d613c78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:42.715630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952f1a6-2495-40c0-b1d6-677842260b2c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:42.750917 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d759977-950a-4729-9e29-f0410d673a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:42.751821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d759977-950a-4729-9e29-f0410d673a4a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:42.752097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d759977-950a-4729-9e29-f0410d673a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:42.752368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d759977-950a-4729-9e29-f0410d673a4a None admin] PATH_INFO: `/v3/groups/d074030120884d3da3376ffa5354a80c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:42.753545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d759977-950a-4729-9e29-f0410d673a4a None admin] RBAC: Authorizing `identity:get_group(group_id=d074030120884d3da3376ffa5354a80c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:42.754995 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d759977-950a-4729-9e29-f0410d673a4a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:42.756799 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 223/450] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:42 2022] GET /identity/v3/groups/d074030120884d3da3376ffa5354a80c => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:42.762402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d759977-950a-4729-9e29-f0410d673a4a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:42.778097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:42.781344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487aeeda-a5a1-4462-89fe-8bd9d613c78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:42.783412 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487aeeda-a5a1-4462-89fe-8bd9d613c78a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:42.808476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:42.861942 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d759977-950a-4729-9e29-f0410d673a4a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:42.879295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 228/451] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:28:42.884751 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aeeda-a5a1-4462-89fe-8bd9d613c78a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:42.895806 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86220bcd-838e-4442-8389-22d3096f863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:42.896461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86220bcd-838e-4442-8389-22d3096f863b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:42.896745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86220bcd-838e-4442-8389-22d3096f863b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:42.897022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86220bcd-838e-4442-8389-22d3096f863b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:42.897849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86220bcd-838e-4442-8389-22d3096f863b None admin] RBAC: Adding query filter params (group.id=d074030120884d3da3376ffa5354a80c, role.id=4f0522c790e94492976ef2674f85ad66, scope.project.id=e9135a691446476da5eef60527399dcc) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:42.898162 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86220bcd-838e-4442-8389-22d3096f863b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:42.899640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86220bcd-838e-4442-8389-22d3096f863b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:42.905304 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 224/452] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jul 6 20:28:42 2022] GET /identity/v3/role_assignments?group.id=d074030120884d3da3376ffa5354a80c&scope.project.id=e9135a691446476da5eef60527399dcc&role.id=4f0522c790e94492976ef2674f85ad66 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:42.991948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:42.995664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aeeda-a5a1-4462-89fe-8bd9d613c78a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:43.033161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9860e1-77a5-454f-b331-a66e30748fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:43.034029 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9860e1-77a5-454f-b331-a66e30748fea None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:43.034309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9860e1-77a5-454f-b331-a66e30748fea None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:43.034585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9860e1-77a5-454f-b331-a66e30748fea None admin] PATH_INFO: `/v3/projects/371b1675f3c34bee9789abbf8b4d7fc5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:43.035840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9860e1-77a5-454f-b331-a66e30748fea None admin] RBAC: Authorizing `identity:get_project(project_id=371b1675f3c34bee9789abbf8b4d7fc5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:43.037313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9860e1-77a5-454f-b331-a66e30748fea None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:43.039037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 229/453] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:28:42 2022] GET /identity/v3/projects/371b1675f3c34bee9789abbf8b4d7fc5 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:43.044618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86220bcd-838e-4442-8389-22d3096f863b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:43.147024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86220bcd-838e-4442-8389-22d3096f863b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:43.158476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:43.182364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0306c-e77e-4352-9483-10bf3e31819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:43.183334 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0306c-e77e-4352-9483-10bf3e31819a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:43.183616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0306c-e77e-4352-9483-10bf3e31819a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:43.183888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0306c-e77e-4352-9483-10bf3e31819a None admin] PATH_INFO: `/v3/groups/43a0559a38ae487fb7134faf6b125618` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:43.185052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0306c-e77e-4352-9483-10bf3e31819a None admin] RBAC: Authorizing `identity:get_group(group_id=43a0559a38ae487fb7134faf6b125618)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:43.186502 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0306c-e77e-4352-9483-10bf3e31819a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:43.188346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 225/454] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jul 6 20:28:43 2022] GET /identity/v3/groups/43a0559a38ae487fb7134faf6b125618 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:43.194253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9860e1-77a5-454f-b331-a66e30748fea None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:43.293196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9860e1-77a5-454f-b331-a66e30748fea None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:43.325420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d9d59-6658-4ec0-b12d-e85a34e61ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:43.326065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d9d59-6658-4ec0-b12d-e85a34e61ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:43.326346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d9d59-6658-4ec0-b12d-e85a34e61ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:43.326621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d9d59-6658-4ec0-b12d-e85a34e61ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:43.327503 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d9d59-6658-4ec0-b12d-e85a34e61ab5 None admin] RBAC: Adding query filter params (group.id=43a0559a38ae487fb7134faf6b125618, role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=371b1675f3c34bee9789abbf8b4d7fc5) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:43.327815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d9d59-6658-4ec0-b12d-e85a34e61ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:43.329231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d9d59-6658-4ec0-b12d-e85a34e61ab5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:43.334814 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 230/455] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jul 6 20:28:43 2022] GET /identity/v3/role_assignments?group.id=43a0559a38ae487fb7134faf6b125618&scope.project.id=371b1675f3c34bee9789abbf8b4d7fc5&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:45.767088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296996f8-fff0-4a3e-81ae-4818a4f0afa5 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:45.767969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296996f8-fff0-4a3e-81ae-4818a4f0afa5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:45.768388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296996f8-fff0-4a3e-81ae-4818a4f0afa5 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:45.770473 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 226/456] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:45.776154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e009d5-2845-4bfa-8f6c-b7cd086f121f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:45.776906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e009d5-2845-4bfa-8f6c-b7cd086f121f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:45.777392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e009d5-2845-4bfa-8f6c-b7cd086f121f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:45.799768 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-24e009d5-2845-4bfa-8f6c-b7cd086f121f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:45.801210 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-24e009d5-2845-4bfa-8f6c-b7cd086f121f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:45.841112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:45.899531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 231/457] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:45.924401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296996f8-fff0-4a3e-81ae-4818a4f0afa5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:46.062211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296996f8-fff0-4a3e-81ae-4818a4f0afa5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:46.098456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512afd3a-50f8-4ef7-956b-3d47431c67e8 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.098979 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512afd3a-50f8-4ef7-956b-3d47431c67e8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.099423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512afd3a-50f8-4ef7-956b-3d47431c67e8 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.100929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 232/458] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:28:46.106262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd69a7-5a3e-4591-88ca-ec50b3c2643e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.106556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd69a7-5a3e-4591-88ca-ec50b3c2643e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.106837 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd69a7-5a3e-4591-88ca-ec50b3c2643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.119089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b907e8-6454-4e1a-9f45-0acb373beec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:46.120099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b907e8-6454-4e1a-9f45-0acb373beec2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.121304 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b907e8-6454-4e1a-9f45-0acb373beec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.121726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b907e8-6454-4e1a-9f45-0acb373beec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.138650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-eebd69a7-5a3e-4591-88ca-ec50b3c2643e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:46.141467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-eebd69a7-5a3e-4591-88ca-ec50b3c2643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:46.146236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b907e8-6454-4e1a-9f45-0acb373beec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:46.147922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b907e8-6454-4e1a-9f45-0acb373beec2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e3b907e8-6454-4e1a-9f45-0acb373beec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:46.183159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:46.184295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:46.185360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:46.185360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:46.185360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:46.185360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:46.189513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 227/459] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:46.195356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b907e8-6454-4e1a-9f45-0acb373beec2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:46.228506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:46.259971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 233/460] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:46.261998 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d80f3-a16b-4068-a0f9-0bb9cae2d113 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.262830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d80f3-a16b-4068-a0f9-0bb9cae2d113 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.263482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d80f3-a16b-4068-a0f9-0bb9cae2d113 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.270207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 234/461] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:46.271483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42ddf5-780c-495c-91c9-eab8fba92594 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.271751 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42ddf5-780c-495c-91c9-eab8fba92594 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.272029 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42ddf5-780c-495c-91c9-eab8fba92594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.291552 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ae42ddf5-780c-495c-91c9-eab8fba92594 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:46.292772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ae42ddf5-780c-495c-91c9-eab8fba92594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:46.324055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b907e8-6454-4e1a-9f45-0acb373beec2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:46.363506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fe533-e9ef-4a73-bb94-53b7422766c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:46.371341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fe533-e9ef-4a73-bb94-53b7422766c6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.371471 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 235/462] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:46.371562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fe533-e9ef-4a73-bb94-53b7422766c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.371562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fe533-e9ef-4a73-bb94-53b7422766c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.371750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42ddf5-780c-495c-91c9-eab8fba92594 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:46.371843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fe533-e9ef-4a73-bb94-53b7422766c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:46.371843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fe533-e9ef-4a73-bb94-53b7422766c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:46.371843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fe533-e9ef-4a73-bb94-53b7422766c6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:46.382571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 228/463] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:46.383761 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd259d-81b0-4f5a-b7cc-baeef71a8c19 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.384062 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd259d-81b0-4f5a-b7cc-baeef71a8c19 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.384354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd259d-81b0-4f5a-b7cc-baeef71a8c19 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.387356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 229/464] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:46.391226 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dbcb7-4812-4a40-8704-ee182d7028d2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.391516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dbcb7-4812-4a40-8704-ee182d7028d2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.391795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dbcb7-4812-4a40-8704-ee182d7028d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.399521 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:46.410479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f06dbcb7-4812-4a40-8704-ee182d7028d2 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:46.411911 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f06dbcb7-4812-4a40-8704-ee182d7028d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:46.482812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42ddf5-780c-495c-91c9-eab8fba92594 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:46.488422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 230/465] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:46.489163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dbcb7-4812-4a40-8704-ee182d7028d2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:46.518150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:46.528621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5501d43-7044-4965-a770-7ef25ac910a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:46.529429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5501d43-7044-4965-a770-7ef25ac910a0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.529710 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5501d43-7044-4965-a770-7ef25ac910a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.529981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5501d43-7044-4965-a770-7ef25ac910a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.540940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5501d43-7044-4965-a770-7ef25ac910a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:46.542509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5501d43-7044-4965-a770-7ef25ac910a0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-c5501d43-7044-4965-a770-7ef25ac910a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:46.561896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:46.562903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:46.564203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:46.564203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:46.564203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:46.564203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:46.564203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 236/466] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:46.564203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5501d43-7044-4965-a770-7ef25ac910a0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:46.615261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dbcb7-4812-4a40-8704-ee182d7028d2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:46.649011 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:46.649748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14018855-1b3a-49fd-a8a9-fa1139ec4829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:46.650452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14018855-1b3a-49fd-a8a9-fa1139ec4829 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.650772 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14018855-1b3a-49fd-a8a9-fa1139ec4829 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.650979 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14018855-1b3a-49fd-a8a9-fa1139ec4829 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.651794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14018855-1b3a-49fd-a8a9-fa1139ec4829 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:46.653245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14018855-1b3a-49fd-a8a9-fa1139ec4829 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:46.683202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 231/467] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:28:46 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:28:46.683202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14018855-1b3a-49fd-a8a9-fa1139ec4829 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:46.686668 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5501d43-7044-4965-a770-7ef25ac910a0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:46.731054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9448c6b-df24-4e05-b639-c91b92a5c1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:46.732013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9448c6b-df24-4e05-b639-c91b92a5c1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.732295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9448c6b-df24-4e05-b639-c91b92a5c1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.732574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9448c6b-df24-4e05-b639-c91b92a5c1c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.746710 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9448c6b-df24-4e05-b639-c91b92a5c1c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:46.748416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9448c6b-df24-4e05-b639-c91b92a5c1c6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-d9448c6b-df24-4e05-b639-c91b92a5c1c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:46.770609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:46.771581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:46.772435 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:46.772435 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:46.772435 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:46.772435 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:46.772435 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 237/468] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:46.773244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9448c6b-df24-4e05-b639-c91b92a5c1c6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:46.776767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:46.804532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14018855-1b3a-49fd-a8a9-fa1139ec4829 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:46.853042 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae614b-49db-459a-bf95-a3398e227d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:46.854137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae614b-49db-459a-bf95-a3398e227d2f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.854429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae614b-49db-459a-bf95-a3398e227d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.854713 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae614b-49db-459a-bf95-a3398e227d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.869373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae614b-49db-459a-bf95-a3398e227d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:46.870901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae614b-49db-459a-bf95-a3398e227d2f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-10ae614b-49db-459a-bf95-a3398e227d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:46.890919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:46.891869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:46.892722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:46.892722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:46.892722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:46.892722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:46.892722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 232/469] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:46.893400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae614b-49db-459a-bf95-a3398e227d2f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:46.929345 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9448c6b-df24-4e05-b639-c91b92a5c1c6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:46.962912 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:46.974227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85efc09-66c3-4c3b-b5f1-6571f87edce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:46.974918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85efc09-66c3-4c3b-b5f1-6571f87edce1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:46.975219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85efc09-66c3-4c3b-b5f1-6571f87edce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:46.975496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85efc09-66c3-4c3b-b5f1-6571f87edce1 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:46.976218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85efc09-66c3-4c3b-b5f1-6571f87edce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:46.976526 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85efc09-66c3-4c3b-b5f1-6571f87edce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:46.977910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85efc09-66c3-4c3b-b5f1-6571f87edce1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:46.990872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 238/470] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:46.991759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85efc09-66c3-4c3b-b5f1-6571f87edce1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:47.028274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae614b-49db-459a-bf95-a3398e227d2f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:47.057734 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:47.067800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161c1b7-bb78-4eba-ab3f-614f4735d5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:47.068539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161c1b7-bb78-4eba-ab3f-614f4735d5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:47.068832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161c1b7-bb78-4eba-ab3f-614f4735d5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:47.069143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161c1b7-bb78-4eba-ab3f-614f4735d5f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:47.069850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161c1b7-bb78-4eba-ab3f-614f4735d5f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:47.070166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161c1b7-bb78-4eba-ab3f-614f4735d5f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:47.071677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161c1b7-bb78-4eba-ab3f-614f4735d5f2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:47.085315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 233/471] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:47.090000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161c1b7-bb78-4eba-ab3f-614f4735d5f2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:47.134099 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85efc09-66c3-4c3b-b5f1-6571f87edce1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:47.174179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a9522-1a72-4ae2-ba81-14a5b5a7ebda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:47.175321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a9522-1a72-4ae2-ba81-14a5b5a7ebda None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:47.175814 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a9522-1a72-4ae2-ba81-14a5b5a7ebda None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:47.176338 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a9522-1a72-4ae2-ba81-14a5b5a7ebda None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:47.177269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a9522-1a72-4ae2-ba81-14a5b5a7ebda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:47.177776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a9522-1a72-4ae2-ba81-14a5b5a7ebda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:47.179619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a9522-1a72-4ae2-ba81-14a5b5a7ebda None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:47.193038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 239/472] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:47.198474 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a9522-1a72-4ae2-ba81-14a5b5a7ebda None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:47.199335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161c1b7-bb78-4eba-ab3f-614f4735d5f2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:47.236924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3850ea-f416-4f6a-8ac7-33a26bfde0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:47.237668 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3850ea-f416-4f6a-8ac7-33a26bfde0f3 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:47.237957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3850ea-f416-4f6a-8ac7-33a26bfde0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:47.238978 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3850ea-f416-4f6a-8ac7-33a26bfde0f3 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:47.239088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3850ea-f416-4f6a-8ac7-33a26bfde0f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:47.240531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3850ea-f416-4f6a-8ac7-33a26bfde0f3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:47.251405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:47.271322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 234/473] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:28:47 2022] POST /identity/v3/users => generated 248 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:28:47.271322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3850ea-f416-4f6a-8ac7-33a26bfde0f3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:47.329990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:47.365203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a9522-1a72-4ae2-ba81-14a5b5a7ebda None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:47.399126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3850ea-f416-4f6a-8ac7-33a26bfde0f3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:47.443860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080c32d-d354-4895-aa2d-4ce0506333c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:47.444993 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c32d-d354-4895-aa2d-4ce0506333c9 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:47.445386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c32d-d354-4895-aa2d-4ce0506333c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:47.445767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c32d-d354-4895-aa2d-4ce0506333c9 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:47.446768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080c32d-d354-4895-aa2d-4ce0506333c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:47.449271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080c32d-d354-4895-aa2d-4ce0506333c9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:47.453194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17d362-de0b-4a63-8b7a-ef9db6a3c737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:47.454067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17d362-de0b-4a63-8b7a-ef9db6a3c737 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:47.454551 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17d362-de0b-4a63-8b7a-ef9db6a3c737 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:47.455007 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17d362-de0b-4a63-8b7a-ef9db6a3c737 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:47.455910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17d362-de0b-4a63-8b7a-ef9db6a3c737 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:47.457534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17d362-de0b-4a63-8b7a-ef9db6a3c737 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:47.476801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 235/474] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:28:47 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:28:47.483721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e206c-4faa-4d3a-adf8-9b69918339c4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:47.483721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e206c-4faa-4d3a-adf8-9b69918339c4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:47.483721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e206c-4faa-4d3a-adf8-9b69918339c4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:47.483721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 236/475] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:47.486648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2843d1-838e-4854-a75b-5c68fa6c453d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:47.487067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2843d1-838e-4854-a75b-5c68fa6c453d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:47.487506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2843d1-838e-4854-a75b-5c68fa6c453d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:47.490472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 240/476] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:28:47 2022] POST /identity/v3/users => generated 248 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:28:47.523014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8d2843d1-838e-4854-a75b-5c68fa6c453d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:47.524316 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8d2843d1-838e-4854-a75b-5c68fa6c453d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:47.621078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 237/477] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:47.646690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17d362-de0b-4a63-8b7a-ef9db6a3c737 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:47.768800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17d362-de0b-4a63-8b7a-ef9db6a3c737 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:47.770787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:47.808215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c5867-d4e9-4143-ba8a-c9573791df73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:47.808939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c5867-d4e9-4143-ba8a-c9573791df73 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:47.809229 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c5867-d4e9-4143-ba8a-c9573791df73 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:47.809506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c5867-d4e9-4143-ba8a-c9573791df73 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:47.810264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c5867-d4e9-4143-ba8a-c9573791df73 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:47.812271 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c5867-d4e9-4143-ba8a-c9573791df73 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:47.824358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.sql.core [None req-a21c5867-d4e9-4143-ba8a-c9573791df73 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 20:28:47.824358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 06 20:28:47.824358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [parameters: {'id': '90d6d0a1d969433eb84941778c6b513f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 06 20:28:47.824358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80523) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-a21c5867-d4e9-4143-ba8a-c9573791df73 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application conn.query(q) Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result.read() Jul 06 20:28:47.841716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return ref.to_dict() Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 20:28:47.843268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application next(self.gen) Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application yield resource Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application next(self.gen) Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise self.value Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application session.commit() Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 20:28:47.844214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.session.flush() Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application compat.raise_( Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 20:28:47.845156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 20:28:47.846057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application conn.query(q) Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result.read() Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 20:28:47.846902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [parameters: {'id': '90d6d0a1d969433eb84941778c6b513f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:47.850179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 06 20:28:47.855295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:47.860874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 241/478] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Jul 6 20:28:47 2022] POST /identity/v3/roles => generated 144 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:47.861013 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2843d1-838e-4854-a75b-5c68fa6c453d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:47.883956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:47.961992 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2843d1-838e-4854-a75b-5c68fa6c453d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:48.008728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b483f43-9776-4af2-b0a4-bb5f64a5ebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:48.009549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b483f43-9776-4af2-b0a4-bb5f64a5ebe2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:48.009837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b483f43-9776-4af2-b0a4-bb5f64a5ebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:48.010109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b483f43-9776-4af2-b0a4-bb5f64a5ebe2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:48.032071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b483f43-9776-4af2-b0a4-bb5f64a5ebe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9b483f43-9776-4af2-b0a4-bb5f64a5ebe2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:48.040402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:48.041302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:48.042087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:48.042087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:48.042087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:48.042087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:48.042087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:48.042087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:48.042087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:48.042087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:48.042087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:48.042087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:48.042087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 20:28:48.042087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:48.042087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 238/479] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:28:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:48.048073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c5867-d4e9-4143-ba8a-c9573791df73 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:48.196172 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c5867-d4e9-4143-ba8a-c9573791df73 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:48.246674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7e524-1e9b-4778-b51e-476ed1491956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:48.247373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7e524-1e9b-4778-b51e-476ed1491956 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:48.247654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7e524-1e9b-4778-b51e-476ed1491956 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:48.247927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7e524-1e9b-4778-b51e-476ed1491956 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:48.248783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7e524-1e9b-4778-b51e-476ed1491956 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:48.249182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7e524-1e9b-4778-b51e-476ed1491956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:48.250559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7e524-1e9b-4778-b51e-476ed1491956 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:48.259398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 242/480] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:49.013064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729cfec-f9f9-456a-9d70-461f306cdfe0 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:49.014039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729cfec-f9f9-456a-9d70-461f306cdfe0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:49.015101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729cfec-f9f9-456a-9d70-461f306cdfe0 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:49.016947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 239/481] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:49.022189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6fdea-bd56-4a08-b92a-02bf6eeacd8a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:49.022749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6fdea-bd56-4a08-b92a-02bf6eeacd8a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:49.023267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6fdea-bd56-4a08-b92a-02bf6eeacd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:49.048231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-34c6fdea-bd56-4a08-b92a-02bf6eeacd8a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:49.050183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-34c6fdea-bd56-4a08-b92a-02bf6eeacd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:49.076429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:49.133139 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 243/482] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:49.158691 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729cfec-f9f9-456a-9d70-461f306cdfe0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:49.277216 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:49.289278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729cfec-f9f9-456a-9d70-461f306cdfe0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:49.325873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782ba07-3ddd-4dfc-9bf9-d5fb79cec5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:49.327376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782ba07-3ddd-4dfc-9bf9-d5fb79cec5fb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:49.327867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782ba07-3ddd-4dfc-9bf9-d5fb79cec5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:49.328341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782ba07-3ddd-4dfc-9bf9-d5fb79cec5fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:49.339471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782ba07-3ddd-4dfc-9bf9-d5fb79cec5fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5782ba07-3ddd-4dfc-9bf9-d5fb79cec5fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:49.348295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:49.349262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:49.350061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:49.350061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:49.350061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:49.350061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:49.350061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:49.350061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:49.350061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:49.350061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:49.350061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:49.350061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:49.350061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:49.350061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:49.352771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 240/483] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:28:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:49.361194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6fdea-bd56-4a08-b92a-02bf6eeacd8a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:49.518255 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6fdea-bd56-4a08-b92a-02bf6eeacd8a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:49.567742 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4d93a-f401-41ff-b8ea-b0586fd64e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:49.568472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4d93a-f401-41ff-b8ea-b0586fd64e15 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:49.568759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4d93a-f401-41ff-b8ea-b0586fd64e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:49.569037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4d93a-f401-41ff-b8ea-b0586fd64e15 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:49.569788 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4d93a-f401-41ff-b8ea-b0586fd64e15 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:49.570095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4d93a-f401-41ff-b8ea-b0586fd64e15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:49.571533 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4d93a-f401-41ff-b8ea-b0586fd64e15 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:49.585730 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 244/484] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:28:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:49.599875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782ba07-3ddd-4dfc-9bf9-d5fb79cec5fb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:49.732676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782ba07-3ddd-4dfc-9bf9-d5fb79cec5fb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:49.774591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4231dc-e895-446f-8bd7-a945234c2be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:49.775783 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4231dc-e895-446f-8bd7-a945234c2be1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:49.776288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4231dc-e895-446f-8bd7-a945234c2be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:49.776774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4231dc-e895-446f-8bd7-a945234c2be1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:49.789768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4231dc-e895-446f-8bd7-a945234c2be1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:49.791615 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4231dc-e895-446f-8bd7-a945234c2be1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-eb4231dc-e895-446f-8bd7-a945234c2be1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:49.816707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:49.817596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:49.818464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:49.818464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:49.818464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:49.818464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:49.820763 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 241/485] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:49.826013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4d93a-f401-41ff-b8ea-b0586fd64e15 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:49.862913 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:49.975405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4d93a-f401-41ff-b8ea-b0586fd64e15 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:50.009820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab00c-0806-430c-803e-e6063e7b8e0b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.010466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab00c-0806-430c-803e-e6063e7b8e0b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.010963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab00c-0806-430c-803e-e6063e7b8e0b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.012534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 242/486] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:28:50.017674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59db89a-c5be-4539-b0f9-590555084850 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.018261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59db89a-c5be-4539-b0f9-590555084850 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.018394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59db89a-c5be-4539-b0f9-590555084850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.028766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:50.030680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775a1b4-dbb9-41df-a517-93caa93a3345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:50.031887 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775a1b4-dbb9-41df-a517-93caa93a3345 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.032309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775a1b4-dbb9-41df-a517-93caa93a3345 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.032732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775a1b4-dbb9-41df-a517-93caa93a3345 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.033583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775a1b4-dbb9-41df-a517-93caa93a3345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:50.034019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775a1b4-dbb9-41df-a517-93caa93a3345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:50.035547 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775a1b4-dbb9-41df-a517-93caa93a3345 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:50.048195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 245/487] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:50.052275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c59db89a-c5be-4539-b0f9-590555084850 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:50.053280 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775a1b4-dbb9-41df-a517-93caa93a3345 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:50.055375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c59db89a-c5be-4539-b0f9-590555084850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:50.163190 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:50.173029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 243/488] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:50.180317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a63368-16f0-43bd-9ace-9e2369223dfb None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.180606 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a63368-16f0-43bd-9ace-9e2369223dfb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.180881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a63368-16f0-43bd-9ace-9e2369223dfb None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.189220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 244/489] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:50.191370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a39119-774d-4458-8829-afb8fc2728a3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.191658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a39119-774d-4458-8829-afb8fc2728a3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.191934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a39119-774d-4458-8829-afb8fc2728a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.209236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775a1b4-dbb9-41df-a517-93caa93a3345 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:50.214969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-05a39119-774d-4458-8829-afb8fc2728a3 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:50.216201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-05a39119-774d-4458-8829-afb8fc2728a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:50.257635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee4f1f-ddb6-47fe-b64e-1f12c267a876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:50.258823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4f1f-ddb6-47fe-b64e-1f12c267a876 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.259343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4f1f-ddb6-47fe-b64e-1f12c267a876 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.259855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4f1f-ddb6-47fe-b64e-1f12c267a876 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.272314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee4f1f-ddb6-47fe-b64e-1f12c267a876 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:50.274677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee4f1f-ddb6-47fe-b64e-1f12c267a876 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:50.295294 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 245/490] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:50.296887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a39119-774d-4458-8829-afb8fc2728a3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-69ee4f1f-ddb6-47fe-b64e-1f12c267a876 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:28:50.297505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:50.298365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:50.299291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:50.299291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:50.299291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:28:50.299291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:28:50.299291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:28:50.299291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:28:50.299291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:28:50.299291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:28:50.299291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:28:50.299291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:50.302123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 246/491] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jul 6 20:28:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:50.312691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee4f1f-ddb6-47fe-b64e-1f12c267a876 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:50.379856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:50.423897 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee4f1f-ddb6-47fe-b64e-1f12c267a876 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:50.424064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a39119-774d-4458-8829-afb8fc2728a3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:50.458373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d564d7-91af-4754-a3e0-fff1ecfff5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:50.459070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d564d7-91af-4754-a3e0-fff1ecfff5ef None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.459382 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d564d7-91af-4754-a3e0-fff1ecfff5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.459667 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d564d7-91af-4754-a3e0-fff1ecfff5ef None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.459890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50108352-6320-4788-b7ce-15360ed4b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:50.460503 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d564d7-91af-4754-a3e0-fff1ecfff5ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:50.460686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108352-6320-4788-b7ce-15360ed4b434 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.460837 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d564d7-91af-4754-a3e0-fff1ecfff5ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:50.460999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108352-6320-4788-b7ce-15360ed4b434 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.461242 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108352-6320-4788-b7ce-15360ed4b434 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.462255 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d564d7-91af-4754-a3e0-fff1ecfff5ef None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:50.471823 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50108352-6320-4788-b7ce-15360ed4b434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-50108352-6320-4788-b7ce-15360ed4b434 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:50.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:50.480671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:50.481999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:50.481999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:50.481999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:50.481999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:50.481999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:50.481999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:50.481999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:50.481999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:50.481999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:50.481999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:50.481999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:50.481999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:50.481999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 246/492] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:28:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:50.484372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50108352-6320-4788-b7ce-15360ed4b434 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:50.493112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:50.509326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 247/493] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jul 6 20:28:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:50.510633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08f30d-eafb-4f9c-86e0-7aa53c56a47b None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.511008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08f30d-eafb-4f9c-86e0-7aa53c56a47b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.511212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08f30d-eafb-4f9c-86e0-7aa53c56a47b None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.517050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 248/494] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:50.517050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08f30d-eafb-4f9c-86e0-7aa53c56a47b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:50.600513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50108352-6320-4788-b7ce-15360ed4b434 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:50.628587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:50.630841 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08f30d-eafb-4f9c-86e0-7aa53c56a47b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:50.641467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfceac0-47da-4034-bd7f-b7719391c1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:50.642276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfceac0-47da-4034-bd7f-b7719391c1bc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.642564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfceac0-47da-4034-bd7f-b7719391c1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.642843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfceac0-47da-4034-bd7f-b7719391c1bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.654097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfceac0-47da-4034-bd7f-b7719391c1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1dfceac0-47da-4034-bd7f-b7719391c1bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:50.662946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:50.663843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:50.664614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:50.664614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:50.664614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:50.664614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:50.664614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:50.664614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:50.664614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:50.664614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:50.664614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:50.664614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:50.664614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:50.664614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:50.664614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 247/495] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:28:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:50.666017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfceac0-47da-4034-bd7f-b7719391c1bc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:50.675264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04826f-7404-4d4c-bb95-6e07cd379991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:50.675882 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04826f-7404-4d4c-bb95-6e07cd379991 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.676166 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04826f-7404-4d4c-bb95-6e07cd379991 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.676449 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04826f-7404-4d4c-bb95-6e07cd379991 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.677201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04826f-7404-4d4c-bb95-6e07cd379991 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:50.677516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04826f-7404-4d4c-bb95-6e07cd379991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:50.678917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04826f-7404-4d4c-bb95-6e07cd379991 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:50.691797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 249/496] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:28:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:50.691797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ae4ad-c804-46db-a87d-59a2d5541304 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.691797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ae4ad-c804-46db-a87d-59a2d5541304 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.691797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ae4ad-c804-46db-a87d-59a2d5541304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.706760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-082ae4ad-c804-46db-a87d-59a2d5541304 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:50.707991 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-082ae4ad-c804-46db-a87d-59a2d5541304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:50.776391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfceac0-47da-4034-bd7f-b7719391c1bc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:50.778967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:50.791155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 250/497] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:50.800200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ae4ad-c804-46db-a87d-59a2d5541304 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:50.813629 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769403a1-493b-4ef6-aace-2e59dfe0252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:50.814287 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769403a1-493b-4ef6-aace-2e59dfe0252f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.814569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769403a1-493b-4ef6-aace-2e59dfe0252f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.815098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769403a1-493b-4ef6-aace-2e59dfe0252f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.873964 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:50.897527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769403a1-493b-4ef6-aace-2e59dfe0252f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:50.898992 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769403a1-493b-4ef6-aace-2e59dfe0252f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:50.911648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ae4ad-c804-46db-a87d-59a2d5541304 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:50.947326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925abb22-eb9b-457d-8c91-16a1684a8f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:50.948194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925abb22-eb9b-457d-8c91-16a1684a8f3c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:50.948479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925abb22-eb9b-457d-8c91-16a1684a8f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:50.948754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925abb22-eb9b-457d-8c91-16a1684a8f3c None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:50.949510 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925abb22-eb9b-457d-8c91-16a1684a8f3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:50.949802 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925abb22-eb9b-457d-8c91-16a1684a8f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:50.951215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925abb22-eb9b-457d-8c91-16a1684a8f3c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:50.959384 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 251/498] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:28:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:50.960167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925abb22-eb9b-457d-8c91-16a1684a8f3c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:51.015520 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 248/499] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:51.016463 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769403a1-493b-4ef6-aace-2e59dfe0252f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:51.021166 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:51.072366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925abb22-eb9b-457d-8c91-16a1684a8f3c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:51.107358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:51.109840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e502a4f-8c7c-49de-b1c1-33f0eb81643e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:51.110745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502a4f-8c7c-49de-b1c1-33f0eb81643e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.111063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502a4f-8c7c-49de-b1c1-33f0eb81643e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.111437 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502a4f-8c7c-49de-b1c1-33f0eb81643e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.123308 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e502a4f-8c7c-49de-b1c1-33f0eb81643e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:51.125707 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e502a4f-8c7c-49de-b1c1-33f0eb81643e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:51.130278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769403a1-493b-4ef6-aace-2e59dfe0252f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-9e502a4f-8c7c-49de-b1c1-33f0eb81643e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:51.143409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:51.144735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:51.145911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:51.145911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:51.145911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:51.145911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:51.145911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 252/500] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:51.145911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e502a4f-8c7c-49de-b1c1-33f0eb81643e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:51.166385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68039b-914f-4e10-bae9-b60c4d3b08a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:51.167208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68039b-914f-4e10-bae9-b60c4d3b08a0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.167492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68039b-914f-4e10-bae9-b60c4d3b08a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.167767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68039b-914f-4e10-bae9-b60c4d3b08a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.178048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68039b-914f-4e10-bae9-b60c4d3b08a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-cb68039b-914f-4e10-bae9-b60c4d3b08a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:51.185650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:51.187393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 249/501] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:28:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:51.188529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68039b-914f-4e10-bae9-b60c4d3b08a0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:51.249385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e502a4f-8c7c-49de-b1c1-33f0eb81643e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:51.251575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:51.283763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ed270-7a7a-4943-9a45-ccc8bfcb8a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:51.284573 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ed270-7a7a-4943-9a45-ccc8bfcb8a1f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.284855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ed270-7a7a-4943-9a45-ccc8bfcb8a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.285127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ed270-7a7a-4943-9a45-ccc8bfcb8a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.288232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68039b-914f-4e10-bae9-b60c4d3b08a0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:51.295536 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ed270-7a7a-4943-9a45-ccc8bfcb8a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:51.297173 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ed270-7a7a-4943-9a45-ccc8bfcb8a1f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-958ed270-7a7a-4943-9a45-ccc8bfcb8a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:51.314197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:51.315060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:51.315943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:51.315943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:51.315943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:51.315943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:51.315943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 253/502] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:51.316771 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9510d1c-2775-4fc8-a7e9-35e871b709f5 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.316946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9510d1c-2775-4fc8-a7e9-35e871b709f5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.317221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9510d1c-2775-4fc8-a7e9-35e871b709f5 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.318475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 254/503] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:51.319234 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9510d1c-2775-4fc8-a7e9-35e871b709f5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:51.327512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d04e1-56d2-41ed-ba01-ee71674def68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:51.328392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d04e1-56d2-41ed-ba01-ee71674def68 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.328683 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d04e1-56d2-41ed-ba01-ee71674def68 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.328965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d04e1-56d2-41ed-ba01-ee71674def68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.340599 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d04e1-56d2-41ed-ba01-ee71674def68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:51.342071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d04e1-56d2-41ed-ba01-ee71674def68 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:51.344397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-155d04e1-56d2-41ed-ba01-ee71674def68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:51.360617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:51.361702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:51.362566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:51.362566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:51.362566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:51.362566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:51.362566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 250/504] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:51.362900 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d04e1-56d2-41ed-ba01-ee71674def68 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:51.424605 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9510d1c-2775-4fc8-a7e9-35e871b709f5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:51.457515 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e36a0-56b5-4e41-a12c-367ae4ff597d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:51.458166 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e36a0-56b5-4e41-a12c-367ae4ff597d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.458453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e36a0-56b5-4e41-a12c-367ae4ff597d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.458727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e36a0-56b5-4e41-a12c-367ae4ff597d None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.459474 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e36a0-56b5-4e41-a12c-367ae4ff597d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:51.459785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e36a0-56b5-4e41-a12c-367ae4ff597d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:51.461151 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e36a0-56b5-4e41-a12c-367ae4ff597d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:51.461379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d04e1-56d2-41ed-ba01-ee71674def68 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:51.473571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 255/505] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:51.474370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e36a0-56b5-4e41-a12c-367ae4ff597d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:51.491945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:51.495704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89040296-d641-40b9-b2e4-47868dc9a4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:51.496380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89040296-d641-40b9-b2e4-47868dc9a4db None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.496668 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89040296-d641-40b9-b2e4-47868dc9a4db None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.496945 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89040296-d641-40b9-b2e4-47868dc9a4db None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.497693 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89040296-d641-40b9-b2e4-47868dc9a4db None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:51.498003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89040296-d641-40b9-b2e4-47868dc9a4db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:51.499504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89040296-d641-40b9-b2e4-47868dc9a4db None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:51.507372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 251/506] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:28:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:51.508694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63df0c-7520-4b51-9eb1-5b6c406262f1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.509740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63df0c-7520-4b51-9eb1-5b6c406262f1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.509740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63df0c-7520-4b51-9eb1-5b6c406262f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.525612 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4d63df0c-7520-4b51-9eb1-5b6c406262f1 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:51.526799 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4d63df0c-7520-4b51-9eb1-5b6c406262f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:51.577113 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:51.577565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e36a0-56b5-4e41-a12c-367ae4ff597d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:51.599089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 252/507] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:51.600018 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63df0c-7520-4b51-9eb1-5b6c406262f1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:51.611013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74182d8-536d-4e34-b2e1-2711d74ad131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:51.611702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74182d8-536d-4e34-b2e1-2711d74ad131 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.611986 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74182d8-536d-4e34-b2e1-2711d74ad131 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.612263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74182d8-536d-4e34-b2e1-2711d74ad131 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.612986 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74182d8-536d-4e34-b2e1-2711d74ad131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:51.613297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74182d8-536d-4e34-b2e1-2711d74ad131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:51.614674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74182d8-536d-4e34-b2e1-2711d74ad131 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:51.626528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 256/508] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:51.627374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74182d8-536d-4e34-b2e1-2711d74ad131 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:51.702315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:51.710077 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63df0c-7520-4b51-9eb1-5b6c406262f1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:51.725502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74182d8-536d-4e34-b2e1-2711d74ad131 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:51.744826 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccbf63-c921-45e9-9d09-9ff9c589a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:51.745480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccbf63-c921-45e9-9d09-9ff9c589a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.745761 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccbf63-c921-45e9-9d09-9ff9c589a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.746034 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccbf63-c921-45e9-9d09-9ff9c589a9c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.746742 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccbf63-c921-45e9-9d09-9ff9c589a9c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:51.747041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccbf63-c921-45e9-9d09-9ff9c589a9c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:51.748471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccbf63-c921-45e9-9d09-9ff9c589a9c0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:51.758633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7044b5-bc35-4939-b0e5-52452d064fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:51.759284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 253/509] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:51.759416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7044b5-bc35-4939-b0e5-52452d064fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.759664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7044b5-bc35-4939-b0e5-52452d064fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.759944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7044b5-bc35-4939-b0e5-52452d064fe6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.760173 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccbf63-c921-45e9-9d09-9ff9c589a9c0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:51.769583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7044b5-bc35-4939-b0e5-52452d064fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:51.771038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7044b5-bc35-4939-b0e5-52452d064fe6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-5b7044b5-bc35-4939-b0e5-52452d064fe6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:28:51.785417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:51.786351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:51.787278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:51.787278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:51.787278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:28:51.787278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:28:51.787278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:28:51.787278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:28:51.787278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:28:51.787278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:28:51.787278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 20:28:51.787278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:51.787278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 257/510] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:28:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:51.787837 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7044b5-bc35-4939-b0e5-52452d064fe6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:51.813906 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:51.867612 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccbf63-c921-45e9-9d09-9ff9c589a9c0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:51.886752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7044b5-bc35-4939-b0e5-52452d064fe6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:51.901483 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464b3f8-45de-430c-864e-e30efe6f4717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:51.902277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464b3f8-45de-430c-864e-e30efe6f4717 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.902565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464b3f8-45de-430c-864e-e30efe6f4717 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.902852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464b3f8-45de-430c-864e-e30efe6f4717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.913656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464b3f8-45de-430c-864e-e30efe6f4717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:51.915125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464b3f8-45de-430c-864e-e30efe6f4717 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:51.920625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fb4a1-2896-4a0d-913f-9b2671e520bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:51.921407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fb4a1-2896-4a0d-913f-9b2671e520bc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:51.921691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fb4a1-2896-4a0d-913f-9b2671e520bc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:51.921967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fb4a1-2896-4a0d-913f-9b2671e520bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:51.924673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-6464b3f8-45de-430c-864e-e30efe6f4717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:51.931849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:51.932754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:51.933856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:51.933856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:51.933856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:51.933856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:51.934246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fb4a1-2896-4a0d-913f-9b2671e520bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:51.934317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 254/511] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:51.934317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464b3f8-45de-430c-864e-e30efe6f4717 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:51.934852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fb4a1-2896-4a0d-913f-9b2671e520bc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-660fb4a1-2896-4a0d-913f-9b2671e520bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:51.953865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:51.954874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:51.955782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:51.955782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:51.955782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:51.955782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:51.955782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 258/512] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:51.956042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fb4a1-2896-4a0d-913f-9b2671e520bc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:52.036486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:52.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464b3f8-45de-430c-864e-e30efe6f4717 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:52.058042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fb4a1-2896-4a0d-913f-9b2671e520bc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:52.074788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff6224-cd91-4b48-882e-c1bd9359504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:52.075609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff6224-cd91-4b48-882e-c1bd9359504a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:52.075891 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff6224-cd91-4b48-882e-c1bd9359504a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:52.076166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff6224-cd91-4b48-882e-c1bd9359504a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:52.083554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff6224-cd91-4b48-882e-c1bd9359504a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:52.085011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff6224-cd91-4b48-882e-c1bd9359504a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:52.091619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d6c3c-8a56-4e67-9afe-3a8e4e4be7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:52.092497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6c3c-8a56-4e67-9afe-3a8e4e4be7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:52.092895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6c3c-8a56-4e67-9afe-3a8e4e4be7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:52.093178 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6c3c-8a56-4e67-9afe-3a8e4e4be7a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:52.100093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d6c3c-8a56-4e67-9afe-3a8e4e4be7a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-bbff6224-cd91-4b48-882e-c1bd9359504a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:28:52.101027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:52.102036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:52.103134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:52.103134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:52.103134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:28:52.103134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:28:52.103134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:28:52.103134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:28:52.103134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:28:52.103134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:28:52.103134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:28:52.103134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:52.103813 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d6c3c-8a56-4e67-9afe-3a8e4e4be7a9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:52.103892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 255/513] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:52.103892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff6224-cd91-4b48-882e-c1bd9359504a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-978d6c3c-8a56-4e67-9afe-3a8e4e4be7a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:28:52.119350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:52.120208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:52.121036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:28:52.121036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:28:52.121036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:28:52.121036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:28:52.121036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:28:52.121036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:28:52.121036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:28:52.121036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:52.121036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 259/514] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:52.121517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d6c3c-8a56-4e67-9afe-3a8e4e4be7a9 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:52.169784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:52.206838 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff6224-cd91-4b48-882e-c1bd9359504a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:52.219925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d6c3c-8a56-4e67-9afe-3a8e4e4be7a9 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:52.240568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23731a-b8dd-46d9-a679-3819963b7069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:52.241240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23731a-b8dd-46d9-a679-3819963b7069 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:52.241528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23731a-b8dd-46d9-a679-3819963b7069 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:52.241801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23731a-b8dd-46d9-a679-3819963b7069 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:52.242631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23731a-b8dd-46d9-a679-3819963b7069 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:52.242939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23731a-b8dd-46d9-a679-3819963b7069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:52.244404 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23731a-b8dd-46d9-a679-3819963b7069 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:52.254334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee266c16-e7eb-489b-a319-b8dff327387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:52.254992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee266c16-e7eb-489b-a319-b8dff327387e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:52.255334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee266c16-e7eb-489b-a319-b8dff327387e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:52.255617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee266c16-e7eb-489b-a319-b8dff327387e None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:52.256332 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee266c16-e7eb-489b-a319-b8dff327387e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:52.256643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee266c16-e7eb-489b-a319-b8dff327387e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:52.257998 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee266c16-e7eb-489b-a319-b8dff327387e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:52.269971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 260/515] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:52.270898 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee266c16-e7eb-489b-a319-b8dff327387e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:52.282867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 256/516] 10.222.0.33 () {56 vars in 1139 bytes} [Wed Jul 6 20:28:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:52.283905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23731a-b8dd-46d9-a679-3819963b7069 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:52.301679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:52.372903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee266c16-e7eb-489b-a319-b8dff327387e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:52.381379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:52.383399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23731a-b8dd-46d9-a679-3819963b7069 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:52.406458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f0864-9fbf-412e-8590-813dfa9e79a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:52.407106 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f0864-9fbf-412e-8590-813dfa9e79a0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:52.407424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f0864-9fbf-412e-8590-813dfa9e79a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:52.407702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f0864-9fbf-412e-8590-813dfa9e79a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:52.408414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f0864-9fbf-412e-8590-813dfa9e79a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:52.408721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f0864-9fbf-412e-8590-813dfa9e79a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:52.410089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f0864-9fbf-412e-8590-813dfa9e79a0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:52.417120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34236510-c104-4ac1-8d97-6997e45e2eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:52.417787 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34236510-c104-4ac1-8d97-6997e45e2eac None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:52.418070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34236510-c104-4ac1-8d97-6997e45e2eac None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:52.418346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34236510-c104-4ac1-8d97-6997e45e2eac None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:52.419180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34236510-c104-4ac1-8d97-6997e45e2eac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:52.419510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34236510-c104-4ac1-8d97-6997e45e2eac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:52.421659 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34236510-c104-4ac1-8d97-6997e45e2eac None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:52.422057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 261/517] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:52.422838 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f0864-9fbf-412e-8590-813dfa9e79a0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:52.447409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 257/518] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Jul 6 20:28:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:52.447409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34236510-c104-4ac1-8d97-6997e45e2eac None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:52.520025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:52.528525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f0864-9fbf-412e-8590-813dfa9e79a0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:52.545995 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34236510-c104-4ac1-8d97-6997e45e2eac None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:52.563970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659b6c8-0817-4c40-a833-e2447549c27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:52.564564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b6c8-0817-4c40-a833-e2447549c27e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:52.564853 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b6c8-0817-4c40-a833-e2447549c27e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:52.565133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b6c8-0817-4c40-a833-e2447549c27e None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:52.565910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659b6c8-0817-4c40-a833-e2447549c27e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:52.566221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659b6c8-0817-4c40-a833-e2447549c27e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:52.567698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659b6c8-0817-4c40-a833-e2447549c27e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:52.579158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fa20e-6d3d-4f68-be64-3896496dd3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:52.579975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fa20e-6d3d-4f68-be64-3896496dd3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:52.580258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fa20e-6d3d-4f68-be64-3896496dd3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:52.580532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fa20e-6d3d-4f68-be64-3896496dd3d7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:52.585380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 262/519] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:28:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:52.586119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659b6c8-0817-4c40-a833-e2447549c27e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:52.587738 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fa20e-6d3d-4f68-be64-3896496dd3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:52.589403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fa20e-6d3d-4f68-be64-3896496dd3d7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b81fa20e-6d3d-4f68-be64-3896496dd3d7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:28:52.606624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:52.607571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:52.609084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:52.609084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:52.609084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:28:52.609084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:28:52.609084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:28:52.609084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:28:52.609084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:28:52.609084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:28:52.609084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 20:28:52.609084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:52.609084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 258/520] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:52.609649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fa20e-6d3d-4f68-be64-3896496dd3d7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:52.616167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:52.687636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659b6c8-0817-4c40-a833-e2447549c27e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:52.711399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fa20e-6d3d-4f68-be64-3896496dd3d7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:52.720231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec43c1-bd8b-44d7-8ca4-f065f47dc85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:52.720874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec43c1-bd8b-44d7-8ca4-f065f47dc85c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:52.721173 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec43c1-bd8b-44d7-8ca4-f065f47dc85c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:52.721429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec43c1-bd8b-44d7-8ca4-f065f47dc85c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:52.745037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbefaa-dd60-432b-b318-fc1c2ff418f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:52.745698 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbefaa-dd60-432b-b318-fc1c2ff418f1 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:52.745983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbefaa-dd60-432b-b318-fc1c2ff418f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:52.746267 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbefaa-dd60-432b-b318-fc1c2ff418f1 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:52.746956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbefaa-dd60-432b-b318-fc1c2ff418f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:52.749177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbefaa-dd60-432b-b318-fc1c2ff418f1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:52.755887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:52.769552 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 259/521] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:28:52 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:28:52.770355 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbefaa-dd60-432b-b318-fc1c2ff418f1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:52.796591 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec43c1-bd8b-44d7-8ca4-f065f47dc85c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:52.797811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec43c1-bd8b-44d7-8ca4-f065f47dc85c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:52.828657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:52.883533 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbefaa-dd60-432b-b318-fc1c2ff418f1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:52.915307 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 263/522] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:52.915307 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec43c1-bd8b-44d7-8ca4-f065f47dc85c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:52.926679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5228f-8db9-46d8-ac59-5dc234403417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:52.927386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5228f-8db9-46d8-ac59-5dc234403417 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:52.927675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5228f-8db9-46d8-ac59-5dc234403417 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:52.927949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5228f-8db9-46d8-ac59-5dc234403417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:53.002418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:53.016712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5228f-8db9-46d8-ac59-5dc234403417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:53.018181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5228f-8db9-46d8-ac59-5dc234403417 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:53.025773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec43c1-bd8b-44d7-8ca4-f065f47dc85c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:53.054983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:53.065103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1ad45-e07a-488f-9e25-8011d16afa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:53.065762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1ad45-e07a-488f-9e25-8011d16afa17 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:53.066049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1ad45-e07a-488f-9e25-8011d16afa17 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:53.066331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1ad45-e07a-488f-9e25-8011d16afa17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:53.067201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1ad45-e07a-488f-9e25-8011d16afa17 None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=3d68c8fdb65343b8b2f58070addeaf13) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:53.067518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1ad45-e07a-488f-9e25-8011d16afa17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:53.068969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1ad45-e07a-488f-9e25-8011d16afa17 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:53.074514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 264/523] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:52 2022] GET /identity/v3/role_assignments?user.id=3d68c8fdb65343b8b2f58070addeaf13&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:53.075321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1ad45-e07a-488f-9e25-8011d16afa17 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:53.156548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 260/524] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:53.157450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5228f-8db9-46d8-ac59-5dc234403417 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:53.196346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1ad45-e07a-488f-9e25-8011d16afa17 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:53.243502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf5b02-4ed8-426d-96a8-563f4006ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:53.244590 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf5b02-4ed8-426d-96a8-563f4006ede9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:53.245590 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf5b02-4ed8-426d-96a8-563f4006ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:53.245590 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf5b02-4ed8-426d-96a8-563f4006ede9 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:53.246001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf5b02-4ed8-426d-96a8-563f4006ede9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:53.246314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf5b02-4ed8-426d-96a8-563f4006ede9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:53.251226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf5b02-4ed8-426d-96a8-563f4006ede9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:53.263581 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:53.268957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 265/525] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Jul 6 20:28:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:53.269735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf5b02-4ed8-426d-96a8-563f4006ede9 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:53.274548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5228f-8db9-46d8-ac59-5dc234403417 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:53.319185 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19da5c-e6a8-41a6-82ab-5dbc74056df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:53.320261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19da5c-e6a8-41a6-82ab-5dbc74056df0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:53.320544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19da5c-e6a8-41a6-82ab-5dbc74056df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:53.320819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19da5c-e6a8-41a6-82ab-5dbc74056df0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:53.334501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19da5c-e6a8-41a6-82ab-5dbc74056df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:53.336739 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19da5c-e6a8-41a6-82ab-5dbc74056df0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:53.347578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0a19da5c-e6a8-41a6-82ab-5dbc74056df0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:53.360119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:53.361004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:53.361861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:53.361861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:53.361861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:53.361861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:53.361861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 261/526] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:53.362545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19da5c-e6a8-41a6-82ab-5dbc74056df0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:53.382306 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf5b02-4ed8-426d-96a8-563f4006ede9 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:53.418990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72d5d-4c7a-47c1-b8c0-f30de4fa9348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:53.421122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72d5d-4c7a-47c1-b8c0-f30de4fa9348 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:53.421603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72d5d-4c7a-47c1-b8c0-f30de4fa9348 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:53.422175 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72d5d-4c7a-47c1-b8c0-f30de4fa9348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:53.433461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc72d5d-4c7a-47c1-b8c0-f30de4fa9348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:53.435346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc72d5d-4c7a-47c1-b8c0-f30de4fa9348 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-8cc72d5d-4c7a-47c1-b8c0-f30de4fa9348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:53.455772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:53.456671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:53.457537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:53.457537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:53.457537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:53.457537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:53.460100 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 266/527] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:53.461133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72d5d-4c7a-47c1-b8c0-f30de4fa9348 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:53.486597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19da5c-e6a8-41a6-82ab-5dbc74056df0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:53.524386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab31e41-fbc6-416c-bf14-84ad17654d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:53.525441 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab31e41-fbc6-416c-bf14-84ad17654d2a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:53.525925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab31e41-fbc6-416c-bf14-84ad17654d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:53.526416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab31e41-fbc6-416c-bf14-84ad17654d2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:53.539388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:53.587896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72d5d-4c7a-47c1-b8c0-f30de4fa9348 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:53.598653 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:53.618363 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab31e41-fbc6-416c-bf14-84ad17654d2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:53.620436 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab31e41-fbc6-416c-bf14-84ad17654d2a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:53.631937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42b11d-802a-4938-9067-f9e47db766e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:53.632602 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42b11d-802a-4938-9067-f9e47db766e8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:53.632886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42b11d-802a-4938-9067-f9e47db766e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:53.633159 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42b11d-802a-4938-9067-f9e47db766e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:53.634180 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42b11d-802a-4938-9067-f9e47db766e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:53.634495 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42b11d-802a-4938-9067-f9e47db766e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:53.636130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42b11d-802a-4938-9067-f9e47db766e8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:53.650987 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 267/528] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:53.652240 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42b11d-802a-4938-9067-f9e47db766e8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:53.732308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 262/529] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:53.733716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab31e41-fbc6-416c-bf14-84ad17654d2a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:53.776469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42b11d-802a-4938-9067-f9e47db766e8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:53.781061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:53.818646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b37cc-8c02-42a2-af8e-aea87a3c5289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:53.819334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b37cc-8c02-42a2-af8e-aea87a3c5289 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:53.819617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b37cc-8c02-42a2-af8e-aea87a3c5289 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:53.819893 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b37cc-8c02-42a2-af8e-aea87a3c5289 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:53.820616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b37cc-8c02-42a2-af8e-aea87a3c5289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:53.820921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b37cc-8c02-42a2-af8e-aea87a3c5289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:53.822714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b37cc-8c02-42a2-af8e-aea87a3c5289 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:53.842827 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 268/530] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:53.842827 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b37cc-8c02-42a2-af8e-aea87a3c5289 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:53.860008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab31e41-fbc6-416c-bf14-84ad17654d2a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:53.869005 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:53.900578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069c517-1e75-4725-8e14-c7939af90782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:53.901833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069c517-1e75-4725-8e14-c7939af90782 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:53.902383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069c517-1e75-4725-8e14-c7939af90782 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:53.902865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069c517-1e75-4725-8e14-c7939af90782 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:53.911378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069c517-1e75-4725-8e14-c7939af90782 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:53.913230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069c517-1e75-4725-8e14-c7939af90782 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-6069c517-1e75-4725-8e14-c7939af90782 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:28:53.929272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:53.930135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:53.930969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:28:53.930969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:28:53.930969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:28:53.930969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:28:53.930969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:28:53.930969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:28:53.930969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:28:53.930969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:53.933503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 263/531] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:53.934795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069c517-1e75-4725-8e14-c7939af90782 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:53.948566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b37cc-8c02-42a2-af8e-aea87a3c5289 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:53.983951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591d307-8eaa-437b-ba6b-831bf6902451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:53.984871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591d307-8eaa-437b-ba6b-831bf6902451 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:53.984988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591d307-8eaa-437b-ba6b-831bf6902451 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:53.985196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591d307-8eaa-437b-ba6b-831bf6902451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:53.995458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591d307-8eaa-437b-ba6b-831bf6902451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:53.996906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591d307-8eaa-437b-ba6b-831bf6902451 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-c591d307-8eaa-437b-ba6b-831bf6902451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:54.020243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:54.021137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:54.021973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:54.021973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:54.021973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:54.021973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:54.021973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 269/532] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:54.022648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591d307-8eaa-437b-ba6b-831bf6902451 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:54.059654 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069c517-1e75-4725-8e14-c7939af90782 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:54.062024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:54.100921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8d85-76a6-4549-95cb-f65d1ceaa474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:54.101717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8d85-76a6-4549-95cb-f65d1ceaa474 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:54.102151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8d85-76a6-4549-95cb-f65d1ceaa474 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:54.102433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8d85-76a6-4549-95cb-f65d1ceaa474 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:54.109095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:54.111247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8d85-76a6-4549-95cb-f65d1ceaa474 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:54.113076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8d85-76a6-4549-95cb-f65d1ceaa474 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-daba8d85-76a6-4549-95cb-f65d1ceaa474 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:28:54.131571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:54.132462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:54.133279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:28:54.133279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:28:54.133279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:28:54.133279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:28:54.133279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:28:54.133279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:28:54.133279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:28:54.133279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:54.139251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 264/533] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:54.139251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8d85-76a6-4549-95cb-f65d1ceaa474 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:54.145341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591d307-8eaa-437b-ba6b-831bf6902451 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:54.184160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edddd9-573c-4947-baee-882f14dbfb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:54.185197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edddd9-573c-4947-baee-882f14dbfb47 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:54.185791 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edddd9-573c-4947-baee-882f14dbfb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:54.186313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edddd9-573c-4947-baee-882f14dbfb47 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:54.187406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edddd9-573c-4947-baee-882f14dbfb47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:54.187918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edddd9-573c-4947-baee-882f14dbfb47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:54.190056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edddd9-573c-4947-baee-882f14dbfb47 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:54.203965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 270/534] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:54.205566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edddd9-573c-4947-baee-882f14dbfb47 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:54.242725 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8d85-76a6-4549-95cb-f65d1ceaa474 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:54.279368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5eca5-a8df-4710-a039-2425b0e19614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:54.280094 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5eca5-a8df-4710-a039-2425b0e19614 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:54.280458 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5eca5-a8df-4710-a039-2425b0e19614 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:54.280736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5eca5-a8df-4710-a039-2425b0e19614 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:54.281462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5eca5-a8df-4710-a039-2425b0e19614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:54.281768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5eca5-a8df-4710-a039-2425b0e19614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:54.283186 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5eca5-a8df-4710-a039-2425b0e19614 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:54.296030 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 265/535] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:54.296954 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5eca5-a8df-4710-a039-2425b0e19614 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:54.322259 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:54.324284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edddd9-573c-4947-baee-882f14dbfb47 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:54.362919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3507f7f-4234-44a0-843e-9497a0bf6e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:54.363968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507f7f-4234-44a0-843e-9497a0bf6e88 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:54.364558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507f7f-4234-44a0-843e-9497a0bf6e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:54.365088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507f7f-4234-44a0-843e-9497a0bf6e88 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:54.366166 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3507f7f-4234-44a0-843e-9497a0bf6e88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:54.366693 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3507f7f-4234-44a0-843e-9497a0bf6e88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:54.368691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3507f7f-4234-44a0-843e-9497a0bf6e88 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:54.370599 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:54.388096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 271/536] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:54.389506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3507f7f-4234-44a0-843e-9497a0bf6e88 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:54.403304 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5eca5-a8df-4710-a039-2425b0e19614 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:54.440310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9530733-9da1-472b-b07a-5d2592676439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:54.440940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9530733-9da1-472b-b07a-5d2592676439 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:54.441224 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9530733-9da1-472b-b07a-5d2592676439 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:54.441498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9530733-9da1-472b-b07a-5d2592676439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:54.442431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9530733-9da1-472b-b07a-5d2592676439 None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=d7bb4a244df24a19b4c3ad3d1ad2bc7c) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:54.442747 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9530733-9da1-472b-b07a-5d2592676439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:54.444324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9530733-9da1-472b-b07a-5d2592676439 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:54.450572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 266/537] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:54 2022] GET /identity/v3/role_assignments?user.id=d7bb4a244df24a19b4c3ad3d1ad2bc7c&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:54.451557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9530733-9da1-472b-b07a-5d2592676439 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:54.506246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3507f7f-4234-44a0-843e-9497a0bf6e88 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:54.552393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:54.559968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af9ce0-0be9-4060-89fd-b4a6e58e1a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:54.561972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af9ce0-0be9-4060-89fd-b4a6e58e1a56 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:54.562477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af9ce0-0be9-4060-89fd-b4a6e58e1a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:54.562951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af9ce0-0be9-4060-89fd-b4a6e58e1a56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:54.565950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9530733-9da1-472b-b07a-5d2592676439 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:54.571271 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af9ce0-0be9-4060-89fd-b4a6e58e1a56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:54.579226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af9ce0-0be9-4060-89fd-b4a6e58e1a56 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-c2af9ce0-0be9-4060-89fd-b4a6e58e1a56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:28:54.614434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:54.615350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:54.616176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:28:54.616176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:28:54.616176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:28:54.616176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:28:54.616176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:28:54.616176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:28:54.616176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:28:54.616176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:54.616578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f29347-b2e8-4499-aeb0-8c3e59618a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:54.616665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 272/538] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:54.616731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f29347-b2e8-4499-aeb0-8c3e59618a48 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:54.616946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f29347-b2e8-4499-aeb0-8c3e59618a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:54.621509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f29347-b2e8-4499-aeb0-8c3e59618a48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:54.621509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f29347-b2e8-4499-aeb0-8c3e59618a48 None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=4693da03c42e4328b74869abd0ae4b80) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:54.621509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f29347-b2e8-4499-aeb0-8c3e59618a48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:54.621509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f29347-b2e8-4499-aeb0-8c3e59618a48 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:54.622853 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af9ce0-0be9-4060-89fd-b4a6e58e1a56 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:54.632834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 267/539] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:54 2022] GET /identity/v3/role_assignments?user.id=4693da03c42e4328b74869abd0ae4b80&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:54.734463 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:54.793824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af9ce0-0be9-4060-89fd-b4a6e58e1a56 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:54.832889 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6258ccf-d5a9-4aa3-ac17-29bfd7c27938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:54.833565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258ccf-d5a9-4aa3-ac17-29bfd7c27938 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:54.833850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258ccf-d5a9-4aa3-ac17-29bfd7c27938 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:54.834129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258ccf-d5a9-4aa3-ac17-29bfd7c27938 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:54.835849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6258ccf-d5a9-4aa3-ac17-29bfd7c27938 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:54.835849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6258ccf-d5a9-4aa3-ac17-29bfd7c27938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:54.836703 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6258ccf-d5a9-4aa3-ac17-29bfd7c27938 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:54.850395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 273/540] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:54.856449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f29347-b2e8-4499-aeb0-8c3e59618a48 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:54.912078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe62fc5-e8b0-4822-b918-2094c7869cb3 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:54.912679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe62fc5-e8b0-4822-b918-2094c7869cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:54.913135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe62fc5-e8b0-4822-b918-2094c7869cb3 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:54.914700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 274/541] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:28:54.919830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49f996-abd7-4393-b959-f2a29f5d513b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:54.920657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49f996-abd7-4393-b959-f2a29f5d513b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:54.920934 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49f996-abd7-4393-b959-f2a29f5d513b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:54.938348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ec49f996-abd7-4393-b959-f2a29f5d513b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:54.939560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ec49f996-abd7-4393-b959-f2a29f5d513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:55.022052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f29347-b2e8-4499-aeb0-8c3e59618a48 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:55.045404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 275/542] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:55.070544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49f996-abd7-4393-b959-f2a29f5d513b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:55.094806 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce92e2b-6769-4443-89f8-b74c588b923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:55.095602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce92e2b-6769-4443-89f8-b74c588b923d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:55.095885 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce92e2b-6769-4443-89f8-b74c588b923d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:55.096160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce92e2b-6769-4443-89f8-b74c588b923d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:55.096989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce92e2b-6769-4443-89f8-b74c588b923d None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=f892e618b01a46aaaab4f79aa0c3daa9) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:55.097301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce92e2b-6769-4443-89f8-b74c588b923d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:55.099076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce92e2b-6769-4443-89f8-b74c588b923d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:55.113284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 268/543] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:54 2022] GET /identity/v3/role_assignments?user.id=f892e618b01a46aaaab4f79aa0c3daa9&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:55.141141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:55.232906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49f996-abd7-4393-b959-f2a29f5d513b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:55.272201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f37b78-f7ed-4bc6-999f-dfc4eb9d3a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:55.273005 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f37b78-f7ed-4bc6-999f-dfc4eb9d3a5b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:55.273312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f37b78-f7ed-4bc6-999f-dfc4eb9d3a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:55.273592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f37b78-f7ed-4bc6-999f-dfc4eb9d3a5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:55.276132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52162cea-a51d-4e65-9765-3cc9c4e7a030 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:55.276416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52162cea-a51d-4e65-9765-3cc9c4e7a030 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:55.276696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52162cea-a51d-4e65-9765-3cc9c4e7a030 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:55.278204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 269/544] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:28:55.284409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c814af-5b9d-4ede-b818-491a88545984 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:55.285462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c814af-5b9d-4ede-b818-491a88545984 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:55.286029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c814af-5b9d-4ede-b818-491a88545984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:55.290495 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f37b78-f7ed-4bc6-999f-dfc4eb9d3a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-28f37b78-f7ed-4bc6-999f-dfc4eb9d3a5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:55.300778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:55.301677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:55.302473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:55.302473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:55.302473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:55.302473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:55.302473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:55.302473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:55.302473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:55.302473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:55.302473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:55.302473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:55.302473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:55.302473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:55.302473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 276/545] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:28:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:55.309079 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f37b78-f7ed-4bc6-999f-dfc4eb9d3a5b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:55.312707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-87c814af-5b9d-4ede-b818-491a88545984 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:55.314310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-87c814af-5b9d-4ede-b818-491a88545984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:55.332869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:55.458088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 270/546] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:28:55.471280 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f37b78-f7ed-4bc6-999f-dfc4eb9d3a5b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:55.483202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:55.521079 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89409dc1-bd30-4c16-aa26-18f3d551e434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:55.521760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89409dc1-bd30-4c16-aa26-18f3d551e434 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:55.522050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89409dc1-bd30-4c16-aa26-18f3d551e434 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:55.522332 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89409dc1-bd30-4c16-aa26-18f3d551e434 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:55.523083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89409dc1-bd30-4c16-aa26-18f3d551e434 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:55.525875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89409dc1-bd30-4c16-aa26-18f3d551e434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:55.526787 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c814af-5b9d-4ede-b818-491a88545984 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:55.527324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89409dc1-bd30-4c16-aa26-18f3d551e434 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:55.536599 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 277/547] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:28:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:55.542396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89409dc1-bd30-4c16-aa26-18f3d551e434 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:55.681080 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c814af-5b9d-4ede-b818-491a88545984 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:55.726381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8feb0e-9085-490e-8432-6e2dd3a67b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:55.727194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8feb0e-9085-490e-8432-6e2dd3a67b57 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:55.727485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8feb0e-9085-490e-8432-6e2dd3a67b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:55.727757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8feb0e-9085-490e-8432-6e2dd3a67b57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:55.741084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89409dc1-bd30-4c16-aa26-18f3d551e434 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:55.753449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8feb0e-9085-490e-8432-6e2dd3a67b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ee8feb0e-9085-490e-8432-6e2dd3a67b57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:55.762403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:55.763328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:55.764650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:55.764650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:55.764650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:55.764650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:55.764650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:55.764650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:55.764650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:55.764650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:55.764650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:55.764650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:55.764650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:55.764650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:55.764650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 271/548] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:28:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:55.776265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8feb0e-9085-490e-8432-6e2dd3a67b57 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:55.782520 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:55.796156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0265316-4e8c-4e82-97d8-9bdbab49634c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:55.796946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0265316-4e8c-4e82-97d8-9bdbab49634c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:55.797224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0265316-4e8c-4e82-97d8-9bdbab49634c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:55.797491 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0265316-4e8c-4e82-97d8-9bdbab49634c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:55.824247 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0265316-4e8c-4e82-97d8-9bdbab49634c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:55.825693 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0265316-4e8c-4e82-97d8-9bdbab49634c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-f0265316-4e8c-4e82-97d8-9bdbab49634c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:55.873368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:55.874700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:55.875823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:55.875823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:55.875823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:55.875823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:55.875823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 278/549] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:55.879980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0265316-4e8c-4e82-97d8-9bdbab49634c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:55.903271 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:55.917784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8feb0e-9085-490e-8432-6e2dd3a67b57 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:55.981204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a2abb-b550-4e22-9d73-76d742ad3270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:55.982266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a2abb-b550-4e22-9d73-76d742ad3270 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:55.982887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a2abb-b550-4e22-9d73-76d742ad3270 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:55.984152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a2abb-b550-4e22-9d73-76d742ad3270 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:55.985757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a2abb-b550-4e22-9d73-76d742ad3270 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:55.986434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a2abb-b550-4e22-9d73-76d742ad3270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:55.989434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a2abb-b550-4e22-9d73-76d742ad3270 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:56.006088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 272/550] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:28:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:56.013374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a2abb-b550-4e22-9d73-76d742ad3270 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:56.067489 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0265316-4e8c-4e82-97d8-9bdbab49634c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:56.137336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:56.138613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0bb01-b1d2-4d8c-be69-c732e7f03a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:56.139765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0bb01-b1d2-4d8c-be69-c732e7f03a06 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:56.141215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0bb01-b1d2-4d8c-be69-c732e7f03a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:56.142285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0bb01-b1d2-4d8c-be69-c732e7f03a06 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:56.143510 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0bb01-b1d2-4d8c-be69-c732e7f03a06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:56.144437 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0bb01-b1d2-4d8c-be69-c732e7f03a06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:56.146170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0bb01-b1d2-4d8c-be69-c732e7f03a06 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:56.171924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 279/551] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:56.177353 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0bb01-b1d2-4d8c-be69-c732e7f03a06 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:56.206576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a2abb-b550-4e22-9d73-76d742ad3270 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:56.273056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9e689-e559-420c-838e-28158f6bd4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:56.274205 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9e689-e559-420c-838e-28158f6bd4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:56.274851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9e689-e559-420c-838e-28158f6bd4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:56.276493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9e689-e559-420c-838e-28158f6bd4d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:56.291857 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9e689-e559-420c-838e-28158f6bd4d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:56.294243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9e689-e559-420c-838e-28158f6bd4d2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1ec9e689-e559-420c-838e-28158f6bd4d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:56.315660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:56.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:56.317557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:56.317557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:56.317557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:56.317557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:56.319832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 273/552] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:56.322502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:56.327750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9e689-e559-420c-838e-28158f6bd4d2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:56.365373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0bb01-b1d2-4d8c-be69-c732e7f03a06 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:56.441293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47099f-ae9a-49dd-84c6-72effd07fd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:56.442505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47099f-ae9a-49dd-84c6-72effd07fd1a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:56.443016 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47099f-ae9a-49dd-84c6-72effd07fd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:56.443542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47099f-ae9a-49dd-84c6-72effd07fd1a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:56.459739 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47099f-ae9a-49dd-84c6-72effd07fd1a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:56.461206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47099f-ae9a-49dd-84c6-72effd07fd1a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-cd47099f-ae9a-49dd-84c6-72effd07fd1a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:28:56.487866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:56.488863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:56.489785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:56.489785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:56.489785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:28:56.489785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:28:56.489785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:28:56.489785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:28:56.489785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:28:56.489785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:28:56.489785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:28:56.489785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:56.490424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 280/553] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:28:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:28:56.498958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47099f-ae9a-49dd-84c6-72effd07fd1a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:56.515932 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9e689-e559-420c-838e-28158f6bd4d2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:56.555965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:56.603215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccad454-f2eb-4370-9942-13d9a9461a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:56.603882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccad454-f2eb-4370-9942-13d9a9461a94 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:56.604171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccad454-f2eb-4370-9942-13d9a9461a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:56.604446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccad454-f2eb-4370-9942-13d9a9461a94 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:56.605343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccad454-f2eb-4370-9942-13d9a9461a94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:56.605653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccad454-f2eb-4370-9942-13d9a9461a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:56.608004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccad454-f2eb-4370-9942-13d9a9461a94 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:56.629234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 274/554] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:28:56.635888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccad454-f2eb-4370-9942-13d9a9461a94 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:56.691873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47099f-ae9a-49dd-84c6-72effd07fd1a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:56.752196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b643593-5079-46e8-a7fa-43cc99979968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:56.754174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b643593-5079-46e8-a7fa-43cc99979968 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:56.755524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b643593-5079-46e8-a7fa-43cc99979968 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:56.756031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b643593-5079-46e8-a7fa-43cc99979968 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:56.758247 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b643593-5079-46e8-a7fa-43cc99979968 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:56.760967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b643593-5079-46e8-a7fa-43cc99979968 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:56.762643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b643593-5079-46e8-a7fa-43cc99979968 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:56.782511 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:56.800463 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 281/555] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Jul 6 20:28:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:56.806320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b643593-5079-46e8-a7fa-43cc99979968 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:56.850321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccad454-f2eb-4370-9942-13d9a9461a94 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:56.926982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b643593-5079-46e8-a7fa-43cc99979968 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:56.965106 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad54056-97c2-4c3c-8a47-2cd3530c62b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:56.966004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad54056-97c2-4c3c-8a47-2cd3530c62b3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:56.966432 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad54056-97c2-4c3c-8a47-2cd3530c62b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:56.967623 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad54056-97c2-4c3c-8a47-2cd3530c62b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:56.999912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd0a0f-b8fe-494c-a90a-5566120c1187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:57.000722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0a0f-b8fe-494c-a90a-5566120c1187 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.001006 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0a0f-b8fe-494c-a90a-5566120c1187 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.001279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0a0f-b8fe-494c-a90a-5566120c1187 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.024039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd0a0f-b8fe-494c-a90a-5566120c1187 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:57.025514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd0a0f-b8fe-494c-a90a-5566120c1187 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:57.042571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad54056-97c2-4c3c-8a47-2cd3530c62b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:57.044508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad54056-97c2-4c3c-8a47-2cd3530c62b3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:57.047708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-52bd0a0f-b8fe-494c-a90a-5566120c1187 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:28:57.055151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:57.056593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:57.057916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:57.057916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:57.057916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:28:57.057916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:28:57.057916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:28:57.057916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:28:57.057916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:28:57.057916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:28:57.057916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:28:57.057916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:57.057916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 275/556] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jul 6 20:28:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:57.058507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fe69c-8b92-4b33-a559-f79189f2c3b3 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.058507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fe69c-8b92-4b33-a559-f79189f2c3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.058935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fe69c-8b92-4b33-a559-f79189f2c3b3 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.065061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 276/557] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:57.065858 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fe69c-8b92-4b33-a559-f79189f2c3b3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:57.112469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:57.176160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 282/558] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:28:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:28:57.177939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7849c0-6504-4824-b970-0f7c062fddd3 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.178290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7849c0-6504-4824-b970-0f7c062fddd3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.178634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7849c0-6504-4824-b970-0f7c062fddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.189474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fe69c-8b92-4b33-a559-f79189f2c3b3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:57.197314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2b7849c0-6504-4824-b970-0f7c062fddd3 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:57.198504 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2b7849c0-6504-4824-b970-0f7c062fddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:57.229390 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fb5e1-cfe1-4f5c-b377-6b629be7cdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:57.230437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fb5e1-cfe1-4f5c-b377-6b629be7cdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.230722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fb5e1-cfe1-4f5c-b377-6b629be7cdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.230999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fb5e1-cfe1-4f5c-b377-6b629be7cdf1 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.232058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fb5e1-cfe1-4f5c-b377-6b629be7cdf1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:57.232490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fb5e1-cfe1-4f5c-b377-6b629be7cdf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:57.233947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fb5e1-cfe1-4f5c-b377-6b629be7cdf1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:57.255516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 277/559] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jul 6 20:28:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:57.257887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada3abb-be47-442f-8b2b-1784e487d794 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.258181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada3abb-be47-442f-8b2b-1784e487d794 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.258460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada3abb-be47-442f-8b2b-1784e487d794 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.259871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 278/560] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:57.260472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada3abb-be47-442f-8b2b-1784e487d794 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:57.272554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 283/561] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:57.280931 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7849c0-6504-4824-b970-0f7c062fddd3 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:57.313292 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:57.366839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:57.374927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada3abb-be47-442f-8b2b-1784e487d794 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:57.389922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7849c0-6504-4824-b970-0f7c062fddd3 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:57.412576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b4817-9d20-4f26-b880-29ae2fc2215b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:57.413522 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4817-9d20-4f26-b880-29ae2fc2215b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.413810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4817-9d20-4f26-b880-29ae2fc2215b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.414092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4817-9d20-4f26-b880-29ae2fc2215b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.425252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b4817-9d20-4f26-b880-29ae2fc2215b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:57.425620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c05cb1-7ef9-4c00-bf58-3ad7d975daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:57.426415 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c05cb1-7ef9-4c00-bf58-3ad7d975daa3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.426694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c05cb1-7ef9-4c00-bf58-3ad7d975daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.426791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b4817-9d20-4f26-b880-29ae2fc2215b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:57.426966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c05cb1-7ef9-4c00-bf58-3ad7d975daa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.438267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c05cb1-7ef9-4c00-bf58-3ad7d975daa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:57.439741 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c05cb1-7ef9-4c00-bf58-3ad7d975daa3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-363b4817-9d20-4f26-b880-29ae2fc2215b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:57.445281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:57.446148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:57.447043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:57.447043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:57.447043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:57.447043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:57.447043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 279/562] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:57.447875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1500f-3a05-43d0-bf47-0e8e91af114d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.447947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1500f-3a05-43d0-bf47-0e8e91af114d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.448486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1500f-3a05-43d0-bf47-0e8e91af114d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-84c05cb1-7ef9-4c00-bf58-3ad7d975daa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:57.462642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:57.463641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:57.464529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:57.464529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:57.464529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:57.464529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:57.464529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 284/563] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:57.465277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-20a1500f-3a05-43d0-bf47-0e8e91af114d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:57.465364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c05cb1-7ef9-4c00-bf58-3ad7d975daa3 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:57.466250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-20a1500f-3a05-43d0-bf47-0e8e91af114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:57.535326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 280/564] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:57.536098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1500f-3a05-43d0-bf47-0e8e91af114d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:57.552463 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:57.577199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c05cb1-7ef9-4c00-bf58-3ad7d975daa3 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:57.612945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708c3d3-7007-4211-974e-80f6d3a866e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:57.613739 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708c3d3-7007-4211-974e-80f6d3a866e3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.614043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708c3d3-7007-4211-974e-80f6d3a866e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.614321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708c3d3-7007-4211-974e-80f6d3a866e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.624397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708c3d3-7007-4211-974e-80f6d3a866e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:57.624524 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-a708c3d3-7007-4211-974e-80f6d3a866e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:57.632649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:57.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 285/565] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:28:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:57.639759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977f799-8d12-408f-938b-dafb6f999c55 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.640527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977f799-8d12-408f-938b-dafb6f999c55 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.640527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977f799-8d12-408f-938b-dafb6f999c55 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.640527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 286/566] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:28:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:28:57.640527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977f799-8d12-408f-938b-dafb6f999c55 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:57.647408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1500f-3a05-43d0-bf47-0e8e91af114d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:57.681211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dfdc5-6e5d-4684-9b8d-46d68539972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:57.681873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dfdc5-6e5d-4684-9b8d-46d68539972e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.682156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dfdc5-6e5d-4684-9b8d-46d68539972e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.682433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dfdc5-6e5d-4684-9b8d-46d68539972e None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.683158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dfdc5-6e5d-4684-9b8d-46d68539972e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:57.683504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dfdc5-6e5d-4684-9b8d-46d68539972e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:57.684878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dfdc5-6e5d-4684-9b8d-46d68539972e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:57.697234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 281/567] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:57.698037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dfdc5-6e5d-4684-9b8d-46d68539972e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:57.747362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977f799-8d12-408f-938b-dafb6f999c55 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:57.780398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7ac03-af14-443a-881b-54555266dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:57.781057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7ac03-af14-443a-881b-54555266dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.781344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7ac03-af14-443a-881b-54555266dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.781626 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7ac03-af14-443a-881b-54555266dbf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.782345 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7ac03-af14-443a-881b-54555266dbf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:57.782657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7ac03-af14-443a-881b-54555266dbf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:57.784077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7ac03-af14-443a-881b-54555266dbf0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:57.790828 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:57.796063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dfdc5-6e5d-4684-9b8d-46d68539972e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:57.797708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 287/568] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:57.798497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7ac03-af14-443a-881b-54555266dbf0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:57.829469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a47497-920e-4fbd-9714-a91be0d7422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:57.830261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47497-920e-4fbd-9714-a91be0d7422b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.830544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47497-920e-4fbd-9714-a91be0d7422b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.830819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47497-920e-4fbd-9714-a91be0d7422b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.837419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:57.842187 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a47497-920e-4fbd-9714-a91be0d7422b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-36a47497-920e-4fbd-9714-a91be0d7422b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:57.850144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:57.851096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:57.851960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:57.851960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:57.851960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:57.851960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:57.851960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:57.851960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:57.851960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:57.851960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:57.851960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:57.851960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:57.851960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:57.851960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:57.851960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 282/569] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:28:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:57.852815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132a0c0-7db0-4ac7-afc0-709268bd288d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.852887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132a0c0-7db0-4ac7-afc0-709268bd288d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.853132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132a0c0-7db0-4ac7-afc0-709268bd288d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.869447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5132a0c0-7db0-4ac7-afc0-709268bd288d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:28:57.870624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5132a0c0-7db0-4ac7-afc0-709268bd288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:28:57.901708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7ac03-af14-443a-881b-54555266dbf0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:57.935079 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 283/570] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:28:57.935765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b4c03-aea3-4d8c-8b6d-058afd50abd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:57.936009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132a0c0-7db0-4ac7-afc0-709268bd288d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:57.936479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b4c03-aea3-4d8c-8b6d-058afd50abd5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:57.936765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b4c03-aea3-4d8c-8b6d-058afd50abd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:57.937038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b4c03-aea3-4d8c-8b6d-058afd50abd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:57.937778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b4c03-aea3-4d8c-8b6d-058afd50abd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:57.938093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b4c03-aea3-4d8c-8b6d-058afd50abd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:57.939471 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b4c03-aea3-4d8c-8b6d-058afd50abd5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:57.955154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 288/571] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:28:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:57.956077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b4c03-aea3-4d8c-8b6d-058afd50abd5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:58.012123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:58.036264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132a0c0-7db0-4ac7-afc0-709268bd288d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:58.053111 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b4c03-aea3-4d8c-8b6d-058afd50abd5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:58.063609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:58.071588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e2b2d-b974-493e-b05a-a213d09e884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:58.072373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e2b2d-b974-493e-b05a-a213d09e884a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.072663 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e2b2d-b974-493e-b05a-a213d09e884a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.072941 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e2b2d-b974-493e-b05a-a213d09e884a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.080281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e2b2d-b974-493e-b05a-a213d09e884a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:58.081736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e2b2d-b974-493e-b05a-a213d09e884a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:58.086119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1baf2-52e1-4ad6-ace8-e580f15636bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:58.086899 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1baf2-52e1-4ad6-ace8-e580f15636bc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.087201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1baf2-52e1-4ad6-ace8-e580f15636bc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.087477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1baf2-52e1-4ad6-ace8-e580f15636bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.094405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1baf2-52e1-4ad6-ace8-e580f15636bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ac5e2b2d-b974-493e-b05a-a213d09e884a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:28:58.095383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:58.096375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:58.097330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:28:58.097330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:28:58.097330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:28:58.097330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:28:58.097330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:28:58.097330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:28:58.097330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:28:58.097330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:58.097783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1baf2-52e1-4ad6-ace8-e580f15636bc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:58.097854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 284/572] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:58.097854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e2b2d-b974-493e-b05a-a213d09e884a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-cff1baf2-52e1-4ad6-ace8-e580f15636bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:28:58.114221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:58.115268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:58.116179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:28:58.116179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:28:58.116179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:28:58.116179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:28:58.116179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:28:58.116179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:28:58.116179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:28:58.116179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:58.116179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 289/573] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:58.116649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1baf2-52e1-4ad6-ace8-e580f15636bc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:58.203827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e2b2d-b974-493e-b05a-a213d09e884a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:58.215263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1baf2-52e1-4ad6-ace8-e580f15636bc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:58.235371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:58.237471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de51d0-6253-4376-bad6-7453cde8ec35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:58.238145 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de51d0-6253-4376-bad6-7453cde8ec35 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.238428 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de51d0-6253-4376-bad6-7453cde8ec35 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.238702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de51d0-6253-4376-bad6-7453cde8ec35 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.239478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de51d0-6253-4376-bad6-7453cde8ec35 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:58.239796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de51d0-6253-4376-bad6-7453cde8ec35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:58.241166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de51d0-6253-4376-bad6-7453cde8ec35 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:58.249584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 285/574] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:28:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:58.250363 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de51d0-6253-4376-bad6-7453cde8ec35 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:58.250487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783eeb18-681e-43ae-a8a6-1fb82af545bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:58.251297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eeb18-681e-43ae-a8a6-1fb82af545bc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.251582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eeb18-681e-43ae-a8a6-1fb82af545bc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.251855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eeb18-681e-43ae-a8a6-1fb82af545bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.261914 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783eeb18-681e-43ae-a8a6-1fb82af545bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-783eeb18-681e-43ae-a8a6-1fb82af545bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:28:58.270445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:58.271567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:58.272407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:58.272407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:58.272407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:58.272407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:58.272407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:28:58.272407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:28:58.272407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:28:58.272407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:28:58.272407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:28:58.272407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:28:58.272407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:28:58.272407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:58.272407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 290/575] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:28:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:58.273088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783eeb18-681e-43ae-a8a6-1fb82af545bc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:58.303749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:58.355473 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de51d0-6253-4376-bad6-7453cde8ec35 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:58.371044 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783eeb18-681e-43ae-a8a6-1fb82af545bc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:58.389111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865db985-d388-40ce-a383-8927ef37b5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:58.389914 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865db985-d388-40ce-a383-8927ef37b5ac None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.390208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865db985-d388-40ce-a383-8927ef37b5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.390529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865db985-d388-40ce-a383-8927ef37b5ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.401068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865db985-d388-40ce-a383-8927ef37b5ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:58.402543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865db985-d388-40ce-a383-8927ef37b5ac None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:58.404530 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dd4ba-d8c0-43ff-bd72-2d366a58ee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:58.405501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dd4ba-d8c0-43ff-bd72-2d366a58ee5b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.405615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dd4ba-d8c0-43ff-bd72-2d366a58ee5b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.405807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dd4ba-d8c0-43ff-bd72-2d366a58ee5b None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.406582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dd4ba-d8c0-43ff-bd72-2d366a58ee5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:58.406894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dd4ba-d8c0-43ff-bd72-2d366a58ee5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:58.408356 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dd4ba-d8c0-43ff-bd72-2d366a58ee5b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:58.420084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 291/576] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:58.425283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dd4ba-d8c0-43ff-bd72-2d366a58ee5b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-865db985-d388-40ce-a383-8927ef37b5ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:58.425446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:58.426484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:58.427666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:58.427666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:58.427666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:58.427666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:58.427666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 286/577] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:58.427666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865db985-d388-40ce-a383-8927ef37b5ac None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:58.465238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:58.522586 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dd4ba-d8c0-43ff-bd72-2d366a58ee5b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:58.524980 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865db985-d388-40ce-a383-8927ef37b5ac None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:58.526499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:58.555840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b2ff6-3a30-4692-80ee-d590bcee48d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:58.556423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b2ff6-3a30-4692-80ee-d590bcee48d0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.556702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b2ff6-3a30-4692-80ee-d590bcee48d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.556974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b2ff6-3a30-4692-80ee-d590bcee48d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.557753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b2ff6-3a30-4692-80ee-d590bcee48d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:58.558058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b2ff6-3a30-4692-80ee-d590bcee48d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:58.558148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1193a3-ad30-451a-afac-0ba75ecd3cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:58.558911 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1193a3-ad30-451a-afac-0ba75ecd3cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.559218 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1193a3-ad30-451a-afac-0ba75ecd3cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.559496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b2ff6-3a30-4692-80ee-d590bcee48d0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:58.559587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1193a3-ad30-451a-afac-0ba75ecd3cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.570174 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1193a3-ad30-451a-afac-0ba75ecd3cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:58.570692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 292/578] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:58.571496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b2ff6-3a30-4692-80ee-d590bcee48d0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:58.571669 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1193a3-ad30-451a-afac-0ba75ecd3cb2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1a1193a3-ad30-451a-afac-0ba75ecd3cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:58.596512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:58.597543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:58.598439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:58.598439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:58.598439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:58.598439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:58.598439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 287/579] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:58.598711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1193a3-ad30-451a-afac-0ba75ecd3cb2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:58.670461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:58.673946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b2ff6-3a30-4692-80ee-d590bcee48d0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:58.696047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1193a3-ad30-451a-afac-0ba75ecd3cb2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:58.708283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd6a66-e458-4717-a0a2-b63dcff3737c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:58.708949 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6a66-e458-4717-a0a2-b63dcff3737c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.709232 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6a66-e458-4717-a0a2-b63dcff3737c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.709511 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6a66-e458-4717-a0a2-b63dcff3737c None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.710255 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd6a66-e458-4717-a0a2-b63dcff3737c None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:58.710566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd6a66-e458-4717-a0a2-b63dcff3737c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:58.711964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd6a66-e458-4717-a0a2-b63dcff3737c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:58.719782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 293/580] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:28:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:58.720855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd6a66-e458-4717-a0a2-b63dcff3737c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:58.733317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2f2bf-53cb-4fe3-81f4-67c87f8cdd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:58.733975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2f2bf-53cb-4fe3-81f4-67c87f8cdd0c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.734254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2f2bf-53cb-4fe3-81f4-67c87f8cdd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.734554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2f2bf-53cb-4fe3-81f4-67c87f8cdd0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.735403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2f2bf-53cb-4fe3-81f4-67c87f8cdd0c None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=88dff378ccb4497fb305563614ea4caa) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:58.735715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2f2bf-53cb-4fe3-81f4-67c87f8cdd0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:58.737143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2f2bf-53cb-4fe3-81f4-67c87f8cdd0c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:58.742501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 288/581] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:28:58 2022] GET /identity/v3/role_assignments?user.id=88dff378ccb4497fb305563614ea4caa&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:58.743386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2f2bf-53cb-4fe3-81f4-67c87f8cdd0c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:58.776869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:58.836814 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd6a66-e458-4717-a0a2-b63dcff3737c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:58.871474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2f2bf-53cb-4fe3-81f4-67c87f8cdd0c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:58.874950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ddd48-d33d-460c-8e20-7c0db1151d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:58.875738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ddd48-d33d-460c-8e20-7c0db1151d9f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.876024 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ddd48-d33d-460c-8e20-7c0db1151d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.876390 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ddd48-d33d-460c-8e20-7c0db1151d9f None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.877027 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ddd48-d33d-460c-8e20-7c0db1151d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:58.877333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ddd48-d33d-460c-8e20-7c0db1151d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:58.878748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ddd48-d33d-460c-8e20-7c0db1151d9f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:58.891646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 294/582] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:58.892507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ddd48-d33d-460c-8e20-7c0db1151d9f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:58.914315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f460b9-5256-4c68-adcb-4449a86d73cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:58.915247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f460b9-5256-4c68-adcb-4449a86d73cc None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:58.915538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f460b9-5256-4c68-adcb-4449a86d73cc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:58.915816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f460b9-5256-4c68-adcb-4449a86d73cc None admin] PATH_INFO: `/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/3d68c8fdb65343b8b2f58070addeaf13/roles/55dba566c5b54bc488719c0c5bb0ce15` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:58.923647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:58.931616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f460b9-5256-4c68-adcb-4449a86d73cc None admin] RBAC: Authorizing `identity:create_grant(project_id=8eda6c9cf4b1439eb280b0db35b3bce2, user_id=3d68c8fdb65343b8b2f58070addeaf13, role_id=55dba566c5b54bc488719c0c5bb0ce15)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:58.933096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f460b9-5256-4c68-adcb-4449a86d73cc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:58.949170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 289/583] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:28:58 2022] PUT /identity/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/3d68c8fdb65343b8b2f58070addeaf13/roles/55dba566c5b54bc488719c0c5bb0ce15 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:28:58.950340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f460b9-5256-4c68-adcb-4449a86d73cc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:59.035498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:59.045460 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ddd48-d33d-460c-8e20-7c0db1151d9f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:59.080620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f460b9-5256-4c68-adcb-4449a86d73cc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:59.098364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ceae8-7745-4bc4-81eb-aab3fff814cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:59.098987 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ceae8-7745-4bc4-81eb-aab3fff814cc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:59.099310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ceae8-7745-4bc4-81eb-aab3fff814cc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:59.099584 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ceae8-7745-4bc4-81eb-aab3fff814cc None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:59.100610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ceae8-7745-4bc4-81eb-aab3fff814cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:59.100873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ceae8-7745-4bc4-81eb-aab3fff814cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:59.102256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ceae8-7745-4bc4-81eb-aab3fff814cc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:59.119848 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 295/584] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:59.120970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ceae8-7745-4bc4-81eb-aab3fff814cc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:59.129862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb749bf-774c-46af-b99b-52057247be16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:59.130290 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb749bf-774c-46af-b99b-52057247be16 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:59.130571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb749bf-774c-46af-b99b-52057247be16 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:59.130886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb749bf-774c-46af-b99b-52057247be16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:59.141638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb749bf-774c-46af-b99b-52057247be16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:59.143384 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb749bf-774c-46af-b99b-52057247be16 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-adb749bf-774c-46af-b99b-52057247be16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:59.163318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:59.164262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:59.165141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:59.165141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:59.165141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:59.165141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:59.165141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 290/585] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:59.165855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb749bf-774c-46af-b99b-52057247be16 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:59.229815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:59.250572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ceae8-7745-4bc4-81eb-aab3fff814cc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:59.278830 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb749bf-774c-46af-b99b-52057247be16 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:59.288472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52efe5-142b-40a8-b18c-7a57e1541e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:59.289628 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52efe5-142b-40a8-b18c-7a57e1541e5b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:59.290131 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52efe5-142b-40a8-b18c-7a57e1541e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:59.290629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52efe5-142b-40a8-b18c-7a57e1541e5b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:59.299730 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52efe5-142b-40a8-b18c-7a57e1541e5b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:59.301498 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52efe5-142b-40a8-b18c-7a57e1541e5b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:59.301750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:59.317439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97927eed-361a-4f53-a16b-ef9bfe665669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:59.318236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927eed-361a-4f53-a16b-ef9bfe665669 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:59.318517 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927eed-361a-4f53-a16b-ef9bfe665669 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:59.318789 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927eed-361a-4f53-a16b-ef9bfe665669 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-9b52efe5-142b-40a8-b18c-7a57e1541e5b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:28:59.319315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:59.320227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:59.321144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:59.321144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:59.321144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:28:59.321144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:28:59.321144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:28:59.321144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:28:59.321144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:28:59.321144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:28:59.321144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:28:59.321144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:59.323815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 296/586] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:59.324878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52efe5-142b-40a8-b18c-7a57e1541e5b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:59.326841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97927eed-361a-4f53-a16b-ef9bfe665669 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:59.328314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97927eed-361a-4f53-a16b-ef9bfe665669 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-97927eed-361a-4f53-a16b-ef9bfe665669 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:28:59.343690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:59.344671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:59.345633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:59.345633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:59.345633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:28:59.345633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:28:59.345633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:28:59.345633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:28:59.345633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:28:59.345633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:28:59.345633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 20:28:59.345633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:59.345633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 291/587] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:28:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:59.346209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97927eed-361a-4f53-a16b-ef9bfe665669 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:59.437350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52efe5-142b-40a8-b18c-7a57e1541e5b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:59.454162 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97927eed-361a-4f53-a16b-ef9bfe665669 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:59.474433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7543b-93b0-44ed-ba25-b39dfc42d5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:59.475515 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7543b-93b0-44ed-ba25-b39dfc42d5da None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:59.476002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7543b-93b0-44ed-ba25-b39dfc42d5da None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:59.476480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7543b-93b0-44ed-ba25-b39dfc42d5da None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:59.477399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7543b-93b0-44ed-ba25-b39dfc42d5da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:59.477920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7543b-93b0-44ed-ba25-b39dfc42d5da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:59.479430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7543b-93b0-44ed-ba25-b39dfc42d5da None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:59.493372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 297/588] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:59.494349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7543b-93b0-44ed-ba25-b39dfc42d5da None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:59.495779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cad6ff-3e13-4a5d-9b99-07f0bae1c083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:59.496651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad6ff-3e13-4a5d-9b99-07f0bae1c083 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:59.497318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad6ff-3e13-4a5d-9b99-07f0bae1c083 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:59.499078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad6ff-3e13-4a5d-9b99-07f0bae1c083 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:59.500148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cad6ff-3e13-4a5d-9b99-07f0bae1c083 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:59.500637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cad6ff-3e13-4a5d-9b99-07f0bae1c083 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:59.502254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cad6ff-3e13-4a5d-9b99-07f0bae1c083 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:59.514131 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:59.528727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 292/589] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Jul 6 20:28:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:59.530304 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cad6ff-3e13-4a5d-9b99-07f0bae1c083 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:59.583650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:59.612613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7543b-93b0-44ed-ba25-b39dfc42d5da None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:59.651515 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a44a9-82ce-4d81-9e3a-6c987bce3246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:59.652553 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a44a9-82ce-4d81-9e3a-6c987bce3246 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:59.653011 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a44a9-82ce-4d81-9e3a-6c987bce3246 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:59.653457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a44a9-82ce-4d81-9e3a-6c987bce3246 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:59.655253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a44a9-82ce-4d81-9e3a-6c987bce3246 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:28:59.655894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a44a9-82ce-4d81-9e3a-6c987bce3246 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:59.657486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a44a9-82ce-4d81-9e3a-6c987bce3246 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:59.661491 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cad6ff-3e13-4a5d-9b99-07f0bae1c083 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:59.681363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 298/590] 10.222.0.33 () {56 vars in 1139 bytes} [Wed Jul 6 20:28:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:28:59.682494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a44a9-82ce-4d81-9e3a-6c987bce3246 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:59.702563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b9eab-03be-45b7-8b60-2bc8d5bc42e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:59.703369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b9eab-03be-45b7-8b60-2bc8d5bc42e6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:59.703652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b9eab-03be-45b7-8b60-2bc8d5bc42e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:59.703924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b9eab-03be-45b7-8b60-2bc8d5bc42e6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:59.711827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b9eab-03be-45b7-8b60-2bc8d5bc42e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:59.713431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b9eab-03be-45b7-8b60-2bc8d5bc42e6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5a2b9eab-03be-45b7-8b60-2bc8d5bc42e6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:28:59.729535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:59.730513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:59.731470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:59.731470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:59.731470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:28:59.731470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:28:59.731470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:28:59.731470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:28:59.731470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:28:59.731470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:28:59.731470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 20:28:59.731470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:59.731470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 293/591] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:28:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:59.732163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b9eab-03be-45b7-8b60-2bc8d5bc42e6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:59.750681 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:59.795184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a44a9-82ce-4d81-9e3a-6c987bce3246 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:59.833373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b44379-9744-4d80-990c-efb6d5f779ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:59.834456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b44379-9744-4d80-990c-efb6d5f779ba None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:59.835004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b44379-9744-4d80-990c-efb6d5f779ba None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:59.835501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b44379-9744-4d80-990c-efb6d5f779ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:59.838352 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:28:59.842949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b9eab-03be-45b7-8b60-2bc8d5bc42e6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:28:59.847086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b44379-9744-4d80-990c-efb6d5f779ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:59.848589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b44379-9744-4d80-990c-efb6d5f779ba None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-b7b44379-9744-4d80-990c-efb6d5f779ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:59.870924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:59.871874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:59.873382 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:59.873382 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:59.873382 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:59.873382 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:28:59.875258 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 299/592] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:59.876162 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b44379-9744-4d80-990c-efb6d5f779ba None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:28:59.888207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e21b0-9c2f-4e0b-b9ae-26d400f72a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:28:59.889765 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e21b0-9c2f-4e0b-b9ae-26d400f72a73 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:28:59.890056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e21b0-9c2f-4e0b-b9ae-26d400f72a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:28:59.890363 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e21b0-9c2f-4e0b-b9ae-26d400f72a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:28:59.906748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e21b0-9c2f-4e0b-b9ae-26d400f72a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:28:59.908255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e21b0-9c2f-4e0b-b9ae-26d400f72a73 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-911e21b0-9c2f-4e0b-b9ae-26d400f72a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:28:59.927694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:28:59.930025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:28:59.932165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:28:59.932165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:28:59.932165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:28:59.932165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:28:59.932165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 294/593] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:28:59.932165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e21b0-9c2f-4e0b-b9ae-26d400f72a73 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:00.004018 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b44379-9744-4d80-990c-efb6d5f779ba None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:00.021568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:00.038215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e21b0-9c2f-4e0b-b9ae-26d400f72a73 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:00.049270 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b00c7-a1ec-4657-8742-d2f0f06dc1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:00.050434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b00c7-a1ec-4657-8742-d2f0f06dc1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:00.051158 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b00c7-a1ec-4657-8742-d2f0f06dc1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:00.051608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b00c7-a1ec-4657-8742-d2f0f06dc1c3 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:00.052709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b00c7-a1ec-4657-8742-d2f0f06dc1c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:00.053165 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b00c7-a1ec-4657-8742-d2f0f06dc1c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:00.055407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b00c7-a1ec-4657-8742-d2f0f06dc1c3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:00.076135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 300/594] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Jul 6 20:28:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:00.077118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b00c7-a1ec-4657-8742-d2f0f06dc1c3 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:00.081361 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe31d2b-5b97-401e-aee1-6ba2c190c04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:00.082260 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe31d2b-5b97-401e-aee1-6ba2c190c04d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:00.082684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe31d2b-5b97-401e-aee1-6ba2c190c04d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:00.083133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe31d2b-5b97-401e-aee1-6ba2c190c04d None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:00.084014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe31d2b-5b97-401e-aee1-6ba2c190c04d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:00.084462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe31d2b-5b97-401e-aee1-6ba2c190c04d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:00.086427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe31d2b-5b97-401e-aee1-6ba2c190c04d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:00.105995 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 295/595] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:00.105995 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe31d2b-5b97-401e-aee1-6ba2c190c04d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:00.139611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:00.190133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b00c7-a1ec-4657-8742-d2f0f06dc1c3 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:00.212820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe31d2b-5b97-401e-aee1-6ba2c190c04d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:00.226735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62601892-f8cf-40c5-8681-8386f88d2753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:00.227569 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62601892-f8cf-40c5-8681-8386f88d2753 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:00.228443 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62601892-f8cf-40c5-8681-8386f88d2753 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:00.228793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62601892-f8cf-40c5-8681-8386f88d2753 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:00.229921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62601892-f8cf-40c5-8681-8386f88d2753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:00.230297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62601892-f8cf-40c5-8681-8386f88d2753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:00.232573 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62601892-f8cf-40c5-8681-8386f88d2753 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:00.252957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 301/596] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:00.252957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62601892-f8cf-40c5-8681-8386f88d2753 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:00.255590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41ae11-bb56-4b82-b487-143a758ed19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:00.256603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41ae11-bb56-4b82-b487-143a758ed19b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:00.257079 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41ae11-bb56-4b82-b487-143a758ed19b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:00.257523 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41ae11-bb56-4b82-b487-143a758ed19b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:00.270984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41ae11-bb56-4b82-b487-143a758ed19b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:00.272951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41ae11-bb56-4b82-b487-143a758ed19b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:00.287370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1b41ae11-bb56-4b82-b487-143a758ed19b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:00.293293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:00.294149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:00.296347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:00.296347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:00.296347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:00.296347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:00.298398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 296/597] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:00.300176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41ae11-bb56-4b82-b487-143a758ed19b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:00.375846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62601892-f8cf-40c5-8681-8386f88d2753 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:00.376099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:00.421392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc19ce-8d03-416b-aca6-def5d6ce507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:00.422193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc19ce-8d03-416b-aca6-def5d6ce507a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:00.422478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc19ce-8d03-416b-aca6-def5d6ce507a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:00.422757 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc19ce-8d03-416b-aca6-def5d6ce507a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:00.428658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41ae11-bb56-4b82-b487-143a758ed19b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:00.430709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc19ce-8d03-416b-aca6-def5d6ce507a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:00.433079 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc19ce-8d03-416b-aca6-def5d6ce507a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-11cc19ce-8d03-416b-aca6-def5d6ce507a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:00.451567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:00.453017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:00.454135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:00.454135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:00.454135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:00.454135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:00.454135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:00.454135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:00.454135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:00.454135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:00.458067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 302/598] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:00.459118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc19ce-8d03-416b-aca6-def5d6ce507a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:00.476616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dfb69-7ed0-4b58-8b49-b3cd1a1c52cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:00.478323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dfb69-7ed0-4b58-8b49-b3cd1a1c52cf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:00.479359 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dfb69-7ed0-4b58-8b49-b3cd1a1c52cf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:00.480122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dfb69-7ed0-4b58-8b49-b3cd1a1c52cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:00.489468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dfb69-7ed0-4b58-8b49-b3cd1a1c52cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:00.492101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dfb69-7ed0-4b58-8b49-b3cd1a1c52cf None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-620dfb69-7ed0-4b58-8b49-b3cd1a1c52cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:00.511422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:00.512310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:00.513617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:00.513617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:00.513617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:00.513617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:00.513617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:00.513617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:00.513617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:00.513617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:00.513617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 297/599] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:00.514261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dfb69-7ed0-4b58-8b49-b3cd1a1c52cf None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:00.568713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:00.580279 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc19ce-8d03-416b-aca6-def5d6ce507a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:00.618073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993de7f-591e-48a8-a9f2-274dca9dcd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:00.619030 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993de7f-591e-48a8-a9f2-274dca9dcd68 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:00.619511 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993de7f-591e-48a8-a9f2-274dca9dcd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:00.619977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993de7f-591e-48a8-a9f2-274dca9dcd68 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:00.620238 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dfb69-7ed0-4b58-8b49-b3cd1a1c52cf None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:00.621148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993de7f-591e-48a8-a9f2-274dca9dcd68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:00.621631 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993de7f-591e-48a8-a9f2-274dca9dcd68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:00.623806 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993de7f-591e-48a8-a9f2-274dca9dcd68 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:00.636506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 303/600] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:00.637678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993de7f-591e-48a8-a9f2-274dca9dcd68 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:00.645615 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:00.659373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0e621-4805-4aae-aef0-a71ae712a8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:00.660032 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0e621-4805-4aae-aef0-a71ae712a8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:00.660318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0e621-4805-4aae-aef0-a71ae712a8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:00.660596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0e621-4805-4aae-aef0-a71ae712a8f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:00.661479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0e621-4805-4aae-aef0-a71ae712a8f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:00.661703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0e621-4805-4aae-aef0-a71ae712a8f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:00.663135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0e621-4805-4aae-aef0-a71ae712a8f2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:00.687696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 298/601] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:00.688449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0e621-4805-4aae-aef0-a71ae712a8f2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:00.754269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993de7f-591e-48a8-a9f2-274dca9dcd68 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:00.790896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca166744-6ebd-4e57-ac5c-84d6ec843aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:00.792189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca166744-6ebd-4e57-ac5c-84d6ec843aac None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:00.792649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca166744-6ebd-4e57-ac5c-84d6ec843aac None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:00.793125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca166744-6ebd-4e57-ac5c-84d6ec843aac None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:00.794140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca166744-6ebd-4e57-ac5c-84d6ec843aac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:00.794701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca166744-6ebd-4e57-ac5c-84d6ec843aac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:00.796355 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca166744-6ebd-4e57-ac5c-84d6ec843aac None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:00.798711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0e621-4805-4aae-aef0-a71ae712a8f2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:00.809897 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 304/602] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:00.811229 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca166744-6ebd-4e57-ac5c-84d6ec843aac None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:00.824258 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:00.836472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ed212-4e1b-4033-948b-28d7bf05ba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:00.837570 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed212-4e1b-4033-948b-28d7bf05ba64 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:00.837570 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed212-4e1b-4033-948b-28d7bf05ba64 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:00.837825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed212-4e1b-4033-948b-28d7bf05ba64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:00.846008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ed212-4e1b-4033-948b-28d7bf05ba64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:00.847545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ed212-4e1b-4033-948b-28d7bf05ba64 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-eb7ed212-4e1b-4033-948b-28d7bf05ba64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:00.862526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:00.863572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:00.864740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:00.864740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:00.864740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:00.864740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:00.864740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:00.864740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:00.864740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:00.864740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:00.864740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 299/603] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:00.865218 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ed212-4e1b-4033-948b-28d7bf05ba64 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:00.911904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:00.925943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca166744-6ebd-4e57-ac5c-84d6ec843aac None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:00.963764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a869b-5b62-4f28-ad54-2a923348ffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:00.964647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a869b-5b62-4f28-ad54-2a923348ffae None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:00.964927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a869b-5b62-4f28-ad54-2a923348ffae None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:00.965201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a869b-5b62-4f28-ad54-2a923348ffae None admin] PATH_INFO: `/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/4693da03c42e4328b74869abd0ae4b80/roles/55dba566c5b54bc488719c0c5bb0ce15` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:00.972637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ed212-4e1b-4033-948b-28d7bf05ba64 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:00.979496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a869b-5b62-4f28-ad54-2a923348ffae None admin] RBAC: Authorizing `identity:create_grant(project_id=8eda6c9cf4b1439eb280b0db35b3bce2, user_id=4693da03c42e4328b74869abd0ae4b80, role_id=55dba566c5b54bc488719c0c5bb0ce15)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:00.980957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a869b-5b62-4f28-ad54-2a923348ffae None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:00.999217 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 305/604] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:29:00 2022] PUT /identity/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/4693da03c42e4328b74869abd0ae4b80/roles/55dba566c5b54bc488719c0c5bb0ce15 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:29:01.000444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3570-444a-4354-9a7a-272126740b86 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:01.000739 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3570-444a-4354-9a7a-272126740b86 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:01.001017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3570-444a-4354-9a7a-272126740b86 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:01.006965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 306/605] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:01.006965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa3570-444a-4354-9a7a-272126740b86 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:01.031962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da656a3-8aff-41a0-8bc8-49f4c8015099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:01.034108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da656a3-8aff-41a0-8bc8-49f4c8015099 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:01.034931 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da656a3-8aff-41a0-8bc8-49f4c8015099 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:01.035452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da656a3-8aff-41a0-8bc8-49f4c8015099 None admin] PATH_INFO: `/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/d7bb4a244df24a19b4c3ad3d1ad2bc7c/roles/55dba566c5b54bc488719c0c5bb0ce15` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:01.062916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da656a3-8aff-41a0-8bc8-49f4c8015099 None admin] RBAC: Authorizing `identity:create_grant(project_id=8eda6c9cf4b1439eb280b0db35b3bce2, user_id=d7bb4a244df24a19b4c3ad3d1ad2bc7c, role_id=55dba566c5b54bc488719c0c5bb0ce15)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:01.065958 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da656a3-8aff-41a0-8bc8-49f4c8015099 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:01.085644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:01.093918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 300/606] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:29:00 2022] PUT /identity/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/d7bb4a244df24a19b4c3ad3d1ad2bc7c/roles/55dba566c5b54bc488719c0c5bb0ce15 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:29:01.095690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d9ada-6441-48b4-b356-8c98fd4c764b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:01.096162 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d9ada-6441-48b4-b356-8c98fd4c764b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:01.096853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d9ada-6441-48b4-b356-8c98fd4c764b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:01.117539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1e8d9ada-6441-48b4-b356-8c98fd4c764b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:01.119226 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1e8d9ada-6441-48b4-b356-8c98fd4c764b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:01.188127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa3570-444a-4354-9a7a-272126740b86 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:01.212633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 301/607] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:29:01.213803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4490c4-e846-49a5-8e0c-0f30d1e91c0e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:01.214097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4490c4-e846-49a5-8e0c-0f30d1e91c0e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:01.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4490c4-e846-49a5-8e0c-0f30d1e91c0e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:01.216014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 302/608] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:01.222608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263d302-e255-4770-9bc1-088cbf01b0d7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:01.222888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263d302-e255-4770-9bc1-088cbf01b0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:01.223162 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263d302-e255-4770-9bc1-088cbf01b0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:01.244352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b74e53-4027-44a2-bfca-516f296e98a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:01.245020 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b74e53-4027-44a2-bfca-516f296e98a3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:01.245395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b74e53-4027-44a2-bfca-516f296e98a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:01.245631 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b74e53-4027-44a2-bfca-516f296e98a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:01.246529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b74e53-4027-44a2-bfca-516f296e98a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:01.246782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b74e53-4027-44a2-bfca-516f296e98a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:01.248991 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b74e53-4027-44a2-bfca-516f296e98a3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:01.250480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1263d302-e255-4770-9bc1-088cbf01b0d7 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:01.252839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1263d302-e255-4770-9bc1-088cbf01b0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:01.264276 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 307/609] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:01.264750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b74e53-4027-44a2-bfca-516f296e98a3 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:01.280456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:01.348106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 303/610] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 20:29:01.349231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263d302-e255-4770-9bc1-088cbf01b0d7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:01.382631 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b74e53-4027-44a2-bfca-516f296e98a3 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:01.407701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:01.425798 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34581b-2649-429f-80c6-de001589f161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:01.426598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34581b-2649-429f-80c6-de001589f161 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:01.426885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34581b-2649-429f-80c6-de001589f161 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:01.427162 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34581b-2649-429f-80c6-de001589f161 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:01.441298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34581b-2649-429f-80c6-de001589f161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-cd34581b-2649-429f-80c6-de001589f161 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:01.452000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:01.453343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:01.454196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:01.454196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:01.454196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:01.454196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:01.454196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:01.454196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:01.454196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:01.454196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:01.454196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:01.454196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:01.454196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:01.454196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:01.454196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 308/611] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:29:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:01.454893 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34581b-2649-429f-80c6-de001589f161 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:01.464556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263d302-e255-4770-9bc1-088cbf01b0d7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:01.515028 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeda351-d970-494d-87be-79bcd6135e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:01.517421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeda351-d970-494d-87be-79bcd6135e1e None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:01.518138 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeda351-d970-494d-87be-79bcd6135e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:01.518823 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeda351-d970-494d-87be-79bcd6135e1e None admin] PATH_INFO: `/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/f892e618b01a46aaaab4f79aa0c3daa9/roles/55dba566c5b54bc488719c0c5bb0ce15` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:01.539413 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeda351-d970-494d-87be-79bcd6135e1e None admin] RBAC: Authorizing `identity:create_grant(project_id=8eda6c9cf4b1439eb280b0db35b3bce2, user_id=f892e618b01a46aaaab4f79aa0c3daa9, role_id=55dba566c5b54bc488719c0c5bb0ce15)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:01.542097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeda351-d970-494d-87be-79bcd6135e1e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:01.560518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 304/612] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:29:01 2022] PUT /identity/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/f892e618b01a46aaaab4f79aa0c3daa9/roles/55dba566c5b54bc488719c0c5bb0ce15 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:29:01.562379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeda351-d970-494d-87be-79bcd6135e1e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:01.566132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:01.594652 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34581b-2649-429f-80c6-de001589f161 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:01.672431 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636064a-86f7-46b8-8bbc-14ef7ca02ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:01.673173 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636064a-86f7-46b8-8bbc-14ef7ca02ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:01.673456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636064a-86f7-46b8-8bbc-14ef7ca02ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:01.673730 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636064a-86f7-46b8-8bbc-14ef7ca02ee0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:01.697603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636064a-86f7-46b8-8bbc-14ef7ca02ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-a636064a-86f7-46b8-8bbc-14ef7ca02ee0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:01.709975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:01.710957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:01.712226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:01.712226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:01.712226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:01.712226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:01.712226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:01.712226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:01.712226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:01.712226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:01.712226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:01.712226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:01.712226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:01.712226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:01.712226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 309/613] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:29:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:01.719474 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636064a-86f7-46b8-8bbc-14ef7ca02ee0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:01.755525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeda351-d970-494d-87be-79bcd6135e1e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:01.785713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:01.807214 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288da67-cc83-4427-b353-8344a7d02af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:01.808944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288da67-cc83-4427-b353-8344a7d02af2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:01.809430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288da67-cc83-4427-b353-8344a7d02af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:01.810196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288da67-cc83-4427-b353-8344a7d02af2 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:01.811811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288da67-cc83-4427-b353-8344a7d02af2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:01.812427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288da67-cc83-4427-b353-8344a7d02af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:01.814010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288da67-cc83-4427-b353-8344a7d02af2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:01.825472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 305/614] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:29:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:01.831420 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288da67-cc83-4427-b353-8344a7d02af2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:01.854171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636064a-86f7-46b8-8bbc-14ef7ca02ee0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:01.908379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b7a9-f831-4989-9690-564326d4b807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:01.909057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b7a9-f831-4989-9690-564326d4b807 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:01.909344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b7a9-f831-4989-9690-564326d4b807 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:01.909622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b7a9-f831-4989-9690-564326d4b807 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:01.910373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8b7a9-f831-4989-9690-564326d4b807 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:01.910685 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8b7a9-f831-4989-9690-564326d4b807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:01.915667 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8b7a9-f831-4989-9690-564326d4b807 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:01.934913 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 310/615] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:29:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:01.944634 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:01.957305 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b7a9-f831-4989-9690-564326d4b807 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:02.009815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288da67-cc83-4427-b353-8344a7d02af2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:02.063194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8aebd8-0325-4959-9649-b60af0fe2dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:02.063194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8aebd8-0325-4959-9649-b60af0fe2dbc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:02.063194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8aebd8-0325-4959-9649-b60af0fe2dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:02.063569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8aebd8-0325-4959-9649-b60af0fe2dbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:02.087195 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8aebd8-0325-4959-9649-b60af0fe2dbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:02.091191 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8aebd8-0325-4959-9649-b60af0fe2dbc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-eb8aebd8-0325-4959-9649-b60af0fe2dbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:02.119196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:02.120125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:02.121026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:02.121026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:02.121026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:02.121026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:02.121721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 306/616] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:02.128493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8aebd8-0325-4959-9649-b60af0fe2dbc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:02.191278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b7a9-f831-4989-9690-564326d4b807 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:02.191598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:02.247192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c74252-08ac-4616-b140-3989176c654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:02.247192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c74252-08ac-4616-b140-3989176c654e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:02.247970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c74252-08ac-4616-b140-3989176c654e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:02.251190 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c74252-08ac-4616-b140-3989176c654e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:02.271203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c74252-08ac-4616-b140-3989176c654e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:02.272460 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c74252-08ac-4616-b140-3989176c654e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-d7c74252-08ac-4616-b140-3989176c654e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:02.311811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:02.313885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:02.316078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:02.316078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:02.316078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:02.316078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:02.316078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 311/617] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:02.324730 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c74252-08ac-4616-b140-3989176c654e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:02.361045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8aebd8-0325-4959-9649-b60af0fe2dbc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:02.400939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:02.451998 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd262542-81c5-45bf-b2df-dbdc3e2a8b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:02.452603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd262542-81c5-45bf-b2df-dbdc3e2a8b7b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:02.452892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd262542-81c5-45bf-b2df-dbdc3e2a8b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:02.453177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd262542-81c5-45bf-b2df-dbdc3e2a8b7b None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:02.453912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd262542-81c5-45bf-b2df-dbdc3e2a8b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:02.454225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd262542-81c5-45bf-b2df-dbdc3e2a8b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:02.455668 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd262542-81c5-45bf-b2df-dbdc3e2a8b7b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:02.467890 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c74252-08ac-4616-b140-3989176c654e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:02.481780 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 307/618] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:02.488559 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd262542-81c5-45bf-b2df-dbdc3e2a8b7b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:02.511537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195e64e-1400-4146-b057-ba586e4ae485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:02.512206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195e64e-1400-4146-b057-ba586e4ae485 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:02.512475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195e64e-1400-4146-b057-ba586e4ae485 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:02.512758 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195e64e-1400-4146-b057-ba586e4ae485 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:02.514274 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195e64e-1400-4146-b057-ba586e4ae485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:02.514592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195e64e-1400-4146-b057-ba586e4ae485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:02.516011 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195e64e-1400-4146-b057-ba586e4ae485 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:02.530316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 312/619] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:02.535633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195e64e-1400-4146-b057-ba586e4ae485 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:02.563629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:02.609098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd262542-81c5-45bf-b2df-dbdc3e2a8b7b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:02.684442 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce69a94-8369-4d49-8a23-76acbd941ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:02.685308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69a94-8369-4d49-8a23-76acbd941ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:02.685596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69a94-8369-4d49-8a23-76acbd941ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:02.685875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69a94-8369-4d49-8a23-76acbd941ad3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:02.692161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195e64e-1400-4146-b057-ba586e4ae485 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:02.702730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce69a94-8369-4d49-8a23-76acbd941ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:02.704177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce69a94-8369-4d49-8a23-76acbd941ad3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2ce69a94-8369-4d49-8a23-76acbd941ad3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:02.725815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:02.726912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:02.727875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:02.727875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:02.727875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:02.727875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:02.727875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:02.727875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:02.727875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:02.727875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:02.727875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:29:02.727875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:02.727875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 308/620] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:29:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:02.737393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce69a94-8369-4d49-8a23-76acbd941ad3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:02.778167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1321c9-bdd6-4d5f-b87c-cd5697939cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:02.779063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1321c9-bdd6-4d5f-b87c-cd5697939cbb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:02.779467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1321c9-bdd6-4d5f-b87c-cd5697939cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:02.779796 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1321c9-bdd6-4d5f-b87c-cd5697939cbb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:02.793631 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1321c9-bdd6-4d5f-b87c-cd5697939cbb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:02.795956 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1321c9-bdd6-4d5f-b87c-cd5697939cbb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:02.819570 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-aa1321c9-bdd6-4d5f-b87c-cd5697939cbb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:02.825181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:02.826807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:02.827799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:02.827799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:02.827799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:02.827799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:02.827799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:02.827799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:02.827799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:02.827799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:02.827799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:02.827799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:02.837542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 313/621] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jul 6 20:29:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:02.838462 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1321c9-bdd6-4d5f-b87c-cd5697939cbb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:02.925720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce69a94-8369-4d49-8a23-76acbd941ad3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:02.986458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:02.999869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9dc9c-7767-40e1-a54c-d3808452f134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:03.000552 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9dc9c-7767-40e1-a54c-d3808452f134 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.000834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9dc9c-7767-40e1-a54c-d3808452f134 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.001109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9dc9c-7767-40e1-a54c-d3808452f134 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.001949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9dc9c-7767-40e1-a54c-d3808452f134 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:03.002265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9dc9c-7767-40e1-a54c-d3808452f134 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:03.003733 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9dc9c-7767-40e1-a54c-d3808452f134 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:03.025494 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 309/622] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Jul 6 20:29:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:03.036161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9dc9c-7767-40e1-a54c-d3808452f134 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:03.037439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1321c9-bdd6-4d5f-b87c-cd5697939cbb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:03.076811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2930d-0202-4722-b142-ed4a2554e097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:03.077951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2930d-0202-4722-b142-ed4a2554e097 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.078567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2930d-0202-4722-b142-ed4a2554e097 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.078946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2930d-0202-4722-b142-ed4a2554e097 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.079919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2930d-0202-4722-b142-ed4a2554e097 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:03.083200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2930d-0202-4722-b142-ed4a2554e097 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:03.083200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2930d-0202-4722-b142-ed4a2554e097 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:03.101468 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 314/623] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jul 6 20:29:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:03.106820 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2930d-0202-4722-b142-ed4a2554e097 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:03.215596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2930d-0202-4722-b142-ed4a2554e097 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:03.248493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:03.253111 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639920e-8510-4774-8e69-0897009b15ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:03.253850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639920e-8510-4774-8e69-0897009b15ef None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.254204 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639920e-8510-4774-8e69-0897009b15ef None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.254554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639920e-8510-4774-8e69-0897009b15ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.280497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:03.284089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9dc9c-7767-40e1-a54c-d3808452f134 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:03.321892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f22d8-d873-4474-8301-7eac1749c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:03.322700 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f22d8-d873-4474-8301-7eac1749c9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.322984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f22d8-d873-4474-8301-7eac1749c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.323394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f22d8-d873-4474-8301-7eac1749c9a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.334432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f22d8-d873-4474-8301-7eac1749c9a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:03.336178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f22d8-d873-4474-8301-7eac1749c9a2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:03.338492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639920e-8510-4774-8e69-0897009b15ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:03.340261 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639920e-8510-4774-8e69-0897009b15ef None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ff9f22d8-d873-4474-8301-7eac1749c9a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:03.355402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:03.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:03.357856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:03.357856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:03.357856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:03.357856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:03.362497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 310/624] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:03.364046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a84c4-7dfe-4d7a-8020-32f954b5ed9b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.364404 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a84c4-7dfe-4d7a-8020-32f954b5ed9b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.364747 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a84c4-7dfe-4d7a-8020-32f954b5ed9b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.370328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 311/625] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:03.371163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a84c4-7dfe-4d7a-8020-32f954b5ed9b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:03.466857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 315/626] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:29:03.468169 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2f37-f480-47a1-b6b3-df57011d7096 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.468737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2f37-f480-47a1-b6b3-df57011d7096 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.468737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2f37-f480-47a1-b6b3-df57011d7096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.491047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a84c4-7dfe-4d7a-8020-32f954b5ed9b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:03.491494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-039e2f37-f480-47a1-b6b3-df57011d7096 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:03.492698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-039e2f37-f480-47a1-b6b3-df57011d7096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:03.520422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:03.532328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19223169-814f-4d51-a37b-d7eeb13cff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:03.533007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19223169-814f-4d51-a37b-d7eeb13cff60 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.533297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19223169-814f-4d51-a37b-d7eeb13cff60 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.533574 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19223169-814f-4d51-a37b-d7eeb13cff60 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.534300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19223169-814f-4d51-a37b-d7eeb13cff60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:03.534609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19223169-814f-4d51-a37b-d7eeb13cff60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:03.536119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19223169-814f-4d51-a37b-d7eeb13cff60 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:03.554644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 312/627] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:03.555732 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19223169-814f-4d51-a37b-d7eeb13cff60 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:03.564926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 316/628] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:29:03.565776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e2f37-f480-47a1-b6b3-df57011d7096 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:03.566424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:03.672328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e2f37-f480-47a1-b6b3-df57011d7096 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:03.672972 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19223169-814f-4d51-a37b-d7eeb13cff60 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:03.708740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb97db1-2691-44b6-8e87-0413f04984da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:03.709651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97db1-2691-44b6-8e87-0413f04984da None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.709937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97db1-2691-44b6-8e87-0413f04984da None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.710139 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e4b79-679d-4d79-b42c-1eac9230d0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:03.710250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97db1-2691-44b6-8e87-0413f04984da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.710942 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e4b79-679d-4d79-b42c-1eac9230d0ac None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.711269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e4b79-679d-4d79-b42c-1eac9230d0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.711550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e4b79-679d-4d79-b42c-1eac9230d0ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.717661 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb97db1-2691-44b6-8e87-0413f04984da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:03.719114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb97db1-2691-44b6-8e87-0413f04984da None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:03.722847 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e4b79-679d-4d79-b42c-1eac9230d0ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:03.724326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e4b79-679d-4d79-b42c-1eac9230d0ac None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-1fb97db1-2691-44b6-8e87-0413f04984da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:03.733948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:03.734842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:03.736094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:03.736094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:03.736094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:03.736094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:03.736094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:03.736094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:03.736094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:03.736094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:03.736094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 317/629] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:03.736592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53686db5-c57a-4c22-84f1-34b59a93eb75 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.736899 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53686db5-c57a-4c22-84f1-34b59a93eb75 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.736992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53686db5-c57a-4c22-84f1-34b59a93eb75 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.738376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 318/630] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:03.740245 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53686db5-c57a-4c22-84f1-34b59a93eb75 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f45e4b79-679d-4d79-b42c-1eac9230d0ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:03.748365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:03.749245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:03.750124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:03.750124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:03.750124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:03.750124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:03.750124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 313/631] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:03.750394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e4b79-679d-4d79-b42c-1eac9230d0ac None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:03.773382 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:03.814194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:03.861377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e4b79-679d-4d79-b42c-1eac9230d0ac None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:03.861891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53686db5-c57a-4c22-84f1-34b59a93eb75 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:03.897283 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec3134-8ea4-4845-acaa-32bf1e784ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:03.897485 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751efcdd-89a9-4064-bdd5-fa94ddd9a180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:03.897954 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec3134-8ea4-4845-acaa-32bf1e784ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.898241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec3134-8ea4-4845-acaa-32bf1e784ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.898354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751efcdd-89a9-4064-bdd5-fa94ddd9a180 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.898514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec3134-8ea4-4845-acaa-32bf1e784ba3 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.898619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751efcdd-89a9-4064-bdd5-fa94ddd9a180 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.898817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751efcdd-89a9-4064-bdd5-fa94ddd9a180 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.899333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec3134-8ea4-4845-acaa-32bf1e784ba3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:03.899646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec3134-8ea4-4845-acaa-32bf1e784ba3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:03.901211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec3134-8ea4-4845-acaa-32bf1e784ba3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:03.909762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751efcdd-89a9-4064-bdd5-fa94ddd9a180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:03.918566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 314/632] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:03.918566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54b7a8-fc0b-4bee-a210-5bfe90866896 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:03.918566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54b7a8-fc0b-4bee-a210-5bfe90866896 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:03.918566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54b7a8-fc0b-4bee-a210-5bfe90866896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-751efcdd-89a9-4064-bdd5-fa94ddd9a180 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:03.918885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:03.920004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 319/633] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:29:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:03.920854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751efcdd-89a9-4064-bdd5-fa94ddd9a180 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:03.941440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7f54b7a8-fc0b-4bee-a210-5bfe90866896 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:03.942949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7f54b7a8-fc0b-4bee-a210-5bfe90866896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:04.008036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:04.010086 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 315/634] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:29:04.010996 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54b7a8-fc0b-4bee-a210-5bfe90866896 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:04.029778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751efcdd-89a9-4064-bdd5-fa94ddd9a180 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:04.061276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:04.063575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ad77a-4d4f-4741-ab21-bcf6e7991293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:04.064241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ad77a-4d4f-4741-ab21-bcf6e7991293 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:04.064528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ad77a-4d4f-4741-ab21-bcf6e7991293 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:04.064807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ad77a-4d4f-4741-ab21-bcf6e7991293 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:04.065532 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ad77a-4d4f-4741-ab21-bcf6e7991293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:04.065845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ad77a-4d4f-4741-ab21-bcf6e7991293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:04.067243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ad77a-4d4f-4741-ab21-bcf6e7991293 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:04.078884 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 320/635] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:04.079713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ad77a-4d4f-4741-ab21-bcf6e7991293 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:04.115890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54b7a8-fc0b-4bee-a210-5bfe90866896 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:04.149101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1361528-9773-4e5e-82e9-fca8dae7518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:04.149984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1361528-9773-4e5e-82e9-fca8dae7518f None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:04.150265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1361528-9773-4e5e-82e9-fca8dae7518f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:04.150538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1361528-9773-4e5e-82e9-fca8dae7518f None admin] PATH_INFO: `/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/88dff378ccb4497fb305563614ea4caa/roles/55dba566c5b54bc488719c0c5bb0ce15` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:04.164874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1361528-9773-4e5e-82e9-fca8dae7518f None admin] RBAC: Authorizing `identity:create_grant(project_id=8eda6c9cf4b1439eb280b0db35b3bce2, user_id=88dff378ccb4497fb305563614ea4caa, role_id=55dba566c5b54bc488719c0c5bb0ce15)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:04.166329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1361528-9773-4e5e-82e9-fca8dae7518f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:04.179076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 316/636] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:29:04 2022] PUT /identity/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/88dff378ccb4497fb305563614ea4caa/roles/55dba566c5b54bc488719c0c5bb0ce15 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:29:04.191330 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ad77a-4d4f-4741-ab21-bcf6e7991293 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:04.191484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75857ad-dca6-4f9d-937d-9824e543bba6 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:04.191484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75857ad-dca6-4f9d-937d-9824e543bba6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:04.191484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75857ad-dca6-4f9d-937d-9824e543bba6 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:04.191484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 317/637] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:04.191484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75857ad-dca6-4f9d-937d-9824e543bba6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:04.230831 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087826c-7675-4f67-9940-345da7041c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:04.232102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087826c-7675-4f67-9940-345da7041c71 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:04.233185 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087826c-7675-4f67-9940-345da7041c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:04.233479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087826c-7675-4f67-9940-345da7041c71 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:04.234277 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087826c-7675-4f67-9940-345da7041c71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:04.234604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087826c-7675-4f67-9940-345da7041c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:04.236052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087826c-7675-4f67-9940-345da7041c71 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:04.245177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 321/638] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:29:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:04.246034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087826c-7675-4f67-9940-345da7041c71 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:04.251840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:04.303334 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:04.312349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75857ad-dca6-4f9d-937d-9824e543bba6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:04.355727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49453c85-302b-49d6-9d2c-d21e31b51a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:04.358027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49453c85-302b-49d6-9d2c-d21e31b51a44 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:04.358322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49453c85-302b-49d6-9d2c-d21e31b51a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:04.358607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49453c85-302b-49d6-9d2c-d21e31b51a44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:04.360748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087826c-7675-4f67-9940-345da7041c71 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:04.369678 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49453c85-302b-49d6-9d2c-d21e31b51a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-49453c85-302b-49d6-9d2c-d21e31b51a44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:04.378977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:04.380067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:04.380950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:04.380950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:04.380950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:04.380950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:04.380950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:04.380950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:04.380950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:04.380950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:04.380950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:04.380950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:04.380950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:04.380950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:04.380950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 318/639] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:29:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:04.382266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fe4cb-1c2b-4897-8eca-c5cb9ea3c14a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:04.382266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fe4cb-1c2b-4897-8eca-c5cb9ea3c14a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:04.382429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fe4cb-1c2b-4897-8eca-c5cb9ea3c14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:04.399198 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fde24-b43b-43a4-be0b-075ce909f3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:04.400466 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fde24-b43b-43a4-be0b-075ce909f3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:04.400977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fde24-b43b-43a4-be0b-075ce909f3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:04.401206 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b09fe4cb-1c2b-4897-8eca-c5cb9ea3c14a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:04.401643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fde24-b43b-43a4-be0b-075ce909f3a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:04.402410 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b09fe4cb-1c2b-4897-8eca-c5cb9ea3c14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:04.409945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fde24-b43b-43a4-be0b-075ce909f3a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:04.411809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fde24-b43b-43a4-be0b-075ce909f3a0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-3f0fde24-b43b-43a4-be0b-075ce909f3a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:04.430684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:04.431877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:04.432785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:04.432785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:04.432785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:04.432785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:04.432785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:04.432785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:04.432785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:04.432785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:04.438933 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 322/640] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:04.438933 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fde24-b43b-43a4-be0b-075ce909f3a0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:04.491241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 319/641] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:29:04.491241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fe4cb-1c2b-4897-8eca-c5cb9ea3c14a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:04.509140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:04.552763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fde24-b43b-43a4-be0b-075ce909f3a0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:04.588081 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:04.598839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873e91a-3185-4e19-ae66-2e8c7ca42c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:04.599664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873e91a-3185-4e19-ae66-2e8c7ca42c65 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:04.599946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873e91a-3185-4e19-ae66-2e8c7ca42c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:04.600218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873e91a-3185-4e19-ae66-2e8c7ca42c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:04.602116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fe4cb-1c2b-4897-8eca-c5cb9ea3c14a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:04.611154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873e91a-3185-4e19-ae66-2e8c7ca42c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:04.612621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873e91a-3185-4e19-ae66-2e8c7ca42c65 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-6873e91a-3185-4e19-ae66-2e8c7ca42c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:04.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:04.631161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:04.637071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:04.637071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:04.637071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:04.637071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:04.637071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 323/642] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:04.637071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873e91a-3185-4e19-ae66-2e8c7ca42c65 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:04.643479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039d021-fdd3-422e-8b37-4c095281c45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:04.644444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039d021-fdd3-422e-8b37-4c095281c45c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:04.644938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039d021-fdd3-422e-8b37-4c095281c45c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:04.645446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039d021-fdd3-422e-8b37-4c095281c45c None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:04.646274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039d021-fdd3-422e-8b37-4c095281c45c None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:04.646594 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039d021-fdd3-422e-8b37-4c095281c45c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:04.648020 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039d021-fdd3-422e-8b37-4c095281c45c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:04.657744 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 320/643] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:29:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:04.658543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039d021-fdd3-422e-8b37-4c095281c45c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:04.744574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873e91a-3185-4e19-ae66-2e8c7ca42c65 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:04.763980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:04.764749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039d021-fdd3-422e-8b37-4c095281c45c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:04.782708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03cf49-7ec3-4bd7-8f58-232231b77999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:04.783509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03cf49-7ec3-4bd7-8f58-232231b77999 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:04.783791 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03cf49-7ec3-4bd7-8f58-232231b77999 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:04.784066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03cf49-7ec3-4bd7-8f58-232231b77999 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:04.784841 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03cf49-7ec3-4bd7-8f58-232231b77999 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:04.785148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03cf49-7ec3-4bd7-8f58-232231b77999 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:04.786710 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03cf49-7ec3-4bd7-8f58-232231b77999 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:04.799092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 324/644] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:04.799927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03cf49-7ec3-4bd7-8f58-232231b77999 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:04.806146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196c819-c884-49c9-a502-9422f8deb613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:04.806945 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196c819-c884-49c9-a502-9422f8deb613 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:04.807266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196c819-c884-49c9-a502-9422f8deb613 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:04.807542 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196c819-c884-49c9-a502-9422f8deb613 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:04.820005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196c819-c884-49c9-a502-9422f8deb613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2196c819-c884-49c9-a502-9422f8deb613 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:04.831193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:04.835720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 321/645] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:29:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:04.837841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196c819-c884-49c9-a502-9422f8deb613 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:04.850423 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:04.929519 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03cf49-7ec3-4bd7-8f58-232231b77999 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:04.951922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196c819-c884-49c9-a502-9422f8deb613 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:04.965365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0f577-d2dd-4e97-9fd2-61d4cb459092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:04.966626 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0f577-d2dd-4e97-9fd2-61d4cb459092 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:04.966919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0f577-d2dd-4e97-9fd2-61d4cb459092 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:04.967225 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0f577-d2dd-4e97-9fd2-61d4cb459092 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:04.967958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0f577-d2dd-4e97-9fd2-61d4cb459092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:04.968271 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0f577-d2dd-4e97-9fd2-61d4cb459092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:04.969644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0f577-d2dd-4e97-9fd2-61d4cb459092 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:04.987010 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 325/646] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:04.987010 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0f577-d2dd-4e97-9fd2-61d4cb459092 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:04.991940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef5a13-8f3f-43a3-8b60-1b72b848817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:04.992803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef5a13-8f3f-43a3-8b60-1b72b848817b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:04.993091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef5a13-8f3f-43a3-8b60-1b72b848817b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:04.993487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef5a13-8f3f-43a3-8b60-1b72b848817b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.005417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef5a13-8f3f-43a3-8b60-1b72b848817b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:05.006873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef5a13-8f3f-43a3-8b60-1b72b848817b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:05.021469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-cdef5a13-8f3f-43a3-8b60-1b72b848817b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:05.026407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:05.027333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:05.028343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:05.028343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:05.028343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:05.028343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:05.028343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 322/647] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:05.029904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef5a13-8f3f-43a3-8b60-1b72b848817b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:05.094970 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:05.100928 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0f577-d2dd-4e97-9fd2-61d4cb459092 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:05.137120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef5a13-8f3f-43a3-8b60-1b72b848817b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:05.139041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325105e0-2f2e-4d68-af6e-35686ae1a2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:05.139793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325105e0-2f2e-4d68-af6e-35686ae1a2aa None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:05.140766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325105e0-2f2e-4d68-af6e-35686ae1a2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:05.140766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325105e0-2f2e-4d68-af6e-35686ae1a2aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.141165 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325105e0-2f2e-4d68-af6e-35686ae1a2aa None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=3d68c8fdb65343b8b2f58070addeaf13) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:05.141478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325105e0-2f2e-4d68-af6e-35686ae1a2aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:05.143154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325105e0-2f2e-4d68-af6e-35686ae1a2aa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:05.159368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 326/648] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:04 2022] GET /identity/v3/role_assignments?user.id=3d68c8fdb65343b8b2f58070addeaf13&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:05.159368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325105e0-2f2e-4d68-af6e-35686ae1a2aa None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:05.185632 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e833-c283-400e-8a7c-7d18243173e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:05.186315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e833-c283-400e-8a7c-7d18243173e1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:05.186599 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e833-c283-400e-8a7c-7d18243173e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:05.186873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e833-c283-400e-8a7c-7d18243173e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.187809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320e833-c283-400e-8a7c-7d18243173e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:05.188117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320e833-c283-400e-8a7c-7d18243173e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:05.189745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320e833-c283-400e-8a7c-7d18243173e1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:05.200706 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 323/649] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:29:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:05.201724 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e833-c283-400e-8a7c-7d18243173e1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:05.301695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:05.305227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325105e0-2f2e-4d68-af6e-35686ae1a2aa None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:05.337806 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e833-c283-400e-8a7c-7d18243173e1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:05.348301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6d71e-74f8-47ca-8eaf-466f6d2156d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:05.349415 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6d71e-74f8-47ca-8eaf-466f6d2156d6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:05.349908 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6d71e-74f8-47ca-8eaf-466f6d2156d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:05.350697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6d71e-74f8-47ca-8eaf-466f6d2156d6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.361551 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6d71e-74f8-47ca-8eaf-466f6d2156d6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:05.363372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6d71e-74f8-47ca-8eaf-466f6d2156d6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:05.365140 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-eca6d71e-74f8-47ca-8eaf-466f6d2156d6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:05.380919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:05.382096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:05.383694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:05.383694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:05.383694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:05.383694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:05.383694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:05.383694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:05.383694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:05.383694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:05.383694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:29:05.383694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:05.383694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 327/650] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:29:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:05.383694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6d71e-74f8-47ca-8eaf-466f6d2156d6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:05.389521 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383613c-03d6-41e0-ada1-52a5fc795778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:05.390203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383613c-03d6-41e0-ada1-52a5fc795778 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:05.390489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383613c-03d6-41e0-ada1-52a5fc795778 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:05.390767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383613c-03d6-41e0-ada1-52a5fc795778 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.392200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383613c-03d6-41e0-ada1-52a5fc795778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:05.392200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383613c-03d6-41e0-ada1-52a5fc795778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:05.393511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383613c-03d6-41e0-ada1-52a5fc795778 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:05.408506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 324/651] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:05.409336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383613c-03d6-41e0-ada1-52a5fc795778 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:05.499118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6d71e-74f8-47ca-8eaf-466f6d2156d6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:05.529375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383613c-03d6-41e0-ada1-52a5fc795778 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:05.537151 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1270af9-2fb2-44a0-9364-e963f787ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:05.538524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270af9-2fb2-44a0-9364-e963f787ff0e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:05.539034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270af9-2fb2-44a0-9364-e963f787ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:05.539532 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270af9-2fb2-44a0-9364-e963f787ff0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.551373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1270af9-2fb2-44a0-9364-e963f787ff0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:05.553122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1270af9-2fb2-44a0-9364-e963f787ff0e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:05.566158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db2d43-9b7e-415c-9161-62007ec89fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:05.566832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db2d43-9b7e-415c-9161-62007ec89fcf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:05.567118 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db2d43-9b7e-415c-9161-62007ec89fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:05.567439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db2d43-9b7e-415c-9161-62007ec89fcf None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.568272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db2d43-9b7e-415c-9161-62007ec89fcf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:05.568585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db2d43-9b7e-415c-9161-62007ec89fcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:05.570087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db2d43-9b7e-415c-9161-62007ec89fcf None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-a1270af9-2fb2-44a0-9364-e963f787ff0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:05.573325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:05.574177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:05.575074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:05.575074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:05.575074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:05.575074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:05.577926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 328/652] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:05.578940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1270af9-2fb2-44a0-9364-e963f787ff0e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:05.594830 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 325/653] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Jul 6 20:29:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:05.595748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db2d43-9b7e-415c-9161-62007ec89fcf None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:05.607940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:05.646462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:05.698684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1270af9-2fb2-44a0-9364-e963f787ff0e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:05.710235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db2d43-9b7e-415c-9161-62007ec89fcf None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:05.734353 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78e3f0-86f0-461b-863b-8c073806e938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:05.735546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78e3f0-86f0-461b-863b-8c073806e938 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:05.736048 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78e3f0-86f0-461b-863b-8c073806e938 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:05.736520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78e3f0-86f0-461b-863b-8c073806e938 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.744948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78e3f0-86f0-461b-863b-8c073806e938 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:05.747262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78e3f0-86f0-461b-863b-8c073806e938 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:05.747458 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c66b3b-8ed7-4808-bd9c-3f8534d6b938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:05.747965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c66b3b-8ed7-4808-bd9c-3f8534d6b938 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:05.748252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c66b3b-8ed7-4808-bd9c-3f8534d6b938 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:05.748542 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c66b3b-8ed7-4808-bd9c-3f8534d6b938 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.749259 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c66b3b-8ed7-4808-bd9c-3f8534d6b938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:05.749569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c66b3b-8ed7-4808-bd9c-3f8534d6b938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:05.751065 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c66b3b-8ed7-4808-bd9c-3f8534d6b938 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-9a78e3f0-86f0-461b-863b-8c073806e938 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:05.764525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:05.765692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:05.766611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:05.766611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:05.766611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:05.766611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:05.766611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:05.766611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:05.766611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:05.766611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:05.766611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 20:29:05.766611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:05.767927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 326/654] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:05.768576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c66b3b-8ed7-4808-bd9c-3f8534d6b938 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:05.770803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 329/655] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:29:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:05.771931 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78e3f0-86f0-461b-863b-8c073806e938 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:05.845735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:05.877709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78e3f0-86f0-461b-863b-8c073806e938 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:05.883988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c66b3b-8ed7-4808-bd9c-3f8534d6b938 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:05.911560 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:05.919516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4882b9-3e5a-41ea-9a4c-e4489d4289d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:05.920616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4882b9-3e5a-41ea-9a4c-e4489d4289d1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:05.921050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4882b9-3e5a-41ea-9a4c-e4489d4289d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:05.921387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4882b9-3e5a-41ea-9a4c-e4489d4289d1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.923771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088c39b-77c9-44b9-9e89-f99b9194e167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:05.924743 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088c39b-77c9-44b9-9e89-f99b9194e167 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:05.925240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088c39b-77c9-44b9-9e89-f99b9194e167 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:05.925737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088c39b-77c9-44b9-9e89-f99b9194e167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:05.930109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4882b9-3e5a-41ea-9a4c-e4489d4289d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:05.931621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4882b9-3e5a-41ea-9a4c-e4489d4289d1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-3c4882b9-3e5a-41ea-9a4c-e4489d4289d1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:05.946480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:05.947514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:05.948459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:05.948459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:05.948459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:05.948459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:05.948459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:05.948459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:05.948459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:05.948459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:05.948459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 20:29:05.948459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:05.948459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 330/656] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:29:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:05.949067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4882b9-3e5a-41ea-9a4c-e4489d4289d1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:06.002769 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088c39b-77c9-44b9-9e89-f99b9194e167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:06.004595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088c39b-77c9-44b9-9e89-f99b9194e167 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:06.054126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4882b9-3e5a-41ea-9a4c-e4489d4289d1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:06.084423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:06.089727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c5bf3-3a57-4934-9b90-079ad92dd693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:06.091394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c5bf3-3a57-4934-9b90-079ad92dd693 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:06.092102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c5bf3-3a57-4934-9b90-079ad92dd693 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:06.092606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c5bf3-3a57-4934-9b90-079ad92dd693 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:06.093785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c5bf3-3a57-4934-9b90-079ad92dd693 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:06.094161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c5bf3-3a57-4934-9b90-079ad92dd693 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:06.095762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c5bf3-3a57-4934-9b90-079ad92dd693 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:06.114260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 331/657] 10.222.0.33 () {56 vars in 1139 bytes} [Wed Jul 6 20:29:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:06.115347 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c5bf3-3a57-4934-9b90-079ad92dd693 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:06.116924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 327/658] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:29:06.119711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088c39b-77c9-44b9-9e89-f99b9194e167 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:06.131677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:06.219325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c5bf3-3a57-4934-9b90-079ad92dd693 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:06.230213 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088c39b-77c9-44b9-9e89-f99b9194e167 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:06.254516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226c7cf-ffd9-4b92-8c0e-4da927cd5a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:06.255321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226c7cf-ffd9-4b92-8c0e-4da927cd5a56 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:06.255646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226c7cf-ffd9-4b92-8c0e-4da927cd5a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:06.255992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226c7cf-ffd9-4b92-8c0e-4da927cd5a56 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:06.257040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226c7cf-ffd9-4b92-8c0e-4da927cd5a56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:06.257442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226c7cf-ffd9-4b92-8c0e-4da927cd5a56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:06.258933 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226c7cf-ffd9-4b92-8c0e-4da927cd5a56 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:06.273644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd991b7-3a35-4007-ae4b-f362119a3020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:06.274320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd991b7-3a35-4007-ae4b-f362119a3020 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:06.274602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd991b7-3a35-4007-ae4b-f362119a3020 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:06.274875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd991b7-3a35-4007-ae4b-f362119a3020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:06.280359 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 332/659] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Jul 6 20:29:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:06.281265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226c7cf-ffd9-4b92-8c0e-4da927cd5a56 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:06.343556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:06.350607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd991b7-3a35-4007-ae4b-f362119a3020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:06.352118 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd991b7-3a35-4007-ae4b-f362119a3020 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:06.353969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:06.402516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226c7cf-ffd9-4b92-8c0e-4da927cd5a56 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:06.440066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8add9-34f1-4b15-97d7-4070d9adc9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:06.440860 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8add9-34f1-4b15-97d7-4070d9adc9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:06.441143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8add9-34f1-4b15-97d7-4070d9adc9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:06.441420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8add9-34f1-4b15-97d7-4070d9adc9a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:06.452276 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8add9-34f1-4b15-97d7-4070d9adc9a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:06.453778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8add9-34f1-4b15-97d7-4070d9adc9a9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:06.461926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 328/660] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:29:06.461926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c97b2-879a-4349-9274-826a6ffd347d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:06.461926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c97b2-879a-4349-9274-826a6ffd347d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:06.461926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c97b2-879a-4349-9274-826a6ffd347d None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:06.461926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 329/661] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:06.461926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c97b2-879a-4349-9274-826a6ffd347d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-16c8add9-34f1-4b15-97d7-4070d9adc9a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:06.474716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:06.475950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:06.477063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:06.477063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:06.477063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:06.477063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:06.480817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 333/662] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:06.481890 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8add9-34f1-4b15-97d7-4070d9adc9a9 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:06.585761 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:06.589838 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8add9-34f1-4b15-97d7-4070d9adc9a9 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:06.592159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c97b2-879a-4349-9274-826a6ffd347d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:06.595529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:06.630257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492f4d6-8c4d-4053-a8c7-6583b9cce085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:06.631194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492f4d6-8c4d-4053-a8c7-6583b9cce085 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:06.631499 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492f4d6-8c4d-4053-a8c7-6583b9cce085 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:06.631783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492f4d6-8c4d-4053-a8c7-6583b9cce085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:06.634009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc85dc-c97d-4764-a917-8bffd4c89291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:06.634660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc85dc-c97d-4764-a917-8bffd4c89291 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:06.634968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc85dc-c97d-4764-a917-8bffd4c89291 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:06.635248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc85dc-c97d-4764-a917-8bffd4c89291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:06.644076 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492f4d6-8c4d-4053-a8c7-6583b9cce085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:06.645756 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492f4d6-8c4d-4053-a8c7-6583b9cce085 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-0492f4d6-8c4d-4053-a8c7-6583b9cce085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:06.664064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:06.664959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:06.665849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:06.665849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:06.665849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:06.665849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:06.665849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 334/663] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:06.666829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dfca9-199d-4484-8f4f-26ca45a6396c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:06.666829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dfca9-199d-4484-8f4f-26ca45a6396c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:06.667003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dfca9-199d-4484-8f4f-26ca45a6396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:06.686623 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-345dfca9-199d-4484-8f4f-26ca45a6396c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:06.688052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-345dfca9-199d-4484-8f4f-26ca45a6396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:06.712716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc85dc-c97d-4764-a917-8bffd4c89291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:06.713934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc85dc-c97d-4764-a917-8bffd4c89291 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:06.759208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 335/664] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:29:06.759208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dfca9-199d-4484-8f4f-26ca45a6396c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:06.827878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 330/665] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:29:06.829329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc85dc-c97d-4764-a917-8bffd4c89291 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:06.832026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:06.853096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:06.873492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dfca9-199d-4484-8f4f-26ca45a6396c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:06.909867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3e26f-e861-4d2b-9c72-88603be6d096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:06.910551 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3e26f-e861-4d2b-9c72-88603be6d096 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:06.910834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3e26f-e861-4d2b-9c72-88603be6d096 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:06.911116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3e26f-e861-4d2b-9c72-88603be6d096 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:06.911880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3e26f-e861-4d2b-9c72-88603be6d096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:06.912194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3e26f-e861-4d2b-9c72-88603be6d096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:06.913621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3e26f-e861-4d2b-9c72-88603be6d096 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:06.926295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 336/666] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:06.927354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3e26f-e861-4d2b-9c72-88603be6d096 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:06.953228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc85dc-c97d-4764-a917-8bffd4c89291 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:06.991623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761105a5-a99b-4dd6-a28a-42bc57a2c00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:06.992660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761105a5-a99b-4dd6-a28a-42bc57a2c00a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:06.993150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761105a5-a99b-4dd6-a28a-42bc57a2c00a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:06.993635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761105a5-a99b-4dd6-a28a-42bc57a2c00a None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:06.994593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761105a5-a99b-4dd6-a28a-42bc57a2c00a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:06.995103 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761105a5-a99b-4dd6-a28a-42bc57a2c00a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:06.996721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761105a5-a99b-4dd6-a28a-42bc57a2c00a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:07.009860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 331/667] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:07.011045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761105a5-a99b-4dd6-a28a-42bc57a2c00a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:07.042291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3e26f-e861-4d2b-9c72-88603be6d096 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:07.077460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:07.079910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec81dfb-e0e8-43a4-bd24-1c3914c5cca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:07.080875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec81dfb-e0e8-43a4-bd24-1c3914c5cca3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:07.081156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec81dfb-e0e8-43a4-bd24-1c3914c5cca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:07.081429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec81dfb-e0e8-43a4-bd24-1c3914c5cca3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:07.092646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec81dfb-e0e8-43a4-bd24-1c3914c5cca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-aec81dfb-e0e8-43a4-bd24-1c3914c5cca3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:07.100321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:07.101285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:07.102157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:07.102157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:07.102157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:07.102157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:07.102157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:07.102157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:07.102157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:07.102157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:07.102157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:07.102157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:07.102157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:07.102157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:07.102157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 337/668] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:29:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:07.102853 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec81dfb-e0e8-43a4-bd24-1c3914c5cca3 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:07.111073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:07.125017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761105a5-a99b-4dd6-a28a-42bc57a2c00a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:07.167285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee11e4-526d-4f76-b738-70e8fe5377ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:07.168095 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee11e4-526d-4f76-b738-70e8fe5377ec None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:07.168378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee11e4-526d-4f76-b738-70e8fe5377ec None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:07.168707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee11e4-526d-4f76-b738-70e8fe5377ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:07.181460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee11e4-526d-4f76-b738-70e8fe5377ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:07.182169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee11e4-526d-4f76-b738-70e8fe5377ec None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f7ee11e4-526d-4f76-b738-70e8fe5377ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:07.199386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:07.201250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:07.202152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:07.202152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:07.202152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:07.202152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:07.202152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 332/669] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:07.202152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee11e4-526d-4f76-b738-70e8fe5377ec None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:07.221706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec81dfb-e0e8-43a4-bd24-1c3914c5cca3 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:07.258067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a60dd7-fcc0-4fb6-bd5b-cf7802ece1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:07.258857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a60dd7-fcc0-4fb6-bd5b-cf7802ece1dd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:07.259328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a60dd7-fcc0-4fb6-bd5b-cf7802ece1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:07.259625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a60dd7-fcc0-4fb6-bd5b-cf7802ece1dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:07.267969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a60dd7-fcc0-4fb6-bd5b-cf7802ece1dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:07.269534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a60dd7-fcc0-4fb6-bd5b-cf7802ece1dd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-77a60dd7-fcc0-4fb6-bd5b-cf7802ece1dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:07.284834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:07.285726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:07.286604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:07.286604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:07.286604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:07.286604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:07.286604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:07.286604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:07.286604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:07.286604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:07.286604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 338/670] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:07.287813 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a60dd7-fcc0-4fb6-bd5b-cf7802ece1dd None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:07.307873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee11e4-526d-4f76-b738-70e8fe5377ec None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:07.323577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:07.347256 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aab17-29e7-40c2-8302-1fe0c850e6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:07.348052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aab17-29e7-40c2-8302-1fe0c850e6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:07.348340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aab17-29e7-40c2-8302-1fe0c850e6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:07.348618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03aab17-29e7-40c2-8302-1fe0c850e6c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:07.354519 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:07.356550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03aab17-29e7-40c2-8302-1fe0c850e6c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:07.358229 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03aab17-29e7-40c2-8302-1fe0c850e6c2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b03aab17-29e7-40c2-8302-1fe0c850e6c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:07.374540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:07.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:07.376478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:07.376478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:07.376478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:07.376478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:07.376478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:07.376478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:07.376478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:07.376478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:07.376478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 333/671] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:07.376955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aab17-29e7-40c2-8302-1fe0c850e6c2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:07.400389 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a60dd7-fcc0-4fb6-bd5b-cf7802ece1dd None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:07.437443 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d35469-1f8d-4d73-a069-596f53701fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:07.438036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35469-1f8d-4d73-a069-596f53701fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:07.438319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35469-1f8d-4d73-a069-596f53701fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:07.438598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35469-1f8d-4d73-a069-596f53701fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:07.439369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d35469-1f8d-4d73-a069-596f53701fb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:07.439683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d35469-1f8d-4d73-a069-596f53701fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:07.441049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d35469-1f8d-4d73-a069-596f53701fb9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:07.448765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 339/672] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:07.449543 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d35469-1f8d-4d73-a069-596f53701fb9 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:07.484209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03aab17-29e7-40c2-8302-1fe0c850e6c2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:07.519826 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf52e7d-a944-4d77-9f10-e836c7cf2bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:07.519998 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf52e7d-a944-4d77-9f10-e836c7cf2bfe None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:07.520165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf52e7d-a944-4d77-9f10-e836c7cf2bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:07.520441 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf52e7d-a944-4d77-9f10-e836c7cf2bfe None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:07.521167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf52e7d-a944-4d77-9f10-e836c7cf2bfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:07.521475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf52e7d-a944-4d77-9f10-e836c7cf2bfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:07.522847 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf52e7d-a944-4d77-9f10-e836c7cf2bfe None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:07.534918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 334/673] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:07.535752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf52e7d-a944-4d77-9f10-e836c7cf2bfe None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:07.549003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d35469-1f8d-4d73-a069-596f53701fb9 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:07.571949 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:07.572750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:07.584276 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0c592-f147-45c1-8368-44d82eb94cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:07.584947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0c592-f147-45c1-8368-44d82eb94cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:07.585237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0c592-f147-45c1-8368-44d82eb94cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:07.585523 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0c592-f147-45c1-8368-44d82eb94cc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:07.586313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0c592-f147-45c1-8368-44d82eb94cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:07.586856 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0c592-f147-45c1-8368-44d82eb94cc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:07.588097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0c592-f147-45c1-8368-44d82eb94cc6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:07.601074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 340/674] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:07.602419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b79b-8121-4973-96a9-a51d5b4b32c2 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:07.602708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b79b-8121-4973-96a9-a51d5b4b32c2 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:07.602983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b79b-8121-4973-96a9-a51d5b4b32c2 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:07.604248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 341/675] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:07.604929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562b79b-8121-4973-96a9-a51d5b4b32c2 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:07.640547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf52e7d-a944-4d77-9f10-e836c7cf2bfe None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:07.674380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b444e80-8ff6-4fb4-8dde-8efe1522e037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:07.675037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b444e80-8ff6-4fb4-8dde-8efe1522e037 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:07.675347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b444e80-8ff6-4fb4-8dde-8efe1522e037 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:07.675623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b444e80-8ff6-4fb4-8dde-8efe1522e037 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:07.676400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b444e80-8ff6-4fb4-8dde-8efe1522e037 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:07.676710 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b444e80-8ff6-4fb4-8dde-8efe1522e037 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:07.678132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b444e80-8ff6-4fb4-8dde-8efe1522e037 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:07.689748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 335/676] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:07.690465 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b444e80-8ff6-4fb4-8dde-8efe1522e037 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:07.706001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562b79b-8121-4973-96a9-a51d5b4b32c2 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:07.739820 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d1ad0-2f8c-452f-a657-8930e4e8bb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:07.740603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d1ad0-2f8c-452f-a657-8930e4e8bb74 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:07.740881 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d1ad0-2f8c-452f-a657-8930e4e8bb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:07.741159 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d1ad0-2f8c-452f-a657-8930e4e8bb74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:07.751026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d1ad0-2f8c-452f-a657-8930e4e8bb74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:07.752489 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d1ad0-2f8c-452f-a657-8930e4e8bb74 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-7b0d1ad0-2f8c-452f-a657-8930e4e8bb74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:07.769568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:07.770625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:07.771776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:07.771776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:07.771776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:07.771776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:07.771776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 342/677] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:07.771776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d1ad0-2f8c-452f-a657-8930e4e8bb74 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:07.784351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:07.791704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b444e80-8ff6-4fb4-8dde-8efe1522e037 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:07.805804 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:07.826991 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3ad26-26b6-4415-90da-9324285e88a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:07.827822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3ad26-26b6-4415-90da-9324285e88a4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:07.828104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3ad26-26b6-4415-90da-9324285e88a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:07.828654 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3ad26-26b6-4415-90da-9324285e88a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:07.834874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3ad26-26b6-4415-90da-9324285e88a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:07.836353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3ad26-26b6-4415-90da-9324285e88a4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-7aa3ad26-26b6-4415-90da-9324285e88a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:07.850193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:07.851305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:07.852579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:07.852579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:07.852579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:07.852579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:07.852579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:07.852579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:07.852579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:07.852579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:07.852579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 336/678] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:07.853194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c70e9-2ea4-492b-a550-e4d6dfb8a6d8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:07.853194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c70e9-2ea4-492b-a550-e4d6dfb8a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:07.853194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c70e9-2ea4-492b-a550-e4d6dfb8a6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:07.868814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d19c70e9-2ea4-492b-a550-e4d6dfb8a6d8 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:07.870005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d19c70e9-2ea4-492b-a550-e4d6dfb8a6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:07.876274 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d1ad0-2f8c-452f-a657-8930e4e8bb74 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:07.910503 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009a1f1-3635-497c-b10d-11ec3b640fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:07.911155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009a1f1-3635-497c-b10d-11ec3b640fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:07.911463 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009a1f1-3635-497c-b10d-11ec3b640fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:07.911739 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009a1f1-3635-497c-b10d-11ec3b640fa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:07.912559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009a1f1-3635-497c-b10d-11ec3b640fa4 None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=4693da03c42e4328b74869abd0ae4b80) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:07.912867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009a1f1-3635-497c-b10d-11ec3b640fa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:07.914287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009a1f1-3635-497c-b10d-11ec3b640fa4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:07.920801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 343/679] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:07 2022] GET /identity/v3/role_assignments?user.id=4693da03c42e4328b74869abd0ae4b80&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:07.921579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009a1f1-3635-497c-b10d-11ec3b640fa4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:07.941500 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 337/680] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:29:07.943500 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c70e9-2ea4-492b-a550-e4d6dfb8a6d8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:08.044661 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:08.052449 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:08.055953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009a1f1-3635-497c-b10d-11ec3b640fa4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:08.063812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c70e9-2ea4-492b-a550-e4d6dfb8a6d8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:08.099133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b29c73-7413-4234-8f76-5a1b057d7444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:08.100129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b29c73-7413-4234-8f76-5a1b057d7444 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:08.100129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b29c73-7413-4234-8f76-5a1b057d7444 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:08.100348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b29c73-7413-4234-8f76-5a1b057d7444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:08.101664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b29c73-7413-4234-8f76-5a1b057d7444 None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=d7bb4a244df24a19b4c3ad3d1ad2bc7c) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:08.101664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b29c73-7413-4234-8f76-5a1b057d7444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:08.103530 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b29c73-7413-4234-8f76-5a1b057d7444 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:08.104164 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7593f-c268-4055-80b8-879b43c46b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:08.104837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7593f-c268-4055-80b8-879b43c46b4d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:08.105126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7593f-c268-4055-80b8-879b43c46b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:08.105405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7593f-c268-4055-80b8-879b43c46b4d None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:08.106641 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7593f-c268-4055-80b8-879b43c46b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:08.107512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7593f-c268-4055-80b8-879b43c46b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:08.108903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7593f-c268-4055-80b8-879b43c46b4d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:08.112106 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 344/681] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:07 2022] GET /identity/v3/role_assignments?user.id=d7bb4a244df24a19b4c3ad3d1ad2bc7c&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:08.112986 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b29c73-7413-4234-8f76-5a1b057d7444 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:08.131398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 338/682] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:08.131398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7593f-c268-4055-80b8-879b43c46b4d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:08.247474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7593f-c268-4055-80b8-879b43c46b4d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:08.259612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b29c73-7413-4234-8f76-5a1b057d7444 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:08.296002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb88216-8695-4276-b004-09dcbc7fa942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:08.297456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb88216-8695-4276-b004-09dcbc7fa942 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:08.298006 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb88216-8695-4276-b004-09dcbc7fa942 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:08.298528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb88216-8695-4276-b004-09dcbc7fa942 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:08.302549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1112d-e161-4aef-bf91-eb594176b059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:08.302696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1112d-e161-4aef-bf91-eb594176b059 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:08.302970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1112d-e161-4aef-bf91-eb594176b059 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:08.303282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1112d-e161-4aef-bf91-eb594176b059 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:08.304078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1112d-e161-4aef-bf91-eb594176b059 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:08.304394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1112d-e161-4aef-bf91-eb594176b059 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:08.305827 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1112d-e161-4aef-bf91-eb594176b059 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:08.312375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb88216-8695-4276-b004-09dcbc7fa942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:08.320812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 345/683] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-bdb88216-8695-4276-b004-09dcbc7fa942 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:08.321000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:08.322597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:08.323450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:08.323450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:08.323450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:08.323450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:08.323450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:08.323450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:08.323450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:08.323450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:08.323450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:08.323450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:08.323450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:08.323450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:08.324083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1112d-e161-4aef-bf91-eb594176b059 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:08.326431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 339/684] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:29:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:08.328211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb88216-8695-4276-b004-09dcbc7fa942 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:08.333475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:08.361496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:08.453981 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb88216-8695-4276-b004-09dcbc7fa942 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:08.462290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1112d-e161-4aef-bf91-eb594176b059 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:08.498115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a3d3f-f665-45ff-8571-ddac2e075642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:08.499121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a3d3f-f665-45ff-8571-ddac2e075642 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:08.499445 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a3d3f-f665-45ff-8571-ddac2e075642 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:08.499731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a3d3f-f665-45ff-8571-ddac2e075642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:08.500841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a3d3f-f665-45ff-8571-ddac2e075642 None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=f892e618b01a46aaaab4f79aa0c3daa9) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:08.501407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a3d3f-f665-45ff-8571-ddac2e075642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:08.503531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a3d3f-f665-45ff-8571-ddac2e075642 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:08.519201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366786-cf83-4d00-9418-3f269b72e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:08.519201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366786-cf83-4d00-9418-3f269b72e990 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:08.519201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366786-cf83-4d00-9418-3f269b72e990 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:08.519201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366786-cf83-4d00-9418-3f269b72e990 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:08.519639 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 340/685] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:08 2022] GET /identity/v3/role_assignments?user.id=f892e618b01a46aaaab4f79aa0c3daa9&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:08.519639 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a3d3f-f665-45ff-8571-ddac2e075642 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:08.537054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f366786-cf83-4d00-9418-3f269b72e990 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:08.538624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f366786-cf83-4d00-9418-3f269b72e990 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-9f366786-cf83-4d00-9418-3f269b72e990 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:08.576493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:08.577518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:08.578465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:08.578465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:08.578465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:08.578465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:08.578465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:08.578465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:08.578465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:08.578465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:08.578465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:29:08.578465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:08.578465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 346/686] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:29:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:08.585121 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366786-cf83-4d00-9418-3f269b72e990 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:08.628939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:08.698174 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a3d3f-f665-45ff-8571-ddac2e075642 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:08.724726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:08.749946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366786-cf83-4d00-9418-3f269b72e990 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:08.755444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb5486-51f7-4391-8058-c70c0c083d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:08.756249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb5486-51f7-4391-8058-c70c0c083d60 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:08.756631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb5486-51f7-4391-8058-c70c0c083d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:08.757004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb5486-51f7-4391-8058-c70c0c083d60 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:08.757858 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb5486-51f7-4391-8058-c70c0c083d60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:08.758267 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb5486-51f7-4391-8058-c70c0c083d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:08.759782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb5486-51f7-4391-8058-c70c0c083d60 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:08.774201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 341/687] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:29:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:08.782069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb5486-51f7-4391-8058-c70c0c083d60 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:08.805888 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc758863-f75f-4183-a38a-12e99d88cb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:08.807055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc758863-f75f-4183-a38a-12e99d88cb6d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:08.808742 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc758863-f75f-4183-a38a-12e99d88cb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:08.809238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc758863-f75f-4183-a38a-12e99d88cb6d None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:08.810550 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc758863-f75f-4183-a38a-12e99d88cb6d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:08.811029 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc758863-f75f-4183-a38a-12e99d88cb6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:08.813915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc758863-f75f-4183-a38a-12e99d88cb6d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:08.838901 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 347/688] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Jul 6 20:29:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:08.846125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc758863-f75f-4183-a38a-12e99d88cb6d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:08.935966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb5486-51f7-4391-8058-c70c0c083d60 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:08.978077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc758863-f75f-4183-a38a-12e99d88cb6d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:08.980496 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:08.989597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a49dc-df30-40e0-9fa1-e2c508b97f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:08.990417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a49dc-df30-40e0-9fa1-e2c508b97f3b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:08.990708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a49dc-df30-40e0-9fa1-e2c508b97f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:08.991044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a49dc-df30-40e0-9fa1-e2c508b97f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:09.006953 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a49dc-df30-40e0-9fa1-e2c508b97f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:09.009351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a49dc-df30-40e0-9fa1-e2c508b97f3b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:09.023922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bbccb-1138-41ed-af6a-4319dbb5abe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:09.024810 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bbccb-1138-41ed-af6a-4319dbb5abe5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:09.025244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bbccb-1138-41ed-af6a-4319dbb5abe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:09.025679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bbccb-1138-41ed-af6a-4319dbb5abe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-397a49dc-df30-40e0-9fa1-e2c508b97f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:09.032564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:09.033651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:09.034740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:09.034740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:09.034740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:09.034740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:09.034740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 342/689] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:09.039877 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a49dc-df30-40e0-9fa1-e2c508b97f3b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:09.042310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:09.106000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bbccb-1138-41ed-af6a-4319dbb5abe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:09.107767 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bbccb-1138-41ed-af6a-4319dbb5abe5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:09.168222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a49dc-df30-40e0-9fa1-e2c508b97f3b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:09.235841 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 348/690] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 20:29:09.245274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071a29b-25d2-427f-bdb0-87af69054475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:09.246257 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071a29b-25d2-427f-bdb0-87af69054475 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:09.247358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071a29b-25d2-427f-bdb0-87af69054475 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:09.248125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071a29b-25d2-427f-bdb0-87af69054475 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:09.248736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bbccb-1138-41ed-af6a-4319dbb5abe5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:09.249314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071a29b-25d2-427f-bdb0-87af69054475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:09.249827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071a29b-25d2-427f-bdb0-87af69054475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:09.251666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071a29b-25d2-427f-bdb0-87af69054475 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:09.272034 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 343/691] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:09.280611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071a29b-25d2-427f-bdb0-87af69054475 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:09.315439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:09.367541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:09.433448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bbccb-1138-41ed-af6a-4319dbb5abe5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:09.437508 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071a29b-25d2-427f-bdb0-87af69054475 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:09.474421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08011342-7035-41e7-bc66-29468a4a20f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:09.475620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08011342-7035-41e7-bc66-29468a4a20f6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:09.476111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08011342-7035-41e7-bc66-29468a4a20f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:09.476612 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08011342-7035-41e7-bc66-29468a4a20f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:09.485367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08011342-7035-41e7-bc66-29468a4a20f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:09.487154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08011342-7035-41e7-bc66-29468a4a20f6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:09.496252 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f3857-06a8-4f31-bcf7-da7cf9879280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:09.497246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f3857-06a8-4f31-bcf7-da7cf9879280 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:09.497535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f3857-06a8-4f31-bcf7-da7cf9879280 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:09.497812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f3857-06a8-4f31-bcf7-da7cf9879280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-08011342-7035-41e7-bc66-29468a4a20f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:09.505137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:09.506142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:09.507085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:09.507085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:09.507085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:09.507085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:09.507085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:09.507085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:09.507085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:09.507085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:09.507085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:09.507085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:09.509260 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 344/692] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jul 6 20:29:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:09.515704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08011342-7035-41e7-bc66-29468a4a20f6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:09.521574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f3857-06a8-4f31-bcf7-da7cf9879280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:09.523110 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f3857-06a8-4f31-bcf7-da7cf9879280 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-022f3857-06a8-4f31-bcf7-da7cf9879280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:09.567712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:09.568862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:09.569953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:09.569953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:09.569953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:09.569953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:09.569953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 349/693] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:09.577404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f3857-06a8-4f31-bcf7-da7cf9879280 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:09.633154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08011342-7035-41e7-bc66-29468a4a20f6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:09.634686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:09.681544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8a44c-a909-4137-bab2-ac1d2aabc52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:09.682221 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8a44c-a909-4137-bab2-ac1d2aabc52b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:09.682509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8a44c-a909-4137-bab2-ac1d2aabc52b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:09.682789 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8a44c-a909-4137-bab2-ac1d2aabc52b None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:09.683657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8a44c-a909-4137-bab2-ac1d2aabc52b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:09.683996 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8a44c-a909-4137-bab2-ac1d2aabc52b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:09.686156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8a44c-a909-4137-bab2-ac1d2aabc52b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:09.704575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 345/694] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jul 6 20:29:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:09.709975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8a44c-a909-4137-bab2-ac1d2aabc52b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:09.810033 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:09.814616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8a44c-a909-4137-bab2-ac1d2aabc52b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:09.825341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f3857-06a8-4f31-bcf7-da7cf9879280 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:09.851380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a8538-c93c-43fc-8ea0-15bd8fb00ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:09.852047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a8538-c93c-43fc-8ea0-15bd8fb00ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:09.852351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a8538-c93c-43fc-8ea0-15bd8fb00ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:09.852616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a8538-c93c-43fc-8ea0-15bd8fb00ee5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:09.882583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:09.901156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238288e2-5d24-460a-a8a3-6f83ce57af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:09.901830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238288e2-5d24-460a-a8a3-6f83ce57af28 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:09.902119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238288e2-5d24-460a-a8a3-6f83ce57af28 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:09.902399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238288e2-5d24-460a-a8a3-6f83ce57af28 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:09.903885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238288e2-5d24-460a-a8a3-6f83ce57af28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:09.904200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238288e2-5d24-460a-a8a3-6f83ce57af28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:09.906237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238288e2-5d24-460a-a8a3-6f83ce57af28 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:09.919673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 350/695] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:09.925696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238288e2-5d24-460a-a8a3-6f83ce57af28 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:09.959911 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a8538-c93c-43fc-8ea0-15bd8fb00ee5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:09.961395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a8538-c93c-43fc-8ea0-15bd8fb00ee5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:10.095595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 346/696] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 20:29:10.096043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a8538-c93c-43fc-8ea0-15bd8fb00ee5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:10.149085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238288e2-5d24-460a-a8a3-6f83ce57af28 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:10.169955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:10.202020 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a8538-c93c-43fc-8ea0-15bd8fb00ee5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:10.236625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0157f9-2d99-4dfd-b2a9-0312c958e4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:10.237441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0157f9-2d99-4dfd-b2a9-0312c958e4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:10.237728 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0157f9-2d99-4dfd-b2a9-0312c958e4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:10.238007 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0157f9-2d99-4dfd-b2a9-0312c958e4b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:10.255326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0157f9-2d99-4dfd-b2a9-0312c958e4b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:10.256811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0157f9-2d99-4dfd-b2a9-0312c958e4b7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:10.273914 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d71679-08b2-49ec-aa08-2704052abc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:10.275347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d71679-08b2-49ec-aa08-2704052abc3c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:10.275797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d71679-08b2-49ec-aa08-2704052abc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:10.276083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d71679-08b2-49ec-aa08-2704052abc3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:10.287965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d71679-08b2-49ec-aa08-2704052abc3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:10.289602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d71679-08b2-49ec-aa08-2704052abc3c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-5c0157f9-2d99-4dfd-b2a9-0312c958e4b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:10.290721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:10.291621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:10.292484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:10.292484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:10.292484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:10.292484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:10.292484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:10.292484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:10.292484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:10.292484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:10.299607 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 351/697] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:10.308770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0157f9-2d99-4dfd-b2a9-0312c958e4b7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e9d71679-08b2-49ec-aa08-2704052abc3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:10.319539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:10.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:10.321311 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:10.321311 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:10.321311 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:10.321311 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:10.328123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 347/698] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:10.335386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d71679-08b2-49ec-aa08-2704052abc3c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:10.364009 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:10.461512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0157f9-2d99-4dfd-b2a9-0312c958e4b7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:10.466082 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d71679-08b2-49ec-aa08-2704052abc3c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:10.482911 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:10.508963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23180a81-6222-4cd2-841b-6a10d56c35f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:10.509773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23180a81-6222-4cd2-841b-6a10d56c35f1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:10.510177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23180a81-6222-4cd2-841b-6a10d56c35f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:10.510556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23180a81-6222-4cd2-841b-6a10d56c35f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:10.511524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23180a81-6222-4cd2-841b-6a10d56c35f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:10.511903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23180a81-6222-4cd2-841b-6a10d56c35f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:10.512687 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb4649-9fc5-484d-86a4-d6f39612e268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:10.513670 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23180a81-6222-4cd2-841b-6a10d56c35f1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:10.513878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb4649-9fc5-484d-86a4-d6f39612e268 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:10.514301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb4649-9fc5-484d-86a4-d6f39612e268 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:10.514728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb4649-9fc5-484d-86a4-d6f39612e268 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:10.515627 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb4649-9fc5-484d-86a4-d6f39612e268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:10.516091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb4649-9fc5-484d-86a4-d6f39612e268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:10.517872 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb4649-9fc5-484d-86a4-d6f39612e268 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:10.535411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 352/700] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:10.535411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfa821-4b4e-47c2-863c-657b25a0f3ea None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:10.535411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfa821-4b4e-47c2-863c-657b25a0f3ea None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:10.535411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfa821-4b4e-47c2-863c-657b25a0f3ea None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:10.535411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 353/701] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:10.535904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 348/701] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:10.540809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb4649-9fc5-484d-86a4-d6f39612e268 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:10.541133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfa821-4b4e-47c2-863c-657b25a0f3ea None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:10.644426 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:10.676589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfa821-4b4e-47c2-863c-657b25a0f3ea None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:10.678824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb4649-9fc5-484d-86a4-d6f39612e268 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:10.710494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd0433-2c89-4b56-be2f-cd54b5b2af2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:10.711333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd0433-2c89-4b56-be2f-cd54b5b2af2a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:10.711626 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd0433-2c89-4b56-be2f-cd54b5b2af2a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:10.711905 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd0433-2c89-4b56-be2f-cd54b5b2af2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:10.717921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291026d-50a9-4122-8345-3272b6c231ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:10.719059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291026d-50a9-4122-8345-3272b6c231ab None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:10.719325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd0433-2c89-4b56-be2f-cd54b5b2af2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:10.719767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291026d-50a9-4122-8345-3272b6c231ab None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:10.720216 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291026d-50a9-4122-8345-3272b6c231ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:10.720783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd0433-2c89-4b56-be2f-cd54b5b2af2a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:10.721583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291026d-50a9-4122-8345-3272b6c231ab None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=88dff378ccb4497fb305563614ea4caa) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:10.722085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291026d-50a9-4122-8345-3272b6c231ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:10.724314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291026d-50a9-4122-8345-3272b6c231ab None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:10.730785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 349/702] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:10 2022] GET /identity/v3/role_assignments?user.id=88dff378ccb4497fb305563614ea4caa&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:10.732810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906aba6-9ee3-43be-95af-fa60c17d9191 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:10.733261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906aba6-9ee3-43be-95af-fa60c17d9191 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:10.733695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906aba6-9ee3-43be-95af-fa60c17d9191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-80fd0433-2c89-4b56-be2f-cd54b5b2af2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:10.735696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:10.736565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:10.737472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:10.737472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:10.737472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:10.737472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:10.737472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:10.737472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:10.737472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:10.737472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:10.737472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 354/703] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:10.738531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df374d6-1b6a-447f-b539-48453086b4b6 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:10.738819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df374d6-1b6a-447f-b539-48453086b4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:10.739102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df374d6-1b6a-447f-b539-48453086b4b6 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:10.744176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 355/704] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:10.744176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df374d6-1b6a-447f-b539-48453086b4b6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:10.763764 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3906aba6-9ee3-43be-95af-fa60c17d9191 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:10.765813 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3906aba6-9ee3-43be-95af-fa60c17d9191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:10.815895 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:10.864177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 350/705] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:29:10.866506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9c2dc-0f80-4a65-84b1-504b42e7e731 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:10.867056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9c2dc-0f80-4a65-84b1-504b42e7e731 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:10.867528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9c2dc-0f80-4a65-84b1-504b42e7e731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:10.877034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df374d6-1b6a-447f-b539-48453086b4b6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:10.886848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-eec9c2dc-0f80-4a65-84b1-504b42e7e731 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:10.889185 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-eec9c2dc-0f80-4a65-84b1-504b42e7e731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:10.925765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4ee8e-3a54-403e-8c12-f7ef6539282c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:10.926468 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4ee8e-3a54-403e-8c12-f7ef6539282c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:10.926756 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4ee8e-3a54-403e-8c12-f7ef6539282c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:10.927036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4ee8e-3a54-403e-8c12-f7ef6539282c None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:10.927865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4ee8e-3a54-403e-8c12-f7ef6539282c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:10.928188 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4ee8e-3a54-403e-8c12-f7ef6539282c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:10.929621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4ee8e-3a54-403e-8c12-f7ef6539282c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:10.931564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:10.948750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 356/706] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:10.949045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4ee8e-3a54-403e-8c12-f7ef6539282c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:10.979289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 351/707] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:29:10.980150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9c2dc-0f80-4a65-84b1-504b42e7e731 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:11.067095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4ee8e-3a54-403e-8c12-f7ef6539282c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:11.096608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:11.102515 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9c2dc-0f80-4a65-84b1-504b42e7e731 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:11.118170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001b84a-d3f1-47cd-b371-be20a10a0be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:11.119378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001b84a-d3f1-47cd-b371-be20a10a0be2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:11.119664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001b84a-d3f1-47cd-b371-be20a10a0be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:11.119939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001b84a-d3f1-47cd-b371-be20a10a0be2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:11.120589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001b84a-d3f1-47cd-b371-be20a10a0be2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:11.122611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001b84a-d3f1-47cd-b371-be20a10a0be2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-e001b84a-d3f1-47cd-b371-be20a10a0be2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:11.137149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:11.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:11.139107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 357/708] 10.222.0.33 () {56 vars in 1129 bytes} [Wed Jul 6 20:29:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:11.140547 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001b84a-d3f1-47cd-b371-be20a10a0be2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:11.145074 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbd7ee-7d0b-4f22-adad-3d7695a7b6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:11.145748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd7ee-7d0b-4f22-adad-3d7695a7b6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:11.146034 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd7ee-7d0b-4f22-adad-3d7695a7b6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:11.146310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd7ee-7d0b-4f22-adad-3d7695a7b6b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:11.147144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd7ee-7d0b-4f22-adad-3d7695a7b6b2 None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=3d68c8fdb65343b8b2f58070addeaf13) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:11.147493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd7ee-7d0b-4f22-adad-3d7695a7b6b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:11.148947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd7ee-7d0b-4f22-adad-3d7695a7b6b2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:11.163862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 352/709] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:10 2022] GET /identity/v3/role_assignments?user.id=3d68c8fdb65343b8b2f58070addeaf13&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:11.164911 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9e686-217c-4dba-a8b8-a2e2c3392a97 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:11.165209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9e686-217c-4dba-a8b8-a2e2c3392a97 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:11.165498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9e686-217c-4dba-a8b8-a2e2c3392a97 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:11.167069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 353/710] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:11.167567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9e686-217c-4dba-a8b8-a2e2c3392a97 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:11.213855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:11.275314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001b84a-d3f1-47cd-b371-be20a10a0be2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:11.310732 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9e686-217c-4dba-a8b8-a2e2c3392a97 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:11.328148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e32c5-cd12-4674-8c6a-35ed5703d434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:11.328951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e32c5-cd12-4674-8c6a-35ed5703d434 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:11.329231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e32c5-cd12-4674-8c6a-35ed5703d434 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:11.329503 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e32c5-cd12-4674-8c6a-35ed5703d434 None admin] PATH_INFO: `/v3/services/network` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:11.330156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e32c5-cd12-4674-8c6a-35ed5703d434 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:11.331559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e32c5-cd12-4674-8c6a-35ed5703d434 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-fc5e32c5-cd12-4674-8c6a-35ed5703d434 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:11.347077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:11.348425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:29:11.349286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:11.353505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 358/711] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:11 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:11.354909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2587-18eb-4f45-bed5-2191267dcd8a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:11.355276 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2587-18eb-4f45-bed5-2191267dcd8a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:11.355500 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2587-18eb-4f45-bed5-2191267dcd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:11.359867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38823332-280b-4cd8-9445-8487e154f37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:11.360752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38823332-280b-4cd8-9445-8487e154f37b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:11.361206 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38823332-280b-4cd8-9445-8487e154f37b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:11.361934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38823332-280b-4cd8-9445-8487e154f37b None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:11.363780 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38823332-280b-4cd8-9445-8487e154f37b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:11.364245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38823332-280b-4cd8-9445-8487e154f37b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:11.365865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38823332-280b-4cd8-9445-8487e154f37b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:11.376833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 354/712] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Jul 6 20:29:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:11.376999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7bec2587-18eb-4f45-bed5-2191267dcd8a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:11.376999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7bec2587-18eb-4f45-bed5-2191267dcd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:11.378376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38823332-280b-4cd8-9445-8487e154f37b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:11.411573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:11.465294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 359/713] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:29:11.467026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2587-18eb-4f45-bed5-2191267dcd8a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:11.505437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38823332-280b-4cd8-9445-8487e154f37b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:11.541862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:11.542614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096331e7-0f7e-4d58-9ac2-0d766d18cc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:11.543649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096331e7-0f7e-4d58-9ac2-0d766d18cc22 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:11.544438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096331e7-0f7e-4d58-9ac2-0d766d18cc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:11.544867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096331e7-0f7e-4d58-9ac2-0d766d18cc22 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:11.545728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096331e7-0f7e-4d58-9ac2-0d766d18cc22 None admin] RBAC: Adding query filter params (name=network) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:11.546180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096331e7-0f7e-4d58-9ac2-0d766d18cc22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:11.547744 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096331e7-0f7e-4d58-9ac2-0d766d18cc22 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:11.553812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 355/714] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jul 6 20:29:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:11.554877 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096331e7-0f7e-4d58-9ac2-0d766d18cc22 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:11.607413 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2587-18eb-4f45-bed5-2191267dcd8a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:11.657401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189cf18-00a7-4571-b013-69121559c387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:11.658328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189cf18-00a7-4571-b013-69121559c387 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:11.658626 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189cf18-00a7-4571-b013-69121559c387 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:11.658910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189cf18-00a7-4571-b013-69121559c387 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:11.660160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189cf18-00a7-4571-b013-69121559c387 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:11.660478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189cf18-00a7-4571-b013-69121559c387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:11.662168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189cf18-00a7-4571-b013-69121559c387 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:11.666836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:11.672148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 360/715] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Jul 6 20:29:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:11.674310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189cf18-00a7-4571-b013-69121559c387 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:11.704075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096331e7-0f7e-4d58-9ac2-0d766d18cc22 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:11.775952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076fc36-642b-491a-9eb5-c17563be8715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:11.777071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076fc36-642b-491a-9eb5-c17563be8715 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:11.777560 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076fc36-642b-491a-9eb5-c17563be8715 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:11.778076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076fc36-642b-491a-9eb5-c17563be8715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:11.792060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076fc36-642b-491a-9eb5-c17563be8715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:11.795119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076fc36-642b-491a-9eb5-c17563be8715 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-8076fc36-642b-491a-9eb5-c17563be8715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:11.818476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:11.819740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:11.820648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:11.820648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:11.820648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:11.820648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:11.821165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 356/716] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:11.827573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076fc36-642b-491a-9eb5-c17563be8715 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:11.897775 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189cf18-00a7-4571-b013-69121559c387 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:11.921004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:11.944010 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3f34e-8498-4371-af97-8af59104e1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:11.944863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3f34e-8498-4371-af97-8af59104e1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:11.945370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3f34e-8498-4371-af97-8af59104e1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:11.945907 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3f34e-8498-4371-af97-8af59104e1e0 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:11.947294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3f34e-8498-4371-af97-8af59104e1e0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:11.947633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3f34e-8498-4371-af97-8af59104e1e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:11.949668 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3f34e-8498-4371-af97-8af59104e1e0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:11.955764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 361/717] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jul 6 20:29:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:11.989378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076fc36-642b-491a-9eb5-c17563be8715 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:12.030115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d382bd7-7386-4c51-9d51-9795d5b625e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:12.030726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382bd7-7386-4c51-9d51-9795d5b625e2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:12.031015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382bd7-7386-4c51-9d51-9795d5b625e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:12.031338 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382bd7-7386-4c51-9d51-9795d5b625e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:12.032074 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d382bd7-7386-4c51-9d51-9795d5b625e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:12.032393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d382bd7-7386-4c51-9d51-9795d5b625e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:12.034021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d382bd7-7386-4c51-9d51-9795d5b625e2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:12.045631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:12.049472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 357/718] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:12.055247 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3f34e-8498-4371-af97-8af59104e1e0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:12.176569 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3f34e-8498-4371-af97-8af59104e1e0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:12.215407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819bbef-15d1-4bad-b756-18226917461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:12.216911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819bbef-15d1-4bad-b756-18226917461f None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:12.216911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819bbef-15d1-4bad-b756-18226917461f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:12.217167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819bbef-15d1-4bad-b756-18226917461f None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:12.217901 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819bbef-15d1-4bad-b756-18226917461f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:12.219390 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819bbef-15d1-4bad-b756-18226917461f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:12.244980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 362/719] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:29:12 2022] POST /identity/v3/users => generated 254 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:13.269554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d5cd2-79b3-4a12-8d1c-2b6220cdbc8b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:13.270081 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d5cd2-79b3-4a12-8d1c-2b6220cdbc8b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:13.270180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d5cd2-79b3-4a12-8d1c-2b6220cdbc8b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:13.271784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 358/720] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:13.277064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687e02b-ef30-491a-8f6e-33a5c7169ea6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:13.277461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687e02b-ef30-491a-8f6e-33a5c7169ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:13.277638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687e02b-ef30-491a-8f6e-33a5c7169ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:13.297729 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f687e02b-ef30-491a-8f6e-33a5c7169ea6 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:13.298168 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f26a98-1ca5-457a-b698-830523583609 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:13.298466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f26a98-1ca5-457a-b698-830523583609 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:13.298753 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f26a98-1ca5-457a-b698-830523583609 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:13.299844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f687e02b-ef30-491a-8f6e-33a5c7169ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:13.300476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 359/721] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:29:13.307201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258778e-4172-4195-b054-e148936f4123 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:13.307201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258778e-4172-4195-b054-e148936f4123 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:13.307201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258778e-4172-4195-b054-e148936f4123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:13.332467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4258778e-4172-4195-b054-e148936f4123 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:13.333650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4258778e-4172-4195-b054-e148936f4123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:13.340393 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:13.413342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 363/722] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:29:13.442439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687e02b-ef30-491a-8f6e-33a5c7169ea6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:13.448778 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 360/723] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:29:13.474040 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258778e-4172-4195-b054-e148936f4123 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:13.622760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258778e-4172-4195-b054-e148936f4123 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:13.657345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:13.664441 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4abcb-b5d9-49ed-a519-623f81ac69e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:13.665361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687e02b-ef30-491a-8f6e-33a5c7169ea6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:13.665719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4abcb-b5d9-49ed-a519-623f81ac69e7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:13.666225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4abcb-b5d9-49ed-a519-623f81ac69e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:13.666955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4abcb-b5d9-49ed-a519-623f81ac69e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:13.679434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4abcb-b5d9-49ed-a519-623f81ac69e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2fe4abcb-b5d9-49ed-a519-623f81ac69e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:13.689037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:13.689959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:13.690791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:13.690791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:13.690791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:13.690791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:13.690791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:13.690791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:13.690791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:13.690791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:13.690791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:13.690791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:13.690791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:13.690791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:13.693808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 361/724] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:29:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:13.699751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4abcb-b5d9-49ed-a519-623f81ac69e7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:13.748154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6b297-a913-473a-b7b2-7edefe30a0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:13.748959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b297-a913-473a-b7b2-7edefe30a0aa None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:13.749261 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b297-a913-473a-b7b2-7edefe30a0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:13.749787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b297-a913-473a-b7b2-7edefe30a0aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:13.776153 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6b297-a913-473a-b7b2-7edefe30a0aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-2ce6b297-a913-473a-b7b2-7edefe30a0aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:13.784428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:13.785368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:13.786324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:13.786324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:13.786324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:13.786324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:13.786324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:13.786324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:13.786324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:13.786324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:13.786324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:13.786324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:13.786324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:13.786324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:13.791687 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 364/725] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:29:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:13.799501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6b297-a913-473a-b7b2-7edefe30a0aa None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:13.821528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4abcb-b5d9-49ed-a519-623f81ac69e7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:13.856423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:13.862878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2341014-78e1-49da-9ce4-3260055803ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:13.864651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2341014-78e1-49da-9ce4-3260055803ca None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:13.865148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2341014-78e1-49da-9ce4-3260055803ca None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:13.865648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2341014-78e1-49da-9ce4-3260055803ca None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:13.866591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2341014-78e1-49da-9ce4-3260055803ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:13.867105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2341014-78e1-49da-9ce4-3260055803ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:13.869251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2341014-78e1-49da-9ce4-3260055803ca None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:13.880223 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 362/726] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:29:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:13.889117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2341014-78e1-49da-9ce4-3260055803ca None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:13.960253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:14.005393 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6b297-a913-473a-b7b2-7edefe30a0aa None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:14.007340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2341014-78e1-49da-9ce4-3260055803ca None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:14.059629 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be2176-2c0c-48ad-b4f4-ccadf2b405e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:14.060964 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be2176-2c0c-48ad-b4f4-ccadf2b405e8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:14.061477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be2176-2c0c-48ad-b4f4-ccadf2b405e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:14.061951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be2176-2c0c-48ad-b4f4-ccadf2b405e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:14.073384 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be2176-2c0c-48ad-b4f4-ccadf2b405e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:14.075757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be2176-2c0c-48ad-b4f4-ccadf2b405e8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-58be2176-2c0c-48ad-b4f4-ccadf2b405e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:14.094012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:14.094929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:14.095905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:14.095905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:14.095905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:14.095905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:14.096123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1382f-3f7e-4b5e-b333-93eb8ba0a8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:14.096694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1382f-3f7e-4b5e-b333-93eb8ba0a8ff None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:14.096996 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1382f-3f7e-4b5e-b333-93eb8ba0a8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:14.097282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1382f-3f7e-4b5e-b333-93eb8ba0a8ff None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:14.098039 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1382f-3f7e-4b5e-b333-93eb8ba0a8ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:14.098352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1382f-3f7e-4b5e-b333-93eb8ba0a8ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:14.099384 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 363/727] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:14.099777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1382f-3f7e-4b5e-b333-93eb8ba0a8ff None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:14.104822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be2176-2c0c-48ad-b4f4-ccadf2b405e8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:14.121881 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 365/728] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:29:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:14.127482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1382f-3f7e-4b5e-b333-93eb8ba0a8ff None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:14.250973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be2176-2c0c-48ad-b4f4-ccadf2b405e8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:14.268640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:14.312934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce6e5a-0269-4795-9514-3fd44f3f1991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:14.313586 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce6e5a-0269-4795-9514-3fd44f3f1991 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:14.313880 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce6e5a-0269-4795-9514-3fd44f3f1991 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:14.314137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:14.314486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce6e5a-0269-4795-9514-3fd44f3f1991 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:14.315570 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce6e5a-0269-4795-9514-3fd44f3f1991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:14.315891 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce6e5a-0269-4795-9514-3fd44f3f1991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:14.317771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce6e5a-0269-4795-9514-3fd44f3f1991 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:14.330203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1382f-3f7e-4b5e-b333-93eb8ba0a8ff None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:14.333737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 364/729] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:14.335074 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f285-7bf1-4a02-9f46-018e9c6ecbe7 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:14.335459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f285-7bf1-4a02-9f46-018e9c6ecbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:14.335743 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f285-7bf1-4a02-9f46-018e9c6ecbe7 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:14.339254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 365/730] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:14.340018 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0f285-7bf1-4a02-9f46-018e9c6ecbe7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:14.372806 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9b720-1487-4644-b5fb-9450126e3033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:14.373571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9b720-1487-4644-b5fb-9450126e3033 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:14.373958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9b720-1487-4644-b5fb-9450126e3033 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:14.374245 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9b720-1487-4644-b5fb-9450126e3033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:14.385880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9b720-1487-4644-b5fb-9450126e3033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:14.387391 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9b720-1487-4644-b5fb-9450126e3033 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-a1e9b720-1487-4644-b5fb-9450126e3033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:14.407366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:14.408281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:14.409167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:14.409167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:14.409167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:14.409167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:14.409167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 366/731] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:14.415192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da84b30-49be-4fe1-b69b-0afc562a4d7b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:14.415192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da84b30-49be-4fe1-b69b-0afc562a4d7b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:14.415192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da84b30-49be-4fe1-b69b-0afc562a4d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:14.428374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3da84b30-49be-4fe1-b69b-0afc562a4d7b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:14.429683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3da84b30-49be-4fe1-b69b-0afc562a4d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:14.451359 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0f285-7bf1-4a02-9f46-018e9c6ecbe7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:14.490447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95ce1-db47-4fe4-abbe-f00a2ffa862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:14.491366 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95ce1-db47-4fe4-abbe-f00a2ffa862d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:14.491655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95ce1-db47-4fe4-abbe-f00a2ffa862d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:14.491933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95ce1-db47-4fe4-abbe-f00a2ffa862d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:14.500978 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f95ce1-db47-4fe4-abbe-f00a2ffa862d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:14.502592 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f95ce1-db47-4fe4-abbe-f00a2ffa862d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:14.511509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 367/732] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:29:14.512428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da84b30-49be-4fe1-b69b-0afc562a4d7b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-78f95ce1-db47-4fe4-abbe-f00a2ffa862d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:14.519898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:14.521855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:14.523089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:14.523089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:14.523089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:14.523089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:14.523089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:14.523089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:14.523089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:14.523089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:14.523089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:14.523089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:14.523089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 366/733] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jul 6 20:29:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:14.532663 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95ce1-db47-4fe4-abbe-f00a2ffa862d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:14.565713 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:14.604566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:14.637511 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da84b30-49be-4fe1-b69b-0afc562a4d7b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:14.665576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95ce1-db47-4fe4-abbe-f00a2ffa862d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:14.675001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77561e4f-a88b-42a3-a865-243c1304ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:14.675737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77561e4f-a88b-42a3-a865-243c1304ba8c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:14.676029 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77561e4f-a88b-42a3-a865-243c1304ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:14.676315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77561e4f-a88b-42a3-a865-243c1304ba8c None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:14.677047 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77561e4f-a88b-42a3-a865-243c1304ba8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:14.677362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77561e4f-a88b-42a3-a865-243c1304ba8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:14.678734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77561e4f-a88b-42a3-a865-243c1304ba8c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:14.691557 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 368/734] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:14.692475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77561e4f-a88b-42a3-a865-243c1304ba8c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:14.707956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d737b0e-4734-4076-b91a-5b8e0301ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:14.708933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d737b0e-4734-4076-b91a-5b8e0301ee05 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:14.709222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d737b0e-4734-4076-b91a-5b8e0301ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:14.709506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d737b0e-4734-4076-b91a-5b8e0301ee05 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:14.710356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d737b0e-4734-4076-b91a-5b8e0301ee05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:14.710675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d737b0e-4734-4076-b91a-5b8e0301ee05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:14.712153 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d737b0e-4734-4076-b91a-5b8e0301ee05 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:14.735659 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 367/735] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jul 6 20:29:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:14.735659 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d737b0e-4734-4076-b91a-5b8e0301ee05 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:14.799307 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77561e4f-a88b-42a3-a865-243c1304ba8c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:14.821507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:14.829050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:14.835461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af1973-9533-4870-aeac-37f2a7b683e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:14.836137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af1973-9533-4870-aeac-37f2a7b683e3 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:14.836429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af1973-9533-4870-aeac-37f2a7b683e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:14.836707 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af1973-9533-4870-aeac-37f2a7b683e3 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:14.837436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af1973-9533-4870-aeac-37f2a7b683e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:14.838911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af1973-9533-4870-aeac-37f2a7b683e3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:14.844048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d737b0e-4734-4076-b91a-5b8e0301ee05 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:14.855626 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 369/736] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:29:14 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:14.858414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c3600-9225-42be-af28-a94a87bd8049 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:14.858756 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c3600-9225-42be-af28-a94a87bd8049 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:14.859099 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c3600-9225-42be-af28-a94a87bd8049 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:14.863336 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 370/737] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:14.864467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c3600-9225-42be-af28-a94a87bd8049 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:14.897855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ab8a4-2320-4ee9-9719-24f7388b5d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:14.898986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab8a4-2320-4ee9-9719-24f7388b5d70 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:14.899507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab8a4-2320-4ee9-9719-24f7388b5d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:14.899886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab8a4-2320-4ee9-9719-24f7388b5d70 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:14.909927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ab8a4-2320-4ee9-9719-24f7388b5d70 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:14.911728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ab8a4-2320-4ee9-9719-24f7388b5d70 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-009ab8a4-2320-4ee9-9719-24f7388b5d70 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:14.928655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:14.929788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:14.930762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:14.930762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:14.930762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:14.930762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:14.930762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:14.930762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:14.930762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:14.930762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:14.930762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:29:14.930762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:14.930762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 368/738] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:29:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:14.932520 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3f48f-a25b-4af3-a1a6-dba49cfb367a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:14.932875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3f48f-a25b-4af3-a1a6-dba49cfb367a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:14.933236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3f48f-a25b-4af3-a1a6-dba49cfb367a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:14.954714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4cd3f48f-a25b-4af3-a1a6-dba49cfb367a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:14.956778 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4cd3f48f-a25b-4af3-a1a6-dba49cfb367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:15.019211 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c3600-9225-42be-af28-a94a87bd8049 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:15.038487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 369/739] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 20:29:15.039487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3f48f-a25b-4af3-a1a6-dba49cfb367a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:15.056114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde5ebd-8aed-43c4-a99d-9ca7fd28db20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:15.056870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde5ebd-8aed-43c4-a99d-9ca7fd28db20 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:15.057149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde5ebd-8aed-43c4-a99d-9ca7fd28db20 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:15.057417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde5ebd-8aed-43c4-a99d-9ca7fd28db20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:15.068785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde5ebd-8aed-43c4-a99d-9ca7fd28db20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:15.070222 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde5ebd-8aed-43c4-a99d-9ca7fd28db20 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-8fde5ebd-8aed-43c4-a99d-9ca7fd28db20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:15.090008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:15.091588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:15.092538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:15.092538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:15.092538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:15.092538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:15.092538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 371/740] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:15.093590 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ac97d-9b6e-4f42-bf86-c61806fe5974 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:15.094769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ac97d-9b6e-4f42-bf86-c61806fe5974 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:15.094769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ac97d-9b6e-4f42-bf86-c61806fe5974 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:15.095851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 372/741] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:15.096449 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ac97d-9b6e-4f42-bf86-c61806fe5974 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:15.121853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:15.144790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:15.162109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3f48f-a25b-4af3-a1a6-dba49cfb367a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:15.200786 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010b5c5-6c38-472c-b61e-a170348382b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:15.201466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010b5c5-6c38-472c-b61e-a170348382b9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:15.201752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010b5c5-6c38-472c-b61e-a170348382b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:15.202034 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010b5c5-6c38-472c-b61e-a170348382b9 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:15.202872 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010b5c5-6c38-472c-b61e-a170348382b9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:15.203197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010b5c5-6c38-472c-b61e-a170348382b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:15.204674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010b5c5-6c38-472c-b61e-a170348382b9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:15.210116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ac97d-9b6e-4f42-bf86-c61806fe5974 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:15.223393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 370/742] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Jul 6 20:29:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:15.224242 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010b5c5-6c38-472c-b61e-a170348382b9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:15.254412 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2077f22-7965-46c9-9a87-0e02951235a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:15.255419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2077f22-7965-46c9-9a87-0e02951235a9 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:15.255931 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2077f22-7965-46c9-9a87-0e02951235a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:15.256281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2077f22-7965-46c9-9a87-0e02951235a9 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:15.257009 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2077f22-7965-46c9-9a87-0e02951235a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:15.258377 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2077f22-7965-46c9-9a87-0e02951235a9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:15.279032 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 373/743] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:29:15 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:15.281333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ff15-e31c-418a-8b2c-cd9f23e8f897 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:15.281871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ff15-e31c-418a-8b2c-cd9f23e8f897 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:15.282370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ff15-e31c-418a-8b2c-cd9f23e8f897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:15.316188 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-59d7ff15-e31c-418a-8b2c-cd9f23e8f897 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:15.319068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-59d7ff15-e31c-418a-8b2c-cd9f23e8f897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:15.346300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010b5c5-6c38-472c-b61e-a170348382b9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:15.378382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:15.398046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf5978-1186-4ed2-ac0f-9cc19207228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:15.398744 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf5978-1186-4ed2-ac0f-9cc19207228a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:15.399104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf5978-1186-4ed2-ac0f-9cc19207228a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:15.399427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf5978-1186-4ed2-ac0f-9cc19207228a None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:15.400175 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf5978-1186-4ed2-ac0f-9cc19207228a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:15.400491 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf5978-1186-4ed2-ac0f-9cc19207228a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:15.402093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf5978-1186-4ed2-ac0f-9cc19207228a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:15.416186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 374/745] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:15.416370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 371/745] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:15.417017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ff15-e31c-418a-8b2c-cd9f23e8f897 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:15.427352 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf5978-1186-4ed2-ac0f-9cc19207228a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:15.456031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:15.560501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ff15-e31c-418a-8b2c-cd9f23e8f897 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:15.566848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf5978-1186-4ed2-ac0f-9cc19207228a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:15.611273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb6931-331a-4456-a973-a6a3aa7907e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:15.612070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5f78c-e355-401d-81fc-89fa3445fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:15.612222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6931-331a-4456-a973-a6a3aa7907e4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:15.612360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6931-331a-4456-a973-a6a3aa7907e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:15.612644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6931-331a-4456-a973-a6a3aa7907e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:15.613296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5f78c-e355-401d-81fc-89fa3445fc24 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:15.613714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5f78c-e355-401d-81fc-89fa3445fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:15.614134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5f78c-e355-401d-81fc-89fa3445fc24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:15.621097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb6931-331a-4456-a973-a6a3aa7907e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:15.622715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb6931-331a-4456-a973-a6a3aa7907e4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c2cb6931-331a-4456-a973-a6a3aa7907e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:15.643822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:15.644934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:15.645867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:15.645867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:15.645867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:15.645867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:15.645867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:15.645867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:15.645867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:15.645867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:15.645867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 372/746] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:15.646349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb6931-331a-4456-a973-a6a3aa7907e4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:15.695210 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5f78c-e355-401d-81fc-89fa3445fc24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:15.697015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5f78c-e355-401d-81fc-89fa3445fc24 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:15.707383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:15.730821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:15.792194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb6931-331a-4456-a973-a6a3aa7907e4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:15.813284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 375/747] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:29:15.814505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5f78c-e355-401d-81fc-89fa3445fc24 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:15.830546 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aa32e-c962-4ea3-88d3-fa2bb2581330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:15.831367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aa32e-c962-4ea3-88d3-fa2bb2581330 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:15.831657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aa32e-c962-4ea3-88d3-fa2bb2581330 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:15.831938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aa32e-c962-4ea3-88d3-fa2bb2581330 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:15.843766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14aa32e-c962-4ea3-88d3-fa2bb2581330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c14aa32e-c962-4ea3-88d3-fa2bb2581330 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:15.852487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:15.853416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:15.854248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:15.854248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:15.854248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:15.854248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:15.854248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:15.854248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:15.854248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:15.854248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:15.854248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:15.854248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:15.854248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:15.854248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:15.854248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 373/748] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:29:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:15.854929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aa32e-c962-4ea3-88d3-fa2bb2581330 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:15.927263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5f78c-e355-401d-81fc-89fa3445fc24 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:15.959754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:15.963883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aa32e-c962-4ea3-88d3-fa2bb2581330 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:15.965588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:15.967983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e3d0f-282f-451b-ac83-cfd064a30042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:15.968936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e3d0f-282f-451b-ac83-cfd064a30042 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:15.969462 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e3d0f-282f-451b-ac83-cfd064a30042 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:15.969938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e3d0f-282f-451b-ac83-cfd064a30042 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:15.970948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e3d0f-282f-451b-ac83-cfd064a30042 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:15.971479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e3d0f-282f-451b-ac83-cfd064a30042 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:15.973126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e3d0f-282f-451b-ac83-cfd064a30042 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:15.987139 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 376/749] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:15.988280 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e3d0f-282f-451b-ac83-cfd064a30042 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:16.002274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c09a6-8de3-486b-b0fe-b8208b0573be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:16.003082 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c09a6-8de3-486b-b0fe-b8208b0573be None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:16.003399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c09a6-8de3-486b-b0fe-b8208b0573be None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:16.003762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c09a6-8de3-486b-b0fe-b8208b0573be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:16.015523 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c09a6-8de3-486b-b0fe-b8208b0573be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:16.017370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c09a6-8de3-486b-b0fe-b8208b0573be None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2c3c09a6-8de3-486b-b0fe-b8208b0573be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:16.036812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:16.037756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:16.038640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:16.038640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:16.038640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:16.038640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:16.038640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 374/750] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:16.039364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c09a6-8de3-486b-b0fe-b8208b0573be None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:16.105001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e3d0f-282f-451b-ac83-cfd064a30042 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:16.142201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d73ef-a33f-44e7-a4d6-384206bbd885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:16.143574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d73ef-a33f-44e7-a4d6-384206bbd885 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:16.144061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d73ef-a33f-44e7-a4d6-384206bbd885 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:16.144561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d73ef-a33f-44e7-a4d6-384206bbd885 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:16.145598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d73ef-a33f-44e7-a4d6-384206bbd885 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:16.146111 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d73ef-a33f-44e7-a4d6-384206bbd885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:16.147810 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d73ef-a33f-44e7-a4d6-384206bbd885 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:16.155532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c09a6-8de3-486b-b0fe-b8208b0573be None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:16.157516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 377/751] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:29:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:16.158631 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d73ef-a33f-44e7-a4d6-384206bbd885 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:16.192161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433e65b-5d6c-4744-ab5b-75013e1f77f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:16.193057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e65b-5d6c-4744-ab5b-75013e1f77f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:16.193343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e65b-5d6c-4744-ab5b-75013e1f77f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:16.193625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e65b-5d6c-4744-ab5b-75013e1f77f6 None admin] PATH_INFO: `/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/3d68c8fdb65343b8b2f58070addeaf13/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:16.195869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433e65b-5d6c-4744-ab5b-75013e1f77f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8eda6c9cf4b1439eb280b0db35b3bce2, user_id=3d68c8fdb65343b8b2f58070addeaf13, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:16.197428 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433e65b-5d6c-4744-ab5b-75013e1f77f6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:16.216487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 375/752] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:29:16 2022] PUT /identity/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/3d68c8fdb65343b8b2f58070addeaf13/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:29:16.217314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433e65b-5d6c-4744-ab5b-75013e1f77f6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:16.236428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:16.236899 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:16.300723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d73ef-a33f-44e7-a4d6-384206bbd885 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:16.333901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433e65b-5d6c-4744-ab5b-75013e1f77f6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:16.346373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a746d4-9b47-4f83-89a0-9aaf0dc97936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:16.347051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a746d4-9b47-4f83-89a0-9aaf0dc97936 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:16.347506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a746d4-9b47-4f83-89a0-9aaf0dc97936 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:16.347935 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a746d4-9b47-4f83-89a0-9aaf0dc97936 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:16.348673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a746d4-9b47-4f83-89a0-9aaf0dc97936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:16.348990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a746d4-9b47-4f83-89a0-9aaf0dc97936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:16.351115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a746d4-9b47-4f83-89a0-9aaf0dc97936 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:16.367231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 378/753] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:16.378171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a746d4-9b47-4f83-89a0-9aaf0dc97936 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:16.399722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b21fb-9197-499c-acc4-9af717620edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:16.401170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b21fb-9197-499c-acc4-9af717620edf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:16.401626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b21fb-9197-499c-acc4-9af717620edf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:16.402049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b21fb-9197-499c-acc4-9af717620edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:16.420282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b21fb-9197-499c-acc4-9af717620edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:16.422072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b21fb-9197-499c-acc4-9af717620edf None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-bb0b21fb-9197-499c-acc4-9af717620edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:16.440934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:16.442098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:16.443203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:16.443203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:16.443203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:16.443203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:16.447275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 376/754] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:16.451372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b21fb-9197-499c-acc4-9af717620edf None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:16.522709 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:16.532679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a746d4-9b47-4f83-89a0-9aaf0dc97936 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:16.549490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:16.562788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b21fb-9197-499c-acc4-9af717620edf None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:16.573922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8993bd-2b7c-419a-9094-073820a91585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:16.574959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8993bd-2b7c-419a-9094-073820a91585 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:16.575567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8993bd-2b7c-419a-9094-073820a91585 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:16.576005 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8993bd-2b7c-419a-9094-073820a91585 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:16.583870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8993bd-2b7c-419a-9094-073820a91585 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:16.585877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8993bd-2b7c-419a-9094-073820a91585 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-1a8993bd-2b7c-419a-9094-073820a91585 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:16.601750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:16.602921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:16.604051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:16.604051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:16.604051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:16.604051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:16.604051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:16.604051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:16.604051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:16.604051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:16.604934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1cbe7-d5b5-4a12-befd-ec7d32911bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:16.610485 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 379/755] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:16.610614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1cbe7-d5b5-4a12-befd-ec7d32911bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:16.610614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1cbe7-d5b5-4a12-befd-ec7d32911bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:16.610614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1cbe7-d5b5-4a12-befd-ec7d32911bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:16.610614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1cbe7-d5b5-4a12-befd-ec7d32911bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:16.610614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1cbe7-d5b5-4a12-befd-ec7d32911bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:16.610614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1cbe7-d5b5-4a12-befd-ec7d32911bc4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:16.612414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8993bd-2b7c-419a-9094-073820a91585 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:16.632952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 377/756] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:16.634603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1cbe7-d5b5-4a12-befd-ec7d32911bc4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:16.741634 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1cbe7-d5b5-4a12-befd-ec7d32911bc4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:16.768863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:16.780178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae70470-ad73-4730-a8ac-6b4e492f20a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:16.781289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae70470-ad73-4730-a8ac-6b4e492f20a0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:16.781772 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae70470-ad73-4730-a8ac-6b4e492f20a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:16.782263 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae70470-ad73-4730-a8ac-6b4e492f20a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:16.790234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae70470-ad73-4730-a8ac-6b4e492f20a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:16.791973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae70470-ad73-4730-a8ac-6b4e492f20a0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1ae70470-ad73-4730-a8ac-6b4e492f20a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:16.808548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:16.809526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:16.811155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:16.811155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:16.811155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:16.811155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:16.811155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:16.811155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:16.811155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:16.811155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:16.811155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:29:16.811155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:16.818154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 378/757] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jul 6 20:29:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:16.819717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae70470-ad73-4730-a8ac-6b4e492f20a0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:16.885402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8993bd-2b7c-419a-9094-073820a91585 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:16.924546 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae70470-ad73-4730-a8ac-6b4e492f20a0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:16.961106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef844f-f5f4-4c5d-8858-e1ac3a3b83d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:16.962189 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef844f-f5f4-4c5d-8858-e1ac3a3b83d3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:16.962687 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef844f-f5f4-4c5d-8858-e1ac3a3b83d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:16.963200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef844f-f5f4-4c5d-8858-e1ac3a3b83d3 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:16.964229 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef844f-f5f4-4c5d-8858-e1ac3a3b83d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:16.964735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef844f-f5f4-4c5d-8858-e1ac3a3b83d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:16.967122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef844f-f5f4-4c5d-8858-e1ac3a3b83d3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:16.978517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f7f1c-7ce9-41b5-bfef-09f477eec805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:16.979197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f7f1c-7ce9-41b5-bfef-09f477eec805 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:16.979485 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f7f1c-7ce9-41b5-bfef-09f477eec805 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:16.979761 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f7f1c-7ce9-41b5-bfef-09f477eec805 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:16.980583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f7f1c-7ce9-41b5-bfef-09f477eec805 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:16.981023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f7f1c-7ce9-41b5-bfef-09f477eec805 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:16.982531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f7f1c-7ce9-41b5-bfef-09f477eec805 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:16.992247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 379/758] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Jul 6 20:29:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:16.993721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef844f-f5f4-4c5d-8858-e1ac3a3b83d3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:17.011216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 380/759] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:17.020197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f7f1c-7ce9-41b5-bfef-09f477eec805 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:17.053469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:17.080665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:17.110206 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef844f-f5f4-4c5d-8858-e1ac3a3b83d3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:17.147050 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bf81a-bfd4-4b7c-845f-e7beb63d2568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:17.147690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bf81a-bfd4-4b7c-845f-e7beb63d2568 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:17.147976 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bf81a-bfd4-4b7c-845f-e7beb63d2568 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:17.148335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bf81a-bfd4-4b7c-845f-e7beb63d2568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:17.156666 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f7f1c-7ce9-41b5-bfef-09f477eec805 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:17.193256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f397a-71ef-4c5b-8bf3-1626d9609677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:17.194189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f397a-71ef-4c5b-8bf3-1626d9609677 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:17.194666 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f397a-71ef-4c5b-8bf3-1626d9609677 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:17.195083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f397a-71ef-4c5b-8bf3-1626d9609677 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:17.196084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f397a-71ef-4c5b-8bf3-1626d9609677 None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=88dff378ccb4497fb305563614ea4caa) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:17.196539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f397a-71ef-4c5b-8bf3-1626d9609677 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:17.198321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f397a-71ef-4c5b-8bf3-1626d9609677 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:17.211319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 381/760] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:17 2022] GET /identity/v3/role_assignments?user.id=88dff378ccb4497fb305563614ea4caa&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:17.213343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961a9f-0261-4a4d-b16c-8bdd2948e4b5 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:17.213771 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961a9f-0261-4a4d-b16c-8bdd2948e4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:17.214256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961a9f-0261-4a4d-b16c-8bdd2948e4b5 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:17.216494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 382/761] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:17.221803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcaefc-a8cd-4149-962c-e88c9f1675a0 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:17.222357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcaefc-a8cd-4149-962c-e88c9f1675a0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:17.222717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bf81a-bfd4-4b7c-845f-e7beb63d2568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:17.223002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcaefc-a8cd-4149-962c-e88c9f1675a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:17.224215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bf81a-bfd4-4b7c-845f-e7beb63d2568 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:17.256450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-67bcaefc-a8cd-4149-962c-e88c9f1675a0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:17.258113 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-67bcaefc-a8cd-4149-962c-e88c9f1675a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:17.276083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:17.351707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 380/762] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 20:29:17.354340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bf81a-bfd4-4b7c-845f-e7beb63d2568 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:17.434162 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 383/763] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:17.465651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcaefc-a8cd-4149-962c-e88c9f1675a0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:17.494410 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bf81a-bfd4-4b7c-845f-e7beb63d2568 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:17.497059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:17.534757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422d939-bcf4-4fdd-8c7a-550df5922bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:17.535924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422d939-bcf4-4fdd-8c7a-550df5922bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:17.536348 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422d939-bcf4-4fdd-8c7a-550df5922bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:17.536762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422d939-bcf4-4fdd-8c7a-550df5922bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:17.548631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422d939-bcf4-4fdd-8c7a-550df5922bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:17.550463 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422d939-bcf4-4fdd-8c7a-550df5922bb5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:17.558102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0422d939-bcf4-4fdd-8c7a-550df5922bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:17.571642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:17.572583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:17.573476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:17.573476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:17.573476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:17.573476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:17.577649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 381/764] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:17.579136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422d939-bcf4-4fdd-8c7a-550df5922bb5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:17.654920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcaefc-a8cd-4149-962c-e88c9f1675a0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:17.701983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7608a-4073-400b-a494-fc54cc7b2866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:17.702803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7608a-4073-400b-a494-fc54cc7b2866 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:17.703085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7608a-4073-400b-a494-fc54cc7b2866 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:17.703400 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7608a-4073-400b-a494-fc54cc7b2866 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:17.704068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7608a-4073-400b-a494-fc54cc7b2866 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:17.705667 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7608a-4073-400b-a494-fc54cc7b2866 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:17.715479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422d939-bcf4-4fdd-8c7a-550df5922bb5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-f2d7608a-4073-400b-a494-fc54cc7b2866 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:17.718753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:17.719906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:29:17.720926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:17.722486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 384/765] 10.222.0.33 () {56 vars in 1129 bytes} [Wed Jul 6 20:29:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:17.723871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe357501-cabf-4565-8660-4ee8dcdf10a7 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:17.724250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe357501-cabf-4565-8660-4ee8dcdf10a7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:17.724623 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe357501-cabf-4565-8660-4ee8dcdf10a7 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:17.726202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 385/766] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:17.728259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe357501-cabf-4565-8660-4ee8dcdf10a7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:17.768010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64513931-f301-4e0f-9662-6ba60c590217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:17.769539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64513931-f301-4e0f-9662-6ba60c590217 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:17.770859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64513931-f301-4e0f-9662-6ba60c590217 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:17.771317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64513931-f301-4e0f-9662-6ba60c590217 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:17.772206 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64513931-f301-4e0f-9662-6ba60c590217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:17.772657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64513931-f301-4e0f-9662-6ba60c590217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:17.774222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64513931-f301-4e0f-9662-6ba60c590217 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:17.795408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 382/767] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:17.796667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21e489-06b5-48a4-9d91-8f30794a853c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:17.797016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21e489-06b5-48a4-9d91-8f30794a853c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:17.797227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21e489-06b5-48a4-9d91-8f30794a853c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:17.814210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-cf21e489-06b5-48a4-9d91-8f30794a853c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:17.815435 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cf21e489-06b5-48a4-9d91-8f30794a853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:17.844527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:17.857761 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe357501-cabf-4565-8660-4ee8dcdf10a7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:17.883855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:17.900154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815645c-1147-43b9-9097-b120ae3548af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:17.900825 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815645c-1147-43b9-9097-b120ae3548af None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:17.901108 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815645c-1147-43b9-9097-b120ae3548af None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:17.901385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815645c-1147-43b9-9097-b120ae3548af None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:17.902248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815645c-1147-43b9-9097-b120ae3548af None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:17.902556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815645c-1147-43b9-9097-b120ae3548af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:17.905143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815645c-1147-43b9-9097-b120ae3548af None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:17.909968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 383/769] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:17.911264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21e489-06b5-48a4-9d91-8f30794a853c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:17.914436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 386/769] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Jul 6 20:29:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:17.915305 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815645c-1147-43b9-9097-b120ae3548af None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:18.028044 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815645c-1147-43b9-9097-b120ae3548af None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:18.045971 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21e489-06b5-48a4-9d91-8f30794a853c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:18.070737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e75a74-28ef-4844-81c5-ab7a6c40be20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:18.071436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e75a74-28ef-4844-81c5-ab7a6c40be20 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:18.071720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e75a74-28ef-4844-81c5-ab7a6c40be20 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:18.071997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e75a74-28ef-4844-81c5-ab7a6c40be20 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:18.072890 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e75a74-28ef-4844-81c5-ab7a6c40be20 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:18.072998 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e75a74-28ef-4844-81c5-ab7a6c40be20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:18.074361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e75a74-28ef-4844-81c5-ab7a6c40be20 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:18.084838 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 387/770] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Jul 6 20:29:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:18.084838 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e75a74-28ef-4844-81c5-ab7a6c40be20 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:18.102278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e53036-93ae-45c4-893d-e0b19379692e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:18.103595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e53036-93ae-45c4-893d-e0b19379692e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:18.104022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e53036-93ae-45c4-893d-e0b19379692e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:18.104437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e53036-93ae-45c4-893d-e0b19379692e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:18.109256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:18.114831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e53036-93ae-45c4-893d-e0b19379692e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:18.116804 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e53036-93ae-45c4-893d-e0b19379692e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f5e53036-93ae-45c4-893d-e0b19379692e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:18.137133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:18.138340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:18.139385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:18.139385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:18.139385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:18.139385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:18.139385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:18.139385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:18.139385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:18.139385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:18.142327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 384/771] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:18.143320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e53036-93ae-45c4-893d-e0b19379692e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:18.199203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:18.214354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e75a74-28ef-4844-81c5-ab7a6c40be20 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:18.256090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109589a-5d3b-463b-ba4f-bcec27036776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:18.257148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109589a-5d3b-463b-ba4f-bcec27036776 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:18.257534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109589a-5d3b-463b-ba4f-bcec27036776 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:18.257927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109589a-5d3b-463b-ba4f-bcec27036776 None admin] PATH_INFO: `/v3/services/network` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:18.258721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109589a-5d3b-463b-ba4f-bcec27036776 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:18.260275 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109589a-5d3b-463b-ba4f-bcec27036776 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:18.260446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e53036-93ae-45c4-893d-e0b19379692e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-c109589a-5d3b-463b-ba4f-bcec27036776 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:18.273782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:18.275293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:29:18.276357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:18.278273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 388/772] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:18 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:18.280410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109589a-5d3b-463b-ba4f-bcec27036776 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:18.304719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c949ca-1430-4fb9-bf27-0567d653964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:18.305492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c949ca-1430-4fb9-bf27-0567d653964b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:18.305850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c949ca-1430-4fb9-bf27-0567d653964b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:18.306196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c949ca-1430-4fb9-bf27-0567d653964b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:18.307056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c949ca-1430-4fb9-bf27-0567d653964b None admin] RBAC: Adding query filter params (interface=public, service_id=6c05437f47e54e57b9c8fccee0d4f45f, region_id=RegionOne) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:18.307484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c949ca-1430-4fb9-bf27-0567d653964b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:18.308982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c949ca-1430-4fb9-bf27-0567d653964b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:18.322602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 385/773] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jul 6 20:29:18 2022] GET /identity/v3/endpoints?service_id=6c05437f47e54e57b9c8fccee0d4f45f&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:18.322602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c949ca-1430-4fb9-bf27-0567d653964b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:18.389606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:18.408941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109589a-5d3b-463b-ba4f-bcec27036776 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:18.448252 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f5f72-7a0c-4bff-b7d1-8808fcee3056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:18.448899 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f5f72-7a0c-4bff-b7d1-8808fcee3056 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:18.449183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f5f72-7a0c-4bff-b7d1-8808fcee3056 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:18.449334 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c949ca-1430-4fb9-bf27-0567d653964b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:18.449453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f5f72-7a0c-4bff-b7d1-8808fcee3056 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:18.450238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f5f72-7a0c-4bff-b7d1-8808fcee3056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:18.451222 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f5f72-7a0c-4bff-b7d1-8808fcee3056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:18.452648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f5f72-7a0c-4bff-b7d1-8808fcee3056 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:18.463802 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:18.465532 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 389/774] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:18.466923 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f5f72-7a0c-4bff-b7d1-8808fcee3056 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:18.492542 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98045ad4-95cf-41c9-a9a8-36c2040d9ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:18.493104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045ad4-95cf-41c9-a9a8-36c2040d9ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:18.493390 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045ad4-95cf-41c9-a9a8-36c2040d9ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:18.493665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045ad4-95cf-41c9-a9a8-36c2040d9ea8 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:18.494388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98045ad4-95cf-41c9-a9a8-36c2040d9ea8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:18.494696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98045ad4-95cf-41c9-a9a8-36c2040d9ea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:18.496168 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98045ad4-95cf-41c9-a9a8-36c2040d9ea8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:18.502663 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 386/775] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jul 6 20:29:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:18.503593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98045ad4-95cf-41c9-a9a8-36c2040d9ea8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:18.585845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f5f72-7a0c-4bff-b7d1-8808fcee3056 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:18.625706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64702f28-4f3a-4168-98c7-b769e2a1c2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:18.627126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64702f28-4f3a-4168-98c7-b769e2a1c2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:18.627576 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64702f28-4f3a-4168-98c7-b769e2a1c2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:18.628090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64702f28-4f3a-4168-98c7-b769e2a1c2f5 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:18.628909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64702f28-4f3a-4168-98c7-b769e2a1c2f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:18.631282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64702f28-4f3a-4168-98c7-b769e2a1c2f5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:18.645777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 390/776] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jul 6 20:29:18 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:18.645777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64702f28-4f3a-4168-98c7-b769e2a1c2f5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:18.649137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98045ad4-95cf-41c9-a9a8-36c2040d9ea8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:18.676074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:18.729991 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86fe50-27a0-4576-850e-e204150cab38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:18.730590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86fe50-27a0-4576-850e-e204150cab38 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:18.730930 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86fe50-27a0-4576-850e-e204150cab38 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:18.731224 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86fe50-27a0-4576-850e-e204150cab38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:18.732546 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86fe50-27a0-4576-850e-e204150cab38 None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=e1c9cdf941294b4190245ed43d219ef6) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:18.732860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86fe50-27a0-4576-850e-e204150cab38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:18.734315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86fe50-27a0-4576-850e-e204150cab38 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:18.740913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 387/777] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:18 2022] GET /identity/v3/role_assignments?user.id=e1c9cdf941294b4190245ed43d219ef6&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:18.742513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdb446-2f09-4369-b209-b78ddf7a4c21 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:18.742810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdb446-2f09-4369-b209-b78ddf7a4c21 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:18.743087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdb446-2f09-4369-b209-b78ddf7a4c21 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:18.744833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 388/778] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:18.752765 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6d1b2-4543-4662-9167-82db3c9962e0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:18.753430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6d1b2-4543-4662-9167-82db3c9962e0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:18.753937 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6d1b2-4543-4662-9167-82db3c9962e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:18.786310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-31a6d1b2-4543-4662-9167-82db3c9962e0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:18.793885 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-31a6d1b2-4543-4662-9167-82db3c9962e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:18.816816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64702f28-4f3a-4168-98c7-b769e2a1c2f5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:18.860973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:18.866112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c3c93-c2fe-44d9-9853-4d15d21905ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:18.866812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c3c93-c2fe-44d9-9853-4d15d21905ff None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:18.867113 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c3c93-c2fe-44d9-9853-4d15d21905ff None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:18.867483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c3c93-c2fe-44d9-9853-4d15d21905ff None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:18.868203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c3c93-c2fe-44d9-9853-4d15d21905ff None admin] RBAC: Adding query filter params (type=network) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:18.868662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c3c93-c2fe-44d9-9853-4d15d21905ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:18.870129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c3c93-c2fe-44d9-9853-4d15d21905ff None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:18.877138 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 391/779] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jul 6 20:29:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:18.884228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c3c93-c2fe-44d9-9853-4d15d21905ff None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:18.917480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 389/780] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:18.946148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6d1b2-4543-4662-9167-82db3c9962e0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:18.985781 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:19.020249 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c3c93-c2fe-44d9-9853-4d15d21905ff None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:19.057545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431c25f-c9b5-4465-ad47-fd2677004f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:19.058201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431c25f-c9b5-4465-ad47-fd2677004f2d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:19.058538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431c25f-c9b5-4465-ad47-fd2677004f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:19.058816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431c25f-c9b5-4465-ad47-fd2677004f2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:19.059676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431c25f-c9b5-4465-ad47-fd2677004f2d None admin] RBAC: Adding query filter params (interface=public, service_id=3f6d316013a344eeb710dda959389990, region_id=RegionOne) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:19.060763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431c25f-c9b5-4465-ad47-fd2677004f2d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:19.061968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431c25f-c9b5-4465-ad47-fd2677004f2d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:19.071413 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 392/781] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jul 6 20:29:18 2022] GET /identity/v3/endpoints?service_id=3f6d316013a344eeb710dda959389990&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:19.079766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431c25f-c9b5-4465-ad47-fd2677004f2d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:19.103750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6d1b2-4543-4662-9167-82db3c9962e0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:19.150974 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8b8b8-55f7-42b1-a9e9-95d0f74eccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:19.152041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8b8b8-55f7-42b1-a9e9-95d0f74eccd2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:19.153975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8b8b8-55f7-42b1-a9e9-95d0f74eccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:19.155435 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8b8b8-55f7-42b1-a9e9-95d0f74eccd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:19.181204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8b8b8-55f7-42b1-a9e9-95d0f74eccd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c8f8b8b8-55f7-42b1-a9e9-95d0f74eccd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:19.195357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:19.196539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:19.197495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:19.197495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:19.197495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:19.197495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:19.197495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:19.197495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:19.197495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:19.197495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:19.197495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:19.197495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:19.197495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:19.197495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:19.204436 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 390/782] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:29:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:19.210252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8b8b8-55f7-42b1-a9e9-95d0f74eccd2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:19.249862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:19.348191 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8b8b8-55f7-42b1-a9e9-95d0f74eccd2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:19.366680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431c25f-c9b5-4465-ad47-fd2677004f2d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:19.404769 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83f1ea-5dfd-411b-b713-a132ff203898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:19.405453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83f1ea-5dfd-411b-b713-a132ff203898 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:19.405741 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83f1ea-5dfd-411b-b713-a132ff203898 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:19.406011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83f1ea-5dfd-411b-b713-a132ff203898 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:19.406762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83f1ea-5dfd-411b-b713-a132ff203898 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:19.407069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83f1ea-5dfd-411b-b713-a132ff203898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:19.408487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83f1ea-5dfd-411b-b713-a132ff203898 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:19.411439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d00ce5-fbe4-4a50-aea0-f843a70b4e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:19.412103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d00ce5-fbe4-4a50-aea0-f843a70b4e13 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:19.412383 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d00ce5-fbe4-4a50-aea0-f843a70b4e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:19.412655 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d00ce5-fbe4-4a50-aea0-f843a70b4e13 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:19.413324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d00ce5-fbe4-4a50-aea0-f843a70b4e13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:19.414680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d00ce5-fbe4-4a50-aea0-f843a70b4e13 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:19.417374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:19.425881 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 393/783] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jul 6 20:29:19 2022] GET /identity/v3/services => generated 772 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:19.435298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 391/784] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:29:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:19.440883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d00ce5-fbe4-4a50-aea0-f843a70b4e13 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:19.606105 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d00ce5-fbe4-4a50-aea0-f843a70b4e13 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:19.655446 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8c1b3-209c-4b3f-8548-13bb853dc40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:19.656248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8c1b3-209c-4b3f-8548-13bb853dc40a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:19.656558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8c1b3-209c-4b3f-8548-13bb853dc40a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:19.656806 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8c1b3-209c-4b3f-8548-13bb853dc40a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:19.668845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8c1b3-209c-4b3f-8548-13bb853dc40a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:19.670861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8c1b3-209c-4b3f-8548-13bb853dc40a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:19.674881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3fd0f-6af7-4de9-9c02-3bc259bb4979 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:19.675359 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3fd0f-6af7-4de9-9c02-3bc259bb4979 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:19.675454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3fd0f-6af7-4de9-9c02-3bc259bb4979 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:19.677082 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 392/785] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:19.685693 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac57d9-0a39-48d9-9091-d565c15dd586 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:19.686156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac57d9-0a39-48d9-9091-d565c15dd586 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:19.686479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac57d9-0a39-48d9-9091-d565c15dd586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-87d8c1b3-209c-4b3f-8548-13bb853dc40a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:19.691682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:19.692567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:19.693461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:19.693461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:19.693461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:19.693461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:19.693461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 394/786] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:19.712908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b2ac57d9-0a39-48d9-9091-d565c15dd586 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:19.713198 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8c1b3-209c-4b3f-8548-13bb853dc40a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:19.714211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b2ac57d9-0a39-48d9-9091-d565c15dd586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:19.815203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 393/787] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:19.831544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:19.839990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac57d9-0a39-48d9-9091-d565c15dd586 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:19.875559 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:19.926181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8c1b3-209c-4b3f-8548-13bb853dc40a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:19.965522 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12187b-48bd-4f57-987f-c5c31dc3bcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:19.968095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12187b-48bd-4f57-987f-c5c31dc3bcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:19.968383 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12187b-48bd-4f57-987f-c5c31dc3bcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:19.968658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12187b-48bd-4f57-987f-c5c31dc3bcf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:19.969391 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12187b-48bd-4f57-987f-c5c31dc3bcf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:19.969699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12187b-48bd-4f57-987f-c5c31dc3bcf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:19.971076 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12187b-48bd-4f57-987f-c5c31dc3bcf8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:20.009570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 395/788] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:20.010525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12187b-48bd-4f57-987f-c5c31dc3bcf8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:20.081779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac57d9-0a39-48d9-9091-d565c15dd586 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:20.137884 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12187b-48bd-4f57-987f-c5c31dc3bcf8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:20.148130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc044fa6-60b9-4d15-ae68-36f7dc63d281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:20.149037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc044fa6-60b9-4d15-ae68-36f7dc63d281 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:20.149324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc044fa6-60b9-4d15-ae68-36f7dc63d281 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:20.149595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc044fa6-60b9-4d15-ae68-36f7dc63d281 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:20.155506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:20.176347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc044fa6-60b9-4d15-ae68-36f7dc63d281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:20.176960 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4292d-0d33-47e2-9186-93bc1e12a9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:20.177815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4292d-0d33-47e2-9186-93bc1e12a9ee None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:20.178104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4292d-0d33-47e2-9186-93bc1e12a9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:20.178386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4292d-0d33-47e2-9186-93bc1e12a9ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:20.186266 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4292d-0d33-47e2-9186-93bc1e12a9ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:20.187803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4292d-0d33-47e2-9186-93bc1e12a9ee None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-bc044fa6-60b9-4d15-ae68-36f7dc63d281 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:20.188272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:20.189247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:20.190099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:20.190099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:20.190099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:20.190099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:20.190099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:20.190099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:20.190099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:20.190099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:20.190099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:20.190099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:20.190099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:20.190099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:20.190099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 394/789] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:29:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:20.197440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc044fa6-60b9-4d15-ae68-36f7dc63d281 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-d5c4292d-0d33-47e2-9186-93bc1e12a9ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:20.205067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:20.207341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:20.209592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:20.209592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:20.209592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:20.209592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:20.209592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:20.209592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:20.209592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:20.209592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:20.209592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:20.209592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:20.209592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 396/790] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jul 6 20:29:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:20.215213 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4292d-0d33-47e2-9186-93bc1e12a9ee None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:20.322731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4292d-0d33-47e2-9186-93bc1e12a9ee None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:20.361433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85b6e3-0a78-4bca-ac59-d0dba0875b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:20.362111 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85b6e3-0a78-4bca-ac59-d0dba0875b5e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:20.362397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85b6e3-0a78-4bca-ac59-d0dba0875b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:20.362844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85b6e3-0a78-4bca-ac59-d0dba0875b5e None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:20.363786 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85b6e3-0a78-4bca-ac59-d0dba0875b5e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:20.364256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85b6e3-0a78-4bca-ac59-d0dba0875b5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:20.365689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85b6e3-0a78-4bca-ac59-d0dba0875b5e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:20.385363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 397/791] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jul 6 20:29:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:20.391407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85b6e3-0a78-4bca-ac59-d0dba0875b5e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:20.451577 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:20.501296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85b6e3-0a78-4bca-ac59-d0dba0875b5e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:20.516875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:20.538188 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89841d15-5f92-4607-a638-27ab03107319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:20.538850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89841d15-5f92-4607-a638-27ab03107319 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:20.539135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89841d15-5f92-4607-a638-27ab03107319 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:20.539441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89841d15-5f92-4607-a638-27ab03107319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:20.564928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc044fa6-60b9-4d15-ae68-36f7dc63d281 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:20.640005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f08c4-0e30-4742-a962-bd7a152939ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:20.640686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f08c4-0e30-4742-a962-bd7a152939ff None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:20.640971 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f08c4-0e30-4742-a962-bd7a152939ff None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:20.641254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f08c4-0e30-4742-a962-bd7a152939ff None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:20.642059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f08c4-0e30-4742-a962-bd7a152939ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:20.642318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f08c4-0e30-4742-a962-bd7a152939ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:20.643733 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f08c4-0e30-4742-a962-bd7a152939ff None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:20.665207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 395/792] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:29:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:20.666348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89841d15-5f92-4607-a638-27ab03107319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:20.667876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89841d15-5f92-4607-a638-27ab03107319 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:20.671967 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f08c4-0e30-4742-a962-bd7a152939ff None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:20.749906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:20.782535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f08c4-0e30-4742-a962-bd7a152939ff None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:20.818064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a4d59-4174-4478-97c8-5dacccbda48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:20.818866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4d59-4174-4478-97c8-5dacccbda48c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:20.819149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4d59-4174-4478-97c8-5dacccbda48c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:20.819462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4d59-4174-4478-97c8-5dacccbda48c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:20.831220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a4d59-4174-4478-97c8-5dacccbda48c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:20.832704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a4d59-4174-4478-97c8-5dacccbda48c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:20.834622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-229a4d59-4174-4478-97c8-5dacccbda48c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:20.851321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:20.852264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:20.853128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:20.853128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:20.853128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:20.853128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:20.853128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 396/793] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:20.859850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a4d59-4174-4478-97c8-5dacccbda48c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:20.962456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 398/794] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:29:20.976699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a4d59-4174-4478-97c8-5dacccbda48c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:20.976885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89841d15-5f92-4607-a638-27ab03107319 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:21.016999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9c4e4-8a52-471f-ba96-03d16cda8807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:21.017836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9c4e4-8a52-471f-ba96-03d16cda8807 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.018124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9c4e4-8a52-471f-ba96-03d16cda8807 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.018402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9c4e4-8a52-471f-ba96-03d16cda8807 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.019424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9c4e4-8a52-471f-ba96-03d16cda8807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:21.019737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9c4e4-8a52-471f-ba96-03d16cda8807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:21.021118 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9c4e4-8a52-471f-ba96-03d16cda8807 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:21.035810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 397/795] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:21.041180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9c4e4-8a52-471f-ba96-03d16cda8807 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:21.137993 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89841d15-5f92-4607-a638-27ab03107319 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:21.142285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:21.174268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:21.181902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2f177-64c8-47c9-a092-69cbe39a7106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:21.182691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f177-64c8-47c9-a092-69cbe39a7106 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.182972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f177-64c8-47c9-a092-69cbe39a7106 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.183272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f177-64c8-47c9-a092-69cbe39a7106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.190818 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9c4e4-8a52-471f-ba96-03d16cda8807 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:21.194570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2f177-64c8-47c9-a092-69cbe39a7106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:21.196037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2f177-64c8-47c9-a092-69cbe39a7106 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-b1c2f177-64c8-47c9-a092-69cbe39a7106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:21.214442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:21.215610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:21.217038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:21.217038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:21.217038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:21.217038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:21.217038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 399/796] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:21.217706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373739f-2ff6-49e3-80f7-eff83750271c None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.217706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373739f-2ff6-49e3-80f7-eff83750271c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.218085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373739f-2ff6-49e3-80f7-eff83750271c None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.223402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 400/797] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:21.224580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbf074-cca1-4730-aed9-65512b1d648f None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.224864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbf074-cca1-4730-aed9-65512b1d648f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.225139 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbf074-cca1-4730-aed9-65512b1d648f None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.226748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 401/798] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:21.230724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbf074-cca1-4730-aed9-65512b1d648f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:21.236191 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11138fab-fec3-4268-b237-62acde33f396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:21.236998 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11138fab-fec3-4268-b237-62acde33f396 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.237283 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11138fab-fec3-4268-b237-62acde33f396 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.237563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11138fab-fec3-4268-b237-62acde33f396 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.246036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11138fab-fec3-4268-b237-62acde33f396 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:21.247540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11138fab-fec3-4268-b237-62acde33f396 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-11138fab-fec3-4268-b237-62acde33f396 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:21.263241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:21.265339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:21.266489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:21.266489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:21.266489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:21.266489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:21.266489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:21.266489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:21.266489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:21.266489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:21.266489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:29:21.266489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:21.270084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 398/799] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:29:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:21.271377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dd8c8-064e-4761-9ed5-da01c050a84d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.272519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dd8c8-064e-4761-9ed5-da01c050a84d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.272519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dd8c8-064e-4761-9ed5-da01c050a84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.288066 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-338dd8c8-064e-4761-9ed5-da01c050a84d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:21.289284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-338dd8c8-064e-4761-9ed5-da01c050a84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:21.346286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbf074-cca1-4730-aed9-65512b1d648f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:21.360536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 399/800] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:21.361818 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef28f-e9c1-46b9-bc57-61aa8e5474d8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.362108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef28f-e9c1-46b9-bc57-61aa8e5474d8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.362383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef28f-e9c1-46b9-bc57-61aa8e5474d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.386251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5a2ef28f-e9c1-46b9-bc57-61aa8e5474d8 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:21.387464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5a2ef28f-e9c1-46b9-bc57-61aa8e5474d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:21.398483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993b667-03b7-4802-9513-ee3fff400be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:21.399148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993b667-03b7-4802-9513-ee3fff400be6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.399458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993b667-03b7-4802-9513-ee3fff400be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.399732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993b667-03b7-4802-9513-ee3fff400be6 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.400463 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993b667-03b7-4802-9513-ee3fff400be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:21.400769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993b667-03b7-4802-9513-ee3fff400be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:21.402123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993b667-03b7-4802-9513-ee3fff400be6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:21.413734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 402/801] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:21.414538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993b667-03b7-4802-9513-ee3fff400be6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:21.436818 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:21.460867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:21.470792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 400/802] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:21.471620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ef28f-e9c1-46b9-bc57-61aa8e5474d8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:21.525305 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993b667-03b7-4802-9513-ee3fff400be6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:21.566657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60a5c9-2569-41ee-954b-dd23f73e916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:21.567369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60a5c9-2569-41ee-954b-dd23f73e916f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.567669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60a5c9-2569-41ee-954b-dd23f73e916f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.567936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60a5c9-2569-41ee-954b-dd23f73e916f None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.568778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60a5c9-2569-41ee-954b-dd23f73e916f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:21.569095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60a5c9-2569-41ee-954b-dd23f73e916f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:21.570522 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60a5c9-2569-41ee-954b-dd23f73e916f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:21.594952 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 403/803] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Jul 6 20:29:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:21.594952 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60a5c9-2569-41ee-954b-dd23f73e916f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:21.595219 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ef28f-e9c1-46b9-bc57-61aa8e5474d8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:21.630960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8062c65-7f66-4f5b-8613-7493f4d60710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:21.631797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062c65-7f66-4f5b-8613-7493f4d60710 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.632087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062c65-7f66-4f5b-8613-7493f4d60710 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.632364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062c65-7f66-4f5b-8613-7493f4d60710 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.645708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8062c65-7f66-4f5b-8613-7493f4d60710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-a8062c65-7f66-4f5b-8613-7493f4d60710 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:21.655468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:21.656407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:21.657271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:21.657271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:21.657271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:21.657271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:21.657271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:21.657271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:21.657271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:21.657271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:21.657271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:21.657271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:21.657271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:21.657271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:21.657271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 401/804] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:29:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:21.662305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8062c65-7f66-4f5b-8613-7493f4d60710 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:21.698353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:21.708732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:21.711700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60a5c9-2569-41ee-954b-dd23f73e916f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:21.748285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa5785-3017-4b81-880a-176c5cfaf6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:21.748941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa5785-3017-4b81-880a-176c5cfaf6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.749216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa5785-3017-4b81-880a-176c5cfaf6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.749486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa5785-3017-4b81-880a-176c5cfaf6a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.756227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa5785-3017-4b81-880a-176c5cfaf6a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:21.757662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa5785-3017-4b81-880a-176c5cfaf6a7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-5aaa5785-3017-4b81-880a-176c5cfaf6a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:21.771937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:21.772826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:21.773701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:21.773701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:21.773701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:21.773701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:21.773701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:21.773701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:21.773701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:21.773701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:21.773701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 404/805] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:21.774219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa5785-3017-4b81-880a-176c5cfaf6a7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:21.780996 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8062c65-7f66-4f5b-8613-7493f4d60710 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:21.816104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11aa54-c401-4d4d-808b-464635822132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:21.816908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11aa54-c401-4d4d-808b-464635822132 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.817187 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11aa54-c401-4d4d-808b-464635822132 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.817459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11aa54-c401-4d4d-808b-464635822132 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.818104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11aa54-c401-4d4d-808b-464635822132 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:21.819498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11aa54-c401-4d4d-808b-464635822132 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2c11aa54-c401-4d4d-808b-464635822132 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:21.833614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:21.834578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:21.835448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 402/806] 10.222.0.33 () {56 vars in 1129 bytes} [Wed Jul 6 20:29:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:21.836296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11aa54-c401-4d4d-808b-464635822132 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:21.880049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa5785-3017-4b81-880a-176c5cfaf6a7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:21.914114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a8bc-bb07-469f-9a1b-f9d9fb818bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:21.914912 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a8bc-bb07-469f-9a1b-f9d9fb818bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.915218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a8bc-bb07-469f-9a1b-f9d9fb818bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.915501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a8bc-bb07-469f-9a1b-f9d9fb818bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.926982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a8bc-bb07-469f-9a1b-f9d9fb818bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:21.928471 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a8bc-bb07-469f-9a1b-f9d9fb818bf5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:21.935134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:21.940310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11aa54-c401-4d4d-808b-464635822132 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-95c6a8bc-bb07-469f-9a1b-f9d9fb818bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:21.946399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:21.947348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:21.948243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:21.948243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:21.948243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:21.948243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:21.948243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 405/807] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:21.948544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a8bc-bb07-469f-9a1b-f9d9fb818bf5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:21.963947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:21.980370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269de889-9a7e-454f-84fe-9dc36502bdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:21.981121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269de889-9a7e-454f-84fe-9dc36502bdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.981480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269de889-9a7e-454f-84fe-9dc36502bdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.981835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269de889-9a7e-454f-84fe-9dc36502bdf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.983349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269de889-9a7e-454f-84fe-9dc36502bdf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:21.983667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269de889-9a7e-454f-84fe-9dc36502bdf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:21.985054 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269de889-9a7e-454f-84fe-9dc36502bdf0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:21.992895 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 403/808] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:29:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:21.994127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80dfd-cf8e-44dc-8f11-4c7e6bda8a3e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:21.994438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80dfd-cf8e-44dc-8f11-4c7e6bda8a3e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:21.994697 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80dfd-cf8e-44dc-8f11-4c7e6bda8a3e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:21.995961 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 404/809] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:21.996656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d80dfd-cf8e-44dc-8f11-4c7e6bda8a3e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:22.055317 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a8bc-bb07-469f-9a1b-f9d9fb818bf5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:22.089689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4317a27-0fe8-4282-bac3-fbf37a3bbe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:22.090347 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4317a27-0fe8-4282-bac3-fbf37a3bbe4d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:22.090635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4317a27-0fe8-4282-bac3-fbf37a3bbe4d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:22.090917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4317a27-0fe8-4282-bac3-fbf37a3bbe4d None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:22.092352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4317a27-0fe8-4282-bac3-fbf37a3bbe4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:22.092675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4317a27-0fe8-4282-bac3-fbf37a3bbe4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:22.094109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4317a27-0fe8-4282-bac3-fbf37a3bbe4d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:22.100454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d80dfd-cf8e-44dc-8f11-4c7e6bda8a3e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:22.105922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 406/810] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:22.106711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4317a27-0fe8-4282-bac3-fbf37a3bbe4d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:22.137487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58272ce5-9d70-4bea-b1ff-625f49dd5d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:22.138155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272ce5-9d70-4bea-b1ff-625f49dd5d17 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:22.139041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272ce5-9d70-4bea-b1ff-625f49dd5d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:22.139394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272ce5-9d70-4bea-b1ff-625f49dd5d17 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:22.140106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58272ce5-9d70-4bea-b1ff-625f49dd5d17 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:22.140423 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58272ce5-9d70-4bea-b1ff-625f49dd5d17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:22.141797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58272ce5-9d70-4bea-b1ff-625f49dd5d17 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:22.146548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 405/811] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Jul 6 20:29:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:22.147430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58272ce5-9d70-4bea-b1ff-625f49dd5d17 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:22.172056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:22.176941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:22.206760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4317a27-0fe8-4282-bac3-fbf37a3bbe4d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:22.240810 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899bb1f-3f89-4284-9ae4-26fe8d8168ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:22.241462 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899bb1f-3f89-4284-9ae4-26fe8d8168ec None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:22.241744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899bb1f-3f89-4284-9ae4-26fe8d8168ec None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:22.242020 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899bb1f-3f89-4284-9ae4-26fe8d8168ec None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:22.242727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899bb1f-3f89-4284-9ae4-26fe8d8168ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:22.243030 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899bb1f-3f89-4284-9ae4-26fe8d8168ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:22.244418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899bb1f-3f89-4284-9ae4-26fe8d8168ec None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:22.246105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58272ce5-9d70-4bea-b1ff-625f49dd5d17 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:22.256145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 407/812] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:22.257350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41310bb0-1305-462a-93e4-5c24a5d3a53c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:22.257640 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41310bb0-1305-462a-93e4-5c24a5d3a53c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:22.257917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41310bb0-1305-462a-93e4-5c24a5d3a53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:22.275278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-41310bb0-1305-462a-93e4-5c24a5d3a53c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:22.276472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-41310bb0-1305-462a-93e4-5c24a5d3a53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:22.281407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cf4c8-3343-4b6a-af97-729226c011a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:22.282199 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cf4c8-3343-4b6a-af97-729226c011a0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:22.282486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cf4c8-3343-4b6a-af97-729226c011a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:22.282764 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cf4c8-3343-4b6a-af97-729226c011a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:22.293196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cf4c8-3343-4b6a-af97-729226c011a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:22.295239 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cf4c8-3343-4b6a-af97-729226c011a0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b47cf4c8-3343-4b6a-af97-729226c011a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:22.312354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:22.313227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:22.314093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:22.314093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:22.314093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:22.314093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:22.314093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 406/813] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:22.314374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cf4c8-3343-4b6a-af97-729226c011a0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:22.344289 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 408/814] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:22.345129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41310bb0-1305-462a-93e4-5c24a5d3a53c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:22.391058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:22.406185 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:22.414222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cf4c8-3343-4b6a-af97-729226c011a0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:22.444000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41310bb0-1305-462a-93e4-5c24a5d3a53c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:22.447023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e94b1-7535-44cf-b2a9-ab20e9363e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:22.447712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e94b1-7535-44cf-b2a9-ab20e9363e18 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:22.448000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e94b1-7535-44cf-b2a9-ab20e9363e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:22.448278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e94b1-7535-44cf-b2a9-ab20e9363e18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:22.449101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e94b1-7535-44cf-b2a9-ab20e9363e18 None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=3d68c8fdb65343b8b2f58070addeaf13) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:22.449415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e94b1-7535-44cf-b2a9-ab20e9363e18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:22.450869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e94b1-7535-44cf-b2a9-ab20e9363e18 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:22.457247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 407/815] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:22 2022] GET /identity/v3/role_assignments?user.id=3d68c8fdb65343b8b2f58070addeaf13&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:22.458018 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e94b1-7535-44cf-b2a9-ab20e9363e18 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:22.481881 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dce4a-e582-426f-9819-fcf68d78a457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:22.483605 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dce4a-e582-426f-9819-fcf68d78a457 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:22.484073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dce4a-e582-426f-9819-fcf68d78a457 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:22.484619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dce4a-e582-426f-9819-fcf68d78a457 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:22.485658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dce4a-e582-426f-9819-fcf68d78a457 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:22.486147 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dce4a-e582-426f-9819-fcf68d78a457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:22.487884 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dce4a-e582-426f-9819-fcf68d78a457 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:22.493809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 409/816] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Jul 6 20:29:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:22.495186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dce4a-e582-426f-9819-fcf68d78a457 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:22.574564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e94b1-7535-44cf-b2a9-ab20e9363e18 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:22.617569 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dce4a-e582-426f-9819-fcf68d78a457 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:22.617770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d7514-8c13-4b96-ba32-206f4512fce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:22.618459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d7514-8c13-4b96-ba32-206f4512fce4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:22.618749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d7514-8c13-4b96-ba32-206f4512fce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:22.619037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d7514-8c13-4b96-ba32-206f4512fce4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:22.631278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d7514-8c13-4b96-ba32-206f4512fce4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:22.632683 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d7514-8c13-4b96-ba32-206f4512fce4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:22.635951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:22.649352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4d8d7514-8c13-4b96-ba32-206f4512fce4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:22.650471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:22.651451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:22.658391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:22.658391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:22.658391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:22.658391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:22.658391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:22.658391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:22.658391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:22.658391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:22.658391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 408/817] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:22.658391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d7514-8c13-4b96-ba32-206f4512fce4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:22.662938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189f566-f078-487e-a108-e7811ae3195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:22.663719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f566-f078-487e-a108-e7811ae3195e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:22.664072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f566-f078-487e-a108-e7811ae3195e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:22.664417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f566-f078-487e-a108-e7811ae3195e None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:22.665219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189f566-f078-487e-a108-e7811ae3195e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:22.665538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189f566-f078-487e-a108-e7811ae3195e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:22.666901 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189f566-f078-487e-a108-e7811ae3195e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:22.679073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 410/818] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:22.683212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189f566-f078-487e-a108-e7811ae3195e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:22.766906 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d7514-8c13-4b96-ba32-206f4512fce4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:22.786227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189f566-f078-487e-a108-e7811ae3195e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:22.808816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadec9f-a7b2-4881-b85a-42df2a9c42a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:22.809728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadec9f-a7b2-4881-b85a-42df2a9c42a3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:22.810098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadec9f-a7b2-4881-b85a-42df2a9c42a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:22.810984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadec9f-a7b2-4881-b85a-42df2a9c42a3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:22.811736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadec9f-a7b2-4881-b85a-42df2a9c42a3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:22.813183 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadec9f-a7b2-4881-b85a-42df2a9c42a3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1aadec9f-a7b2-4881-b85a-42df2a9c42a3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:22.825181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:22.826875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:22.827784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 409/819] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:22 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:22.828656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadec9f-a7b2-4881-b85a-42df2a9c42a3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:22.829862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd9a20-99f7-4f1b-ade0-b7f1c9d4cf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:22.830705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd9a20-99f7-4f1b-ade0-b7f1c9d4cf04 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:22.831360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd9a20-99f7-4f1b-ade0-b7f1c9d4cf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:22.831787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd9a20-99f7-4f1b-ade0-b7f1c9d4cf04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:22.833547 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd9a20-99f7-4f1b-ade0-b7f1c9d4cf04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:22.835069 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd9a20-99f7-4f1b-ade0-b7f1c9d4cf04 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:22.869535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 411/820] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jul 6 20:29:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:22.870690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd9a20-99f7-4f1b-ade0-b7f1c9d4cf04 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:22.904449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:22.934299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:22.953058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadec9f-a7b2-4881-b85a-42df2a9c42a3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:23.006010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42d51e-b908-4bf7-8bd9-3942faa9472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:23.007307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42d51e-b908-4bf7-8bd9-3942faa9472a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:23.007740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42d51e-b908-4bf7-8bd9-3942faa9472a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:23.008347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42d51e-b908-4bf7-8bd9-3942faa9472a None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:23.009782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42d51e-b908-4bf7-8bd9-3942faa9472a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:23.010377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42d51e-b908-4bf7-8bd9-3942faa9472a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:23.012033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42d51e-b908-4bf7-8bd9-3942faa9472a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:23.012586 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd9a20-99f7-4f1b-ade0-b7f1c9d4cf04 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:23.034372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 410/821] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:23.034372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42d51e-b908-4bf7-8bd9-3942faa9472a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:23.062954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a9ce7-a8aa-42e2-9104-5b200d0e8625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:23.064055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a9ce7-a8aa-42e2-9104-5b200d0e8625 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:23.064522 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a9ce7-a8aa-42e2-9104-5b200d0e8625 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:23.065067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a9ce7-a8aa-42e2-9104-5b200d0e8625 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:23.074386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a9ce7-a8aa-42e2-9104-5b200d0e8625 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:23.076852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a9ce7-a8aa-42e2-9104-5b200d0e8625 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-265a9ce7-a8aa-42e2-9104-5b200d0e8625 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:23.092374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:23.093676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:23.094843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:23.094843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:23.094843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:23.094843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:23.094843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:23.094843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:23.094843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:23.094843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:23.094843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:29:23.094843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:23.094843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 412/822] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jul 6 20:29:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:23.094843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a9ce7-a8aa-42e2-9104-5b200d0e8625 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:23.157027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42d51e-b908-4bf7-8bd9-3942faa9472a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:23.183653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:23.203135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb25a96-9b0f-45e6-a9f3-66d8715c02e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:23.204624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb25a96-9b0f-45e6-a9f3-66d8715c02e5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:23.205155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb25a96-9b0f-45e6-a9f3-66d8715c02e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:23.205574 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb25a96-9b0f-45e6-a9f3-66d8715c02e5 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:23.206765 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb25a96-9b0f-45e6-a9f3-66d8715c02e5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:23.207580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb25a96-9b0f-45e6-a9f3-66d8715c02e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:23.209589 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb25a96-9b0f-45e6-a9f3-66d8715c02e5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:23.212707 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a9ce7-a8aa-42e2-9104-5b200d0e8625 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:23.214481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:23.221437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 411/823] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jul 6 20:29:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:23.223138 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb25a96-9b0f-45e6-a9f3-66d8715c02e5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:23.251619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0507e33-040d-4722-8d9b-7a61241a1f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:23.252660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0507e33-040d-4722-8d9b-7a61241a1f91 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:23.253043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0507e33-040d-4722-8d9b-7a61241a1f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:23.253414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0507e33-040d-4722-8d9b-7a61241a1f91 None admin] PATH_INFO: `/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/88dff378ccb4497fb305563614ea4caa/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:23.255559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0507e33-040d-4722-8d9b-7a61241a1f91 None admin] RBAC: Authorizing `identity:create_grant(project_id=8eda6c9cf4b1439eb280b0db35b3bce2, user_id=88dff378ccb4497fb305563614ea4caa, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:23.257103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0507e33-040d-4722-8d9b-7a61241a1f91 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:23.274695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 413/824] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:29:23 2022] PUT /identity/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/88dff378ccb4497fb305563614ea4caa/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:29:23.282737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0507e33-040d-4722-8d9b-7a61241a1f91 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:23.429609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb25a96-9b0f-45e6-a9f3-66d8715c02e5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:23.479824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb700ab-e552-4ae7-941e-4caae63504a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:23.480497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb700ab-e552-4ae7-941e-4caae63504a7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:23.480782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb700ab-e552-4ae7-941e-4caae63504a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:23.481060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb700ab-e552-4ae7-941e-4caae63504a7 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:23.481243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0507e33-040d-4722-8d9b-7a61241a1f91 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:23.481896 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb700ab-e552-4ae7-941e-4caae63504a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:23.482210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb700ab-e552-4ae7-941e-4caae63504a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:23.483843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb700ab-e552-4ae7-941e-4caae63504a7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:23.503966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 412/825] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Jul 6 20:29:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:23.512857 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb700ab-e552-4ae7-941e-4caae63504a7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:23.533691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b712a7-a7b6-485f-be5c-5ba67180d758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:23.535609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b712a7-a7b6-485f-be5c-5ba67180d758 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:23.536045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b712a7-a7b6-485f-be5c-5ba67180d758 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:23.536640 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b712a7-a7b6-485f-be5c-5ba67180d758 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:23.538211 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b712a7-a7b6-485f-be5c-5ba67180d758 None admin] RBAC: Adding query filter params (type=network) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:23.539392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b712a7-a7b6-485f-be5c-5ba67180d758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:23.541119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b712a7-a7b6-485f-be5c-5ba67180d758 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:23.552040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 414/826] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jul 6 20:29:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:23.557728 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b712a7-a7b6-485f-be5c-5ba67180d758 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:23.605938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:23.630202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:23.712839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb700ab-e552-4ae7-941e-4caae63504a7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:23.722065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b712a7-a7b6-485f-be5c-5ba67180d758 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:23.761251 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7c18d-ec6f-46d8-b084-a2cfe21cf028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:23.762247 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c18d-ec6f-46d8-b084-a2cfe21cf028 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:23.762679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c18d-ec6f-46d8-b084-a2cfe21cf028 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:23.763117 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c18d-ec6f-46d8-b084-a2cfe21cf028 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:23.764815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7c18d-ec6f-46d8-b084-a2cfe21cf028 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:23.766464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7c18d-ec6f-46d8-b084-a2cfe21cf028 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:23.790491 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbf204-c760-4134-84f3-7a3add25212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:23.791696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbf204-c760-4134-84f3-7a3add25212e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:23.792227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbf204-c760-4134-84f3-7a3add25212e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:23.792676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbf204-c760-4134-84f3-7a3add25212e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:23.793034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 415/827] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jul 6 20:29:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:23.807156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbf204-c760-4134-84f3-7a3add25212e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:23.809070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbf204-c760-4134-84f3-7a3add25212e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-63fbf204-c760-4134-84f3-7a3add25212e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:23.832382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:23.834024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:23.835132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:23.835132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:23.835132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:23.835132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:23.837355 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 413/828] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:23.843670 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7c18d-ec6f-46d8-b084-a2cfe21cf028 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:23.943439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:23.979223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7c18d-ec6f-46d8-b084-a2cfe21cf028 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:24.042036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db532961-6568-4f0b-a9a3-fc47280ed470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:24.042711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db532961-6568-4f0b-a9a3-fc47280ed470 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:24.042998 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db532961-6568-4f0b-a9a3-fc47280ed470 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:24.043326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db532961-6568-4f0b-a9a3-fc47280ed470 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:24.044057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db532961-6568-4f0b-a9a3-fc47280ed470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:24.044371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db532961-6568-4f0b-a9a3-fc47280ed470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:24.045890 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db532961-6568-4f0b-a9a3-fc47280ed470 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:24.059424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 416/829] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:24.066597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbf204-c760-4134-84f3-7a3add25212e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:24.172532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:24.181524 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbf204-c760-4134-84f3-7a3add25212e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:24.222993 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d199f57-8e63-49f0-b41d-9fd23891b064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:24.224236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d199f57-8e63-49f0-b41d-9fd23891b064 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:24.224726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d199f57-8e63-49f0-b41d-9fd23891b064 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:24.225228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d199f57-8e63-49f0-b41d-9fd23891b064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:24.233695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d199f57-8e63-49f0-b41d-9fd23891b064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:24.235476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d199f57-8e63-49f0-b41d-9fd23891b064 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1d199f57-8e63-49f0-b41d-9fd23891b064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:24.252063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:24.253127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:24.254027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:24.254027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:24.254027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:24.254027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:24.254027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:24.254027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:24.254027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:24.254027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:24.256902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 414/830] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:24.264842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db532961-6568-4f0b-a9a3-fc47280ed470 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:24.386101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db532961-6568-4f0b-a9a3-fc47280ed470 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:24.423829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70dd11a-1980-48cb-8032-0fa855efaedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:24.424894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dd11a-1980-48cb-8032-0fa855efaedb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:24.425395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dd11a-1980-48cb-8032-0fa855efaedb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:24.425877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dd11a-1980-48cb-8032-0fa855efaedb None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:24.426873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70dd11a-1980-48cb-8032-0fa855efaedb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:24.427414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70dd11a-1980-48cb-8032-0fa855efaedb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:24.429041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70dd11a-1980-48cb-8032-0fa855efaedb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:24.439650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:24.443156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 417/831] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:24.449564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d199f57-8e63-49f0-b41d-9fd23891b064 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:24.574342 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d199f57-8e63-49f0-b41d-9fd23891b064 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:24.628793 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdb5c4-ba82-44c3-b1fb-0d9d710409dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:24.629704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb5c4-ba82-44c3-b1fb-0d9d710409dd None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:24.629991 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb5c4-ba82-44c3-b1fb-0d9d710409dd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:24.630269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb5c4-ba82-44c3-b1fb-0d9d710409dd None admin] PATH_INFO: `/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/e1c9cdf941294b4190245ed43d219ef6/roles/55dba566c5b54bc488719c0c5bb0ce15` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:24.664072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdb5c4-ba82-44c3-b1fb-0d9d710409dd None admin] RBAC: Authorizing `identity:create_grant(project_id=8eda6c9cf4b1439eb280b0db35b3bce2, user_id=e1c9cdf941294b4190245ed43d219ef6, role_id=55dba566c5b54bc488719c0c5bb0ce15)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:24.665545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdb5c4-ba82-44c3-b1fb-0d9d710409dd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:24.695135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 415/832] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:29:24 2022] PUT /identity/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/e1c9cdf941294b4190245ed43d219ef6/roles/55dba566c5b54bc488719c0c5bb0ce15 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:29:24.834068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab239d27-48f2-4d72-aea6-bcc470422dc8 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:24.835075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab239d27-48f2-4d72-aea6-bcc470422dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:24.835592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab239d27-48f2-4d72-aea6-bcc470422dc8 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:24.837544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 418/833] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:24.845018 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2717-6e05-4134-8c37-49ac1f01e911 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:24.845972 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2717-6e05-4134-8c37-49ac1f01e911 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:24.846488 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2717-6e05-4134-8c37-49ac1f01e911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:24.854543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:24.880563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-65de2717-6e05-4134-8c37-49ac1f01e911 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:24.882396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-65de2717-6e05-4134-8c37-49ac1f01e911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:24.973947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 416/834] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:25.001287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab239d27-48f2-4d72-aea6-bcc470422dc8 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:25.115967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab239d27-48f2-4d72-aea6-bcc470422dc8 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:25.152693 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55da8d-0387-4c47-8518-6eab3cee2365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:25.153512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55da8d-0387-4c47-8518-6eab3cee2365 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:25.153788 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55da8d-0387-4c47-8518-6eab3cee2365 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:25.154065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55da8d-0387-4c47-8518-6eab3cee2365 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:25.155107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55da8d-0387-4c47-8518-6eab3cee2365 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:25.156263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55da8d-0387-4c47-8518-6eab3cee2365 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-7d55da8d-0387-4c47-8518-6eab3cee2365 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:25.168876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:25.169834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:25.171873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 419/835] 10.222.0.33 () {56 vars in 1132 bytes} [Wed Jul 6 20:29:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:25.179269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2717-6e05-4134-8c37-49ac1f01e911 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:25.291688 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ac728-a128-46a3-9b79-067c0b5b4048 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:25.292127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ac728-a128-46a3-9b79-067c0b5b4048 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:25.292418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ac728-a128-46a3-9b79-067c0b5b4048 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:25.294625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 420/836] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:29:25.296417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2717-6e05-4134-8c37-49ac1f01e911 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:25.301665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76ffc-84dd-4570-b481-de1399cbfb54 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:25.301955 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76ffc-84dd-4570-b481-de1399cbfb54 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:25.302233 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76ffc-84dd-4570-b481-de1399cbfb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:25.325088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-91d76ffc-84dd-4570-b481-de1399cbfb54 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:25.326682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-91d76ffc-84dd-4570-b481-de1399cbfb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:25.332940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcc614-5a0b-417c-bae0-241bd2435da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:25.333619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcc614-5a0b-417c-bae0-241bd2435da2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:25.333907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcc614-5a0b-417c-bae0-241bd2435da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:25.334187 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcc614-5a0b-417c-bae0-241bd2435da2 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:25.334896 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcc614-5a0b-417c-bae0-241bd2435da2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:25.335235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcc614-5a0b-417c-bae0-241bd2435da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:25.336977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcc614-5a0b-417c-bae0-241bd2435da2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:25.341910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 417/837] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jul 6 20:29:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:25.343005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:25.348626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcc614-5a0b-417c-bae0-241bd2435da2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:25.468412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcc614-5a0b-417c-bae0-241bd2435da2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:25.506768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc1052-876b-46b1-9860-da448006a176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:25.507485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc1052-876b-46b1-9860-da448006a176 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:25.507769 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc1052-876b-46b1-9860-da448006a176 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:25.508045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc1052-876b-46b1-9860-da448006a176 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:25.508816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc1052-876b-46b1-9860-da448006a176 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:25.509124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc1052-876b-46b1-9860-da448006a176 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:25.510551 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc1052-876b-46b1-9860-da448006a176 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:25.517057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 418/838] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jul 6 20:29:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:25.532487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:25.545311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 421/839] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:25.568220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc1052-876b-46b1-9860-da448006a176 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:25.641646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:25.683221 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc1052-876b-46b1-9860-da448006a176 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:25.718279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617085e-2747-4fcd-b55f-748a5a1b3e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:25.719143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617085e-2747-4fcd-b55f-748a5a1b3e75 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:25.719394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617085e-2747-4fcd-b55f-748a5a1b3e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:25.719670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617085e-2747-4fcd-b55f-748a5a1b3e75 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:25.720323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617085e-2747-4fcd-b55f-748a5a1b3e75 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:25.721696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617085e-2747-4fcd-b55f-748a5a1b3e75 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e617085e-2747-4fcd-b55f-748a5a1b3e75 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:25.733935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:25.734963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:29:25.735835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:25.736567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f33e8-ae66-4712-a188-a3b8174f6160 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:25.736567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f33e8-ae66-4712-a188-a3b8174f6160 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:25.736696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 419/840] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:29:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:25.736772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f33e8-ae66-4712-a188-a3b8174f6160 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:25.738302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 422/841] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:25.742889 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57886c-cb2a-481b-bec4-a98dc0f32b51 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:25.743193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57886c-cb2a-481b-bec4-a98dc0f32b51 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:25.743364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f33e8-ae66-4712-a188-a3b8174f6160 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:25.743517 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57886c-cb2a-481b-bec4-a98dc0f32b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:25.760610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5c57886c-cb2a-481b-bec4-a98dc0f32b51 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:25.761791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5c57886c-cb2a-481b-bec4-a98dc0f32b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:25.847255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 420/842] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:25.858733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f33e8-ae66-4712-a188-a3b8174f6160 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:25.872859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57886c-cb2a-481b-bec4-a98dc0f32b51 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:25.903937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472aa3e-b2cc-476a-81a9-7020f805d8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:25.904997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472aa3e-b2cc-476a-81a9-7020f805d8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:25.905476 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472aa3e-b2cc-476a-81a9-7020f805d8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:25.905943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472aa3e-b2cc-476a-81a9-7020f805d8c2 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:25.906976 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472aa3e-b2cc-476a-81a9-7020f805d8c2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:25.907556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472aa3e-b2cc-476a-81a9-7020f805d8c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:25.909120 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472aa3e-b2cc-476a-81a9-7020f805d8c2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:25.914651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 423/843] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:29:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:25.921304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472aa3e-b2cc-476a-81a9-7020f805d8c2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:25.943400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:25.994242 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:26.006035 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57886c-cb2a-481b-bec4-a98dc0f32b51 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:26.048784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ab4ff-aa61-4788-93f9-ecd11a42b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:26.049951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab4ff-aa61-4788-93f9-ecd11a42b276 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:26.050433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab4ff-aa61-4788-93f9-ecd11a42b276 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:26.050867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472aa3e-b2cc-476a-81a9-7020f805d8c2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:26.051139 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab4ff-aa61-4788-93f9-ecd11a42b276 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:26.064469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ab4ff-aa61-4788-93f9-ecd11a42b276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-050ab4ff-aa61-4788-93f9-ecd11a42b276 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:26.072848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:26.073779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:26.074595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:26.074595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:26.074595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:26.074595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:26.074595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:26.074595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:26.074595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:26.074595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:26.074595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:26.074595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:26.074595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:26.074595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:26.079599 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 421/844] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:29:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:26.081705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ab4ff-aa61-4788-93f9-ecd11a42b276 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:26.089875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ea7cf-d294-412f-a546-428e7daf39e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:26.090789 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ea7cf-d294-412f-a546-428e7daf39e4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:26.091311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ea7cf-d294-412f-a546-428e7daf39e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:26.091805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ea7cf-d294-412f-a546-428e7daf39e4 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:26.093302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ea7cf-d294-412f-a546-428e7daf39e4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:26.093820 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ea7cf-d294-412f-a546-428e7daf39e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:26.095394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ea7cf-d294-412f-a546-428e7daf39e4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:26.100534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 424/845] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:29:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:26.209483 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ab4ff-aa61-4788-93f9-ecd11a42b276 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:26.229166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:26.251346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4da49-e385-41c0-893a-a338ec8ce6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:26.251955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4da49-e385-41c0-893a-a338ec8ce6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:26.252242 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4da49-e385-41c0-893a-a338ec8ce6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:26.252526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4da49-e385-41c0-893a-a338ec8ce6e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:26.253278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4da49-e385-41c0-893a-a338ec8ce6e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:26.253590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4da49-e385-41c0-893a-a338ec8ce6e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:26.254968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4da49-e385-41c0-893a-a338ec8ce6e0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:26.264490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 422/846] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:29:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:26.270559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ea7cf-d294-412f-a546-428e7daf39e4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:26.391698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ea7cf-d294-412f-a546-428e7daf39e4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:26.414155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:26.430726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae858b-aeda-44ca-9bd9-a2b615c6af78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:26.431920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae858b-aeda-44ca-9bd9-a2b615c6af78 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:26.432443 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae858b-aeda-44ca-9bd9-a2b615c6af78 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:26.432931 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae858b-aeda-44ca-9bd9-a2b615c6af78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:26.444770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae858b-aeda-44ca-9bd9-a2b615c6af78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:26.446447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae858b-aeda-44ca-9bd9-a2b615c6af78 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-8bae858b-aeda-44ca-9bd9-a2b615c6af78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:26.465717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:26.466641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:26.468762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:26.468762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:26.468762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:26.468762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:26.470780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 425/847] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:26.477821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4da49-e385-41c0-893a-a338ec8ce6e0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:26.723004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4da49-e385-41c0-893a-a338ec8ce6e0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:26.760764 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad8dd9-5b30-4669-8ea9-2562efbe7deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:26.761490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8dd9-5b30-4669-8ea9-2562efbe7deb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:26.761779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8dd9-5b30-4669-8ea9-2562efbe7deb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:26.762060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8dd9-5b30-4669-8ea9-2562efbe7deb None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:26.762787 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad8dd9-5b30-4669-8ea9-2562efbe7deb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:26.763098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad8dd9-5b30-4669-8ea9-2562efbe7deb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:26.765751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad8dd9-5b30-4669-8ea9-2562efbe7deb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:26.778331 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 423/848] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:26.783862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae858b-aeda-44ca-9bd9-a2b615c6af78 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:26.884621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae858b-aeda-44ca-9bd9-a2b615c6af78 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:26.928755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c0b53-1cba-4207-acbf-1fc2684a9962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:26.929562 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c0b53-1cba-4207-acbf-1fc2684a9962 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:26.929846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c0b53-1cba-4207-acbf-1fc2684a9962 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:26.930124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c0b53-1cba-4207-acbf-1fc2684a9962 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:26.938420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c0b53-1cba-4207-acbf-1fc2684a9962 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:26.940912 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c0b53-1cba-4207-acbf-1fc2684a9962 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:26.955401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfb22d-d1f7-4b28-bdfb-8a10f108e568 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:26.955875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfb22d-d1f7-4b28-bdfb-8a10f108e568 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:26.955952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfb22d-d1f7-4b28-bdfb-8a10f108e568 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:26.957542 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 424/849] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-ac8c0b53-1cba-4207-acbf-1fc2684a9962 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:26.957760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:26.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:26.964223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:26.964223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:26.964223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:26.964223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:26.964223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:26.964223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:26.964223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:26.964223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:26.964223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 20:29:26.964223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:26.964223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 426/850] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:29:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:26.966152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936f82-d460-478e-b2df-d55fdb0878c6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:26.966511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936f82-d460-478e-b2df-d55fdb0878c6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:26.966859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936f82-d460-478e-b2df-d55fdb0878c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:26.969569 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c0b53-1cba-4207-acbf-1fc2684a9962 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:26.984892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-24936f82-d460-478e-b2df-d55fdb0878c6 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:26.986251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-24936f82-d460-478e-b2df-d55fdb0878c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:27.016212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:27.023559 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:27.057749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 425/851] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:27.081442 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24936f82-d460-478e-b2df-d55fdb0878c6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:27.102104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c0b53-1cba-4207-acbf-1fc2684a9962 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:27.137684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4692b8-4610-4427-83e0-4c94a7c249ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:27.138630 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4692b8-4610-4427-83e0-4c94a7c249ef None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:27.139736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4692b8-4610-4427-83e0-4c94a7c249ef None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:27.140209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4692b8-4610-4427-83e0-4c94a7c249ef None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:27.141280 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4692b8-4610-4427-83e0-4c94a7c249ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:27.141783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4692b8-4610-4427-83e0-4c94a7c249ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:27.143231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4692b8-4610-4427-83e0-4c94a7c249ef None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:27.162022 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 427/852] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Jul 6 20:29:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:27.167137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4692b8-4610-4427-83e0-4c94a7c249ef None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:27.225646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24936f82-d460-478e-b2df-d55fdb0878c6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:27.262637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa67fc2-f84b-49d0-b41c-0f3a08c1ba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:27.263143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67fc2-f84b-49d0-b41c-0f3a08c1ba99 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:27.263460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67fc2-f84b-49d0-b41c-0f3a08c1ba99 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:27.263741 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67fc2-f84b-49d0-b41c-0f3a08c1ba99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:27.275997 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa67fc2-f84b-49d0-b41c-0f3a08c1ba99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-caa67fc2-f84b-49d0-b41c-0f3a08c1ba99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:27.285293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:27.286415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:27.287289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:27.287289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:27.287289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:27.287289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:27.287289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:27.287289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:27.287289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:27.287289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:27.287289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:27.287289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:27.287289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:29:27.287289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:27.287939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:27.291475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 426/853] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:29:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:27.292939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa67fc2-f84b-49d0-b41c-0f3a08c1ba99 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:27.302126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4692b8-4610-4427-83e0-4c94a7c249ef None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:27.329513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:27.360100 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a792d-75a0-476d-85ce-132683dd48f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:27.361442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a792d-75a0-476d-85ce-132683dd48f9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:27.361934 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a792d-75a0-476d-85ce-132683dd48f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:27.362559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a792d-75a0-476d-85ce-132683dd48f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:27.416640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa67fc2-f84b-49d0-b41c-0f3a08c1ba99 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:27.458363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a792d-75a0-476d-85ce-132683dd48f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:27.459334 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cf7fb-c11a-4573-98b4-f1da23f5c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:27.460014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cf7fb-c11a-4573-98b4-f1da23f5c620 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:27.460301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cf7fb-c11a-4573-98b4-f1da23f5c620 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:27.460578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cf7fb-c11a-4573-98b4-f1da23f5c620 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:27.461209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a792d-75a0-476d-85ce-132683dd48f9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:27.461331 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cf7fb-c11a-4573-98b4-f1da23f5c620 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:27.461614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cf7fb-c11a-4573-98b4-f1da23f5c620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:27.462972 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cf7fb-c11a-4573-98b4-f1da23f5c620 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:27.475241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 427/854] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:29:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:27.478253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cf7fb-c11a-4573-98b4-f1da23f5c620 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:27.569681 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:27.577382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:27.589019 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cf7fb-c11a-4573-98b4-f1da23f5c620 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:27.596414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 428/855] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:27 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:29:27.607251 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a792d-75a0-476d-85ce-132683dd48f9 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:27.627766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cac7cc-dd49-4ddf-aff8-f8afbd16e104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:27.628576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac7cc-dd49-4ddf-aff8-f8afbd16e104 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:27.628892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac7cc-dd49-4ddf-aff8-f8afbd16e104 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:27.629135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac7cc-dd49-4ddf-aff8-f8afbd16e104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:27.645711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cac7cc-dd49-4ddf-aff8-f8afbd16e104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:27.647015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cac7cc-dd49-4ddf-aff8-f8afbd16e104 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-21cac7cc-dd49-4ddf-aff8-f8afbd16e104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:27.666167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:27.667405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:27.668380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:27.668380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:27.668380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:27.668380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:27.668380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 428/856] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:27.673542 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cac7cc-dd49-4ddf-aff8-f8afbd16e104 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:27.731515 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a792d-75a0-476d-85ce-132683dd48f9 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:27.767194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbac0c5-24f3-473a-a9a9-b96969a1823f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:27.768009 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbac0c5-24f3-473a-a9a9-b96969a1823f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:27.768291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbac0c5-24f3-473a-a9a9-b96969a1823f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:27.768564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbac0c5-24f3-473a-a9a9-b96969a1823f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:27.779514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbac0c5-24f3-473a-a9a9-b96969a1823f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:27.782114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbac0c5-24f3-473a-a9a9-b96969a1823f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:27.783811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cac7cc-dd49-4ddf-aff8-f8afbd16e104 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-cbbac0c5-24f3-473a-a9a9-b96969a1823f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:27.800528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:27.801486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:27.802376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:27.802376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:27.802376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:27.802376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:27.806464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 429/857] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:27.807603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927a7be-1024-4cb9-844f-5764ea508e72 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:27.807897 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927a7be-1024-4cb9-844f-5764ea508e72 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:27.808185 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927a7be-1024-4cb9-844f-5764ea508e72 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:27.809772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 430/858] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:27.810477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927a7be-1024-4cb9-844f-5764ea508e72 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:27.826268 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcc3d4-f1d3-4913-be32-e85e5fe3946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:27.827002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcc3d4-f1d3-4913-be32-e85e5fe3946f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:27.827406 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcc3d4-f1d3-4913-be32-e85e5fe3946f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:27.827681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcc3d4-f1d3-4913-be32-e85e5fe3946f None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:27.828406 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcc3d4-f1d3-4913-be32-e85e5fe3946f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:27.828711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcc3d4-f1d3-4913-be32-e85e5fe3946f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:27.830069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcc3d4-f1d3-4913-be32-e85e5fe3946f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:27.847328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 429/859] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:27.847328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8746a62-198a-4a4d-80ac-ac3f404c8c9f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:27.847328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8746a62-198a-4a4d-80ac-ac3f404c8c9f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:27.847328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8746a62-198a-4a4d-80ac-ac3f404c8c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:27.851197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:27.864833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:27.865652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e8746a62-198a-4a4d-80ac-ac3f404c8c9f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:27.866997 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e8746a62-198a-4a4d-80ac-ac3f404c8c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:27.929126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927a7be-1024-4cb9-844f-5764ea508e72 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:27.940935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 430/860] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:27.941883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8746a62-198a-4a4d-80ac-ac3f404c8c9f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:27.982403 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fdd06-4c6b-475a-ba0d-22ce07b91c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:27.983710 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fdd06-4c6b-475a-ba0d-22ce07b91c9e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:27.983996 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fdd06-4c6b-475a-ba0d-22ce07b91c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:27.984270 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fdd06-4c6b-475a-ba0d-22ce07b91c9e None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:27.984989 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fdd06-4c6b-475a-ba0d-22ce07b91c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:27.985292 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fdd06-4c6b-475a-ba0d-22ce07b91c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:27.986651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fdd06-4c6b-475a-ba0d-22ce07b91c9e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:28.004047 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 431/861] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:28.004047 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fdd06-4c6b-475a-ba0d-22ce07b91c9e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:28.058903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8746a62-198a-4a4d-80ac-ac3f404c8c9f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:28.090339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:28.096412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e1aad-6ba0-410f-97d5-ad4a78b84f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:28.097124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e1aad-6ba0-410f-97d5-ad4a78b84f33 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:28.097418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e1aad-6ba0-410f-97d5-ad4a78b84f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:28.097686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e1aad-6ba0-410f-97d5-ad4a78b84f33 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:28.104926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e1aad-6ba0-410f-97d5-ad4a78b84f33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:28.106503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e1aad-6ba0-410f-97d5-ad4a78b84f33 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:28.106728 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fdd06-4c6b-475a-ba0d-22ce07b91c9e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:28.108657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-8a7e1aad-6ba0-410f-97d5-ad4a78b84f33 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:28.124544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:28.125708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:28.126865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:28.126865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:28.126865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:28.126865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:28.126865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:28.126865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:28.126865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:28.126865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:28.126865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:29:28.126865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:28.132760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 431/862] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jul 6 20:29:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:28.132760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e1aad-6ba0-410f-97d5-ad4a78b84f33 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:28.150570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952eb98-94b1-4b05-9a07-7bef240ca30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:28.151371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952eb98-94b1-4b05-9a07-7bef240ca30f None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:28.151738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952eb98-94b1-4b05-9a07-7bef240ca30f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:28.152027 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952eb98-94b1-4b05-9a07-7bef240ca30f None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:28.152858 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952eb98-94b1-4b05-9a07-7bef240ca30f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:28.154306 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952eb98-94b1-4b05-9a07-7bef240ca30f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:28.168086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 432/863] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:29:27 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:28.180377 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952eb98-94b1-4b05-9a07-7bef240ca30f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:28.247539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e1aad-6ba0-410f-97d5-ad4a78b84f33 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:28.301758 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a10ee-8c5a-4fc0-96ac-df3d982d74da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:28.302626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a10ee-8c5a-4fc0-96ac-df3d982d74da None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:28.302909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a10ee-8c5a-4fc0-96ac-df3d982d74da None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:28.303200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a10ee-8c5a-4fc0-96ac-df3d982d74da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:28.310593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a10ee-8c5a-4fc0-96ac-df3d982d74da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:28.312745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a10ee-8c5a-4fc0-96ac-df3d982d74da None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:28.317508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952eb98-94b1-4b05-9a07-7bef240ca30f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f84a10ee-8c5a-4fc0-96ac-df3d982d74da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:28.327699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:28.328643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:28.329514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:28.329514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:28.329514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:28.329514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:28.329514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:28.329514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:28.329514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:28.329514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:28.329514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 432/864] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:28.331012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f297e3-08c9-4a6a-9c41-952506889626 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:28.331324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f297e3-08c9-4a6a-9c41-952506889626 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:28.331596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f297e3-08c9-4a6a-9c41-952506889626 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:28.333000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 433/865] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:28.334465 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f297e3-08c9-4a6a-9c41-952506889626 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:28.367020 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd0526-8acb-4b65-a13c-58d66b068088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:28.367732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0526-8acb-4b65-a13c-58d66b068088 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:28.368015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0526-8acb-4b65-a13c-58d66b068088 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:28.368299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0526-8acb-4b65-a13c-58d66b068088 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:28.369133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd0526-8acb-4b65-a13c-58d66b068088 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:28.369445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd0526-8acb-4b65-a13c-58d66b068088 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:28.370873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd0526-8acb-4b65-a13c-58d66b068088 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:28.388945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 433/866] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Jul 6 20:29:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:28.391073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ab46e-2273-4421-8049-789d34bcd9e6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:28.391418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ab46e-2273-4421-8049-789d34bcd9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:28.391697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ab46e-2273-4421-8049-789d34bcd9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:28.397135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:28.408337 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-113ab46e-2273-4421-8049-789d34bcd9e6 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:28.409524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-113ab46e-2273-4421-8049-789d34bcd9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:28.424143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:28.458605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f297e3-08c9-4a6a-9c41-952506889626 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:28.480967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 434/867] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:28 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:28.489299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ab46e-2273-4421-8049-789d34bcd9e6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:28.494532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57479a15-5728-4f9f-915e-af573b278ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:28.495393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57479a15-5728-4f9f-915e-af573b278ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:28.495869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57479a15-5728-4f9f-915e-af573b278ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:28.496302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57479a15-5728-4f9f-915e-af573b278ee8 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:28.497217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57479a15-5728-4f9f-915e-af573b278ee8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:28.497708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57479a15-5728-4f9f-915e-af573b278ee8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:28.499652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57479a15-5728-4f9f-915e-af573b278ee8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:28.512622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 434/868] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:28.513731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57479a15-5728-4f9f-915e-af573b278ee8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:28.610508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ab46e-2273-4421-8049-789d34bcd9e6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:28.624388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57479a15-5728-4f9f-915e-af573b278ee8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:28.633897 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:28.648636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead45f0b-d8b6-4eae-a603-c42b99faf3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:28.649291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead45f0b-d8b6-4eae-a603-c42b99faf3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:28.649574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead45f0b-d8b6-4eae-a603-c42b99faf3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:28.649853 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead45f0b-d8b6-4eae-a603-c42b99faf3c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:28.661518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c14aef-7d6f-46d2-bab4-b7fa24cbf404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:28.662183 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c14aef-7d6f-46d2-bab4-b7fa24cbf404 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:28.662690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c14aef-7d6f-46d2-bab4-b7fa24cbf404 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:28.662812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c14aef-7d6f-46d2-bab4-b7fa24cbf404 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:28.663975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c14aef-7d6f-46d2-bab4-b7fa24cbf404 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:28.664815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c14aef-7d6f-46d2-bab4-b7fa24cbf404 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:28.678025 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:28.688402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 435/869] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:29:28 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:28.688402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c14aef-7d6f-46d2-bab4-b7fa24cbf404 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:28.768717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead45f0b-d8b6-4eae-a603-c42b99faf3c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:28.770591 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead45f0b-d8b6-4eae-a603-c42b99faf3c6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:28.812699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c14aef-7d6f-46d2-bab4-b7fa24cbf404 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:28.854502 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb3aa6-5339-4140-b7d0-3dd7f4848891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:28.855528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb3aa6-5339-4140-b7d0-3dd7f4848891 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:28.855996 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb3aa6-5339-4140-b7d0-3dd7f4848891 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:28.856466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb3aa6-5339-4140-b7d0-3dd7f4848891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:28.857412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb3aa6-5339-4140-b7d0-3dd7f4848891 None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=88dff378ccb4497fb305563614ea4caa) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:28.857861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb3aa6-5339-4140-b7d0-3dd7f4848891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:28.859525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb3aa6-5339-4140-b7d0-3dd7f4848891 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:28.866416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 436/870] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:28 2022] GET /identity/v3/role_assignments?user.id=88dff378ccb4497fb305563614ea4caa&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:28.906728 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 435/871] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:28 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:29:28.912333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb3aa6-5339-4140-b7d0-3dd7f4848891 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:28.945565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:29.027148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb3aa6-5339-4140-b7d0-3dd7f4848891 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:29.062548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312d46-50a8-4f1b-b783-6201b156006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:29.063419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312d46-50a8-4f1b-b783-6201b156006f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:29.063707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312d46-50a8-4f1b-b783-6201b156006f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:29.063985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312d46-50a8-4f1b-b783-6201b156006f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:29.075102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67312d46-50a8-4f1b-b783-6201b156006f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:29.077102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67312d46-50a8-4f1b-b783-6201b156006f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-67312d46-50a8-4f1b-b783-6201b156006f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:29.095452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:29.096368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:29.097667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:29.097667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:29.097667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:29.097667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:29.097667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 437/872] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:29.102464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead45f0b-d8b6-4eae-a603-c42b99faf3c6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:29.154650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:29.208503 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead45f0b-d8b6-4eae-a603-c42b99faf3c6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:29.243829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272f8e5-b67d-42db-b69e-ea6be07a0540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:29.244868 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272f8e5-b67d-42db-b69e-ea6be07a0540 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:29.245373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272f8e5-b67d-42db-b69e-ea6be07a0540 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:29.245845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272f8e5-b67d-42db-b69e-ea6be07a0540 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:29.246761 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272f8e5-b67d-42db-b69e-ea6be07a0540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:29.247307 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272f8e5-b67d-42db-b69e-ea6be07a0540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:29.249480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272f8e5-b67d-42db-b69e-ea6be07a0540 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:29.261464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 436/873] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:29.271200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312d46-50a8-4f1b-b783-6201b156006f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:29.356337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:29.377369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312d46-50a8-4f1b-b783-6201b156006f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:29.414940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9812a3-67fa-46ad-be72-5f049b2b75c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:29.415775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9812a3-67fa-46ad-be72-5f049b2b75c0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:29.416062 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9812a3-67fa-46ad-be72-5f049b2b75c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:29.416342 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9812a3-67fa-46ad-be72-5f049b2b75c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:29.423442 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9812a3-67fa-46ad-be72-5f049b2b75c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:29.424903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9812a3-67fa-46ad-be72-5f049b2b75c0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-cb9812a3-67fa-46ad-be72-5f049b2b75c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:29.440166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:29.441067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:29.442358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:29.442358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:29.442358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:29.442358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:29.442358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:29.442358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:29.442358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:29.442358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:29.442358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 438/874] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:29.447310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272f8e5-b67d-42db-b69e-ea6be07a0540 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:29.558156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272f8e5-b67d-42db-b69e-ea6be07a0540 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:29.569968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:29.603202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91485a6-aa8d-4429-80fe-03787efcf15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:29.603202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91485a6-aa8d-4429-80fe-03787efcf15d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:29.603202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91485a6-aa8d-4429-80fe-03787efcf15d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:29.603202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91485a6-aa8d-4429-80fe-03787efcf15d None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:29.603570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91485a6-aa8d-4429-80fe-03787efcf15d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:29.603570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91485a6-aa8d-4429-80fe-03787efcf15d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:29.604527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91485a6-aa8d-4429-80fe-03787efcf15d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:29.617390 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 437/875] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:29.623195 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9812a3-67fa-46ad-be72-5f049b2b75c0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:29.728238 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9812a3-67fa-46ad-be72-5f049b2b75c0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:29.762868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c9b98-acd6-425a-bd2f-daed915e2a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:29.763551 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9b98-acd6-425a-bd2f-daed915e2a86 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:29.763836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9b98-acd6-425a-bd2f-daed915e2a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:29.764115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9b98-acd6-425a-bd2f-daed915e2a86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:29.765019 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c9b98-acd6-425a-bd2f-daed915e2a86 None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=e1c9cdf941294b4190245ed43d219ef6) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:29.765338 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c9b98-acd6-425a-bd2f-daed915e2a86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:29.766770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c9b98-acd6-425a-bd2f-daed915e2a86 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:29.773343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 439/876] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:29 2022] GET /identity/v3/role_assignments?user.id=e1c9cdf941294b4190245ed43d219ef6&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:30.306148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa55d7-ed9d-4f39-a330-2fc1a29e2eb0 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:30.306656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa55d7-ed9d-4f39-a330-2fc1a29e2eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:30.306759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa55d7-ed9d-4f39-a330-2fc1a29e2eb0 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:30.308353 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 438/877] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:30.313981 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd5984-5019-4707-a6e7-b95c7c145f07 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:30.314388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd5984-5019-4707-a6e7-b95c7c145f07 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:30.314554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd5984-5019-4707-a6e7-b95c7c145f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:30.320606 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:30.336781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f5bd5984-5019-4707-a6e7-b95c7c145f07 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:30.338236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f5bd5984-5019-4707-a6e7-b95c7c145f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:30.414022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 440/878] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:30.436945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa55d7-ed9d-4f39-a330-2fc1a29e2eb0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:30.547384 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa55d7-ed9d-4f39-a330-2fc1a29e2eb0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:30.586585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb185f-10c5-4981-a4d3-cbb87cccc328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:30.586585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb185f-10c5-4981-a4d3-cbb87cccc328 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:30.586585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb185f-10c5-4981-a4d3-cbb87cccc328 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:30.586585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb185f-10c5-4981-a4d3-cbb87cccc328 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:30.587363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb185f-10c5-4981-a4d3-cbb87cccc328 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:30.587363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb185f-10c5-4981-a4d3-cbb87cccc328 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-40cb185f-10c5-4981-a4d3-cbb87cccc328 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:30.601736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:30.603085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:30.603981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 439/879] 10.222.0.33 () {56 vars in 1132 bytes} [Wed Jul 6 20:29:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:30.607395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd5984-5019-4707-a6e7-b95c7c145f07 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:30.720202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd5984-5019-4707-a6e7-b95c7c145f07 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:30.756338 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901a51d-bd8b-44be-ade0-e3316ec3abfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:30.757013 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901a51d-bd8b-44be-ade0-e3316ec3abfb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:30.757302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901a51d-bd8b-44be-ade0-e3316ec3abfb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:30.757581 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901a51d-bd8b-44be-ade0-e3316ec3abfb None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:30.758286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901a51d-bd8b-44be-ade0-e3316ec3abfb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:30.758598 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901a51d-bd8b-44be-ade0-e3316ec3abfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:30.760001 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901a51d-bd8b-44be-ade0-e3316ec3abfb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:30.761018 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:30.766074 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 441/880] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jul 6 20:29:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:30.771829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb185f-10c5-4981-a4d3-cbb87cccc328 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:30.812093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:30.881411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb185f-10c5-4981-a4d3-cbb87cccc328 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:30.906787 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d1485-cb42-4a5b-b710-e68e0c7a5c87 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:30.907120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d1485-cb42-4a5b-b710-e68e0c7a5c87 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:30.907419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d1485-cb42-4a5b-b710-e68e0c7a5c87 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:30.909146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 442/881] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:30.914758 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0a76-7deb-4110-8cca-e061bcf90756 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:30.915120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0a76-7deb-4110-8cca-e061bcf90756 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:30.915545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0a76-7deb-4110-8cca-e061bcf90756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:30.918023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be7826-99bd-4ed9-9836-0c17d1e62aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:30.918876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7826-99bd-4ed9-9836-0c17d1e62aba None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:30.919161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7826-99bd-4ed9-9836-0c17d1e62aba None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:30.919472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7826-99bd-4ed9-9836-0c17d1e62aba None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:30.920291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be7826-99bd-4ed9-9836-0c17d1e62aba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:30.920661 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be7826-99bd-4ed9-9836-0c17d1e62aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:30.923307 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be7826-99bd-4ed9-9836-0c17d1e62aba None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:30.932915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 440/882] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jul 6 20:29:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:30.939114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7b4a0a76-7deb-4110-8cca-e061bcf90756 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:30.939114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7b4a0a76-7deb-4110-8cca-e061bcf90756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:30.939367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be7826-99bd-4ed9-9836-0c17d1e62aba None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:31.028792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 443/883] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:31.047624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2ec49-499c-4412-b040-1b05d5226380 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.047927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2ec49-499c-4412-b040-1b05d5226380 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.048187 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2ec49-499c-4412-b040-1b05d5226380 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.049607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 444/884] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:29:31.050306 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2ec49-499c-4412-b040-1b05d5226380 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:31.058410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:31.063260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be7826-99bd-4ed9-9836-0c17d1e62aba None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:31.100215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d81553-37bc-4e2a-b70e-2552134df64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:31.100871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81553-37bc-4e2a-b70e-2552134df64a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.101159 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81553-37bc-4e2a-b70e-2552134df64a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.101436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81553-37bc-4e2a-b70e-2552134df64a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.102231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d81553-37bc-4e2a-b70e-2552134df64a None admin] RBAC: Adding query filter params (interface=public, service_id=7157302c5fb8452289fae863714ae397, region_id=RegionOne) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:31.102536 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d81553-37bc-4e2a-b70e-2552134df64a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:31.103932 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d81553-37bc-4e2a-b70e-2552134df64a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:31.111225 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 441/885] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jul 6 20:29:30 2022] GET /identity/v3/endpoints?service_id=7157302c5fb8452289fae863714ae397&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:31.111225 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857885d-7fee-493f-8cf5-6e30206dbcb1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.111225 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857885d-7fee-493f-8cf5-6e30206dbcb1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.111225 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857885d-7fee-493f-8cf5-6e30206dbcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.133800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f857885d-7fee-493f-8cf5-6e30206dbcb1 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:31.135299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f857885d-7fee-493f-8cf5-6e30206dbcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:31.163345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2ec49-499c-4412-b040-1b05d5226380 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:31.192837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:31.201365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d495f51-7c95-4115-98bb-fe11393c5017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:31.202783 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d495f51-7c95-4115-98bb-fe11393c5017 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.203146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d495f51-7c95-4115-98bb-fe11393c5017 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.203471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d495f51-7c95-4115-98bb-fe11393c5017 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.204104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d495f51-7c95-4115-98bb-fe11393c5017 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:31.205479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d495f51-7c95-4115-98bb-fe11393c5017 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:31.217207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 442/886] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:31.217207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857885d-7fee-493f-8cf5-6e30206dbcb1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9d495f51-7c95-4115-98bb-fe11393c5017 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:31.220577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:31.221645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:31.222656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 445/887] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:29:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:31.232080 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d495f51-7c95-4115-98bb-fe11393c5017 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:31.324886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:31.336104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857885d-7fee-493f-8cf5-6e30206dbcb1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:31.339058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d495f51-7c95-4115-98bb-fe11393c5017 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:31.372525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91d5df-9dab-4d65-95ad-d4b3ec74a743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:31.373193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91d5df-9dab-4d65-95ad-d4b3ec74a743 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.373478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91d5df-9dab-4d65-95ad-d4b3ec74a743 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.373796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91d5df-9dab-4d65-95ad-d4b3ec74a743 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.374504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91d5df-9dab-4d65-95ad-d4b3ec74a743 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:31.374814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91d5df-9dab-4d65-95ad-d4b3ec74a743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:31.375502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb7db8-1d3c-4688-9556-2d9fe0093cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:31.376222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91d5df-9dab-4d65-95ad-d4b3ec74a743 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:31.376479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb7db8-1d3c-4688-9556-2d9fe0093cdc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.376907 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb7db8-1d3c-4688-9556-2d9fe0093cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.377409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb7db8-1d3c-4688-9556-2d9fe0093cdc None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.378349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb7db8-1d3c-4688-9556-2d9fe0093cdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:31.379879 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb7db8-1d3c-4688-9556-2d9fe0093cdc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:31.380776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 446/888] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:29:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:31.381548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91d5df-9dab-4d65-95ad-d4b3ec74a743 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:31.391528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 443/889] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jul 6 20:29:31 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:29:31.392532 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb7db8-1d3c-4688-9556-2d9fe0093cdc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:31.461307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:31.520934 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb7db8-1d3c-4688-9556-2d9fe0093cdc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:31.523012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91d5df-9dab-4d65-95ad-d4b3ec74a743 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:31.567459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e7eca-52ed-4242-b3be-1b5bf97b9bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:31.567459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e7eca-52ed-4242-b3be-1b5bf97b9bba None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.567762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e7eca-52ed-4242-b3be-1b5bf97b9bba None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.567980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e7eca-52ed-4242-b3be-1b5bf97b9bba None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.568690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e7eca-52ed-4242-b3be-1b5bf97b9bba None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:31.569001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e7eca-52ed-4242-b3be-1b5bf97b9bba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:31.570364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e7eca-52ed-4242-b3be-1b5bf97b9bba None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:31.578441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 444/890] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:29:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:31.579003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a69f6-4310-41a9-9477-7098a4c59208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:31.579844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a69f6-4310-41a9-9477-7098a4c59208 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.580127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a69f6-4310-41a9-9477-7098a4c59208 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.580398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a69f6-4310-41a9-9477-7098a4c59208 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.581054 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a69f6-4310-41a9-9477-7098a4c59208 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:31.582430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a69f6-4310-41a9-9477-7098a4c59208 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:31.586398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e7eca-52ed-4242-b3be-1b5bf97b9bba None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-6d4a69f6-4310-41a9-9477-7098a4c59208 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:31.600295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:31.601327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:31.602161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 447/891] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jul 6 20:29:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:31.606910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a69f6-4310-41a9-9477-7098a4c59208 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:31.614142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:31.694525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e7eca-52ed-4242-b3be-1b5bf97b9bba None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:31.714727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a69f6-4310-41a9-9477-7098a4c59208 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:31.730248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e5ecc-10ce-4d71-a72c-7000df1ecb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:31.730910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e5ecc-10ce-4d71-a72c-7000df1ecb8d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.731214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e5ecc-10ce-4d71-a72c-7000df1ecb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.731501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e5ecc-10ce-4d71-a72c-7000df1ecb8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.732287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e5ecc-10ce-4d71-a72c-7000df1ecb8d None admin] RBAC: Adding query filter params (interface=public, service_id=9db6178389734af79ee9428264b1e4f2, region_id=RegionOne) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:31.732603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e5ecc-10ce-4d71-a72c-7000df1ecb8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:31.734025 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e5ecc-10ce-4d71-a72c-7000df1ecb8d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:31.737206 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:31.739640 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 445/892] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jul 6 20:29:31 2022] GET /identity/v3/endpoints?service_id=9db6178389734af79ee9428264b1e4f2&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:31.744995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e5ecc-10ce-4d71-a72c-7000df1ecb8d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:31.752696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a08864-7f6b-4a65-b3e2-184db278262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:31.753498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a08864-7f6b-4a65-b3e2-184db278262b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.753928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a08864-7f6b-4a65-b3e2-184db278262b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.754360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a08864-7f6b-4a65-b3e2-184db278262b None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.755186 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a08864-7f6b-4a65-b3e2-184db278262b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:31.755600 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a08864-7f6b-4a65-b3e2-184db278262b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:31.757210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a08864-7f6b-4a65-b3e2-184db278262b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:31.762928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 448/893] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jul 6 20:29:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:31.769354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a08864-7f6b-4a65-b3e2-184db278262b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:31.836830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:31.862852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e5ecc-10ce-4d71-a72c-7000df1ecb8d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:31.886676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a08864-7f6b-4a65-b3e2-184db278262b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:31.910592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109005fe-1234-4aff-9847-030fb39974bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:31.911294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109005fe-1234-4aff-9847-030fb39974bb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.911579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109005fe-1234-4aff-9847-030fb39974bb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.911859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109005fe-1234-4aff-9847-030fb39974bb None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.912535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109005fe-1234-4aff-9847-030fb39974bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:31.913897 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109005fe-1234-4aff-9847-030fb39974bb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:31.927209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 446/894] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jul 6 20:29:31 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:29:31.927209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19c292-44a7-4310-b1ff-f3477bb21a3e None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.927209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19c292-44a7-4310-b1ff-f3477bb21a3e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.927209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19c292-44a7-4310-b1ff-f3477bb21a3e None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.927209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 447/895] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:31.929638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6089a9-e4d9-4f55-b958-f31993744863 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.929927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6089a9-e4d9-4f55-b958-f31993744863 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.930205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6089a9-e4d9-4f55-b958-f31993744863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.930868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1070ef-6a93-41bd-baf4-0839f8df0c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:31.931610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1070ef-6a93-41bd-baf4-0839f8df0c2b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:31.931892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1070ef-6a93-41bd-baf4-0839f8df0c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:31.932202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1070ef-6a93-41bd-baf4-0839f8df0c2b None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:31.932877 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1070ef-6a93-41bd-baf4-0839f8df0c2b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:31.933183 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1070ef-6a93-41bd-baf4-0839f8df0c2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:31.934583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1070ef-6a93-41bd-baf4-0839f8df0c2b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:31.941681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 449/896] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jul 6 20:29:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:31.950729 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1e6089a9-e4d9-4f55-b958-f31993744863 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:31.953079 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1e6089a9-e4d9-4f55-b958-f31993744863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:32.042900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 448/897] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:32.073192 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1070ef-6a93-41bd-baf4-0839f8df0c2b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:32.132116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:32.186236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1070ef-6a93-41bd-baf4-0839f8df0c2b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:32.221560 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a0676-eaf1-4602-a592-bf318da2fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:32.222346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a0676-eaf1-4602-a592-bf318da2fad3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:32.222684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a0676-eaf1-4602-a592-bf318da2fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:32.222967 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a0676-eaf1-4602-a592-bf318da2fad3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:32.234041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a0676-eaf1-4602-a592-bf318da2fad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5e1a0676-eaf1-4602-a592-bf318da2fad3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:32.242487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:32.243459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:32.244274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:32.244274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:32.244274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:32.244274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:32.244274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:32.244274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:32.244274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:32.244274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:32.244274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:32.244274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:32.244274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:29:32.244274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:32.244274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 450/898] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Jul 6 20:29:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:32.251735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6089a9-e4d9-4f55-b958-f31993744863 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:32.334017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:32.360280 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6089a9-e4d9-4f55-b958-f31993744863 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:32.397789 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4e10c-cc6d-4515-a5ae-ee0220a46ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:32.398797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4e10c-cc6d-4515-a5ae-ee0220a46ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:32.399336 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4e10c-cc6d-4515-a5ae-ee0220a46ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:32.399808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4e10c-cc6d-4515-a5ae-ee0220a46ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:32.400734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4e10c-cc6d-4515-a5ae-ee0220a46ec0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:32.401234 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4e10c-cc6d-4515-a5ae-ee0220a46ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:32.402850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4e10c-cc6d-4515-a5ae-ee0220a46ec0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:32.411652 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 449/899] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jul 6 20:29:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:32.417472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a0676-eaf1-4602-a592-bf318da2fad3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:32.532880 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a0676-eaf1-4602-a592-bf318da2fad3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:32.542764 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:32.570887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cdfcc-3339-49a9-8f86-ca454b4a0a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:32.571770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cdfcc-3339-49a9-8f86-ca454b4a0a6b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:32.572057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cdfcc-3339-49a9-8f86-ca454b4a0a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:32.572335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cdfcc-3339-49a9-8f86-ca454b4a0a6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:32.584844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cdfcc-3339-49a9-8f86-ca454b4a0a6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:32.586398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cdfcc-3339-49a9-8f86-ca454b4a0a6b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-768cdfcc-3339-49a9-8f86-ca454b4a0a6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:32.610147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:32.611159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:32.612089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:32.612089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:32.612089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:32.612089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:32.612089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 451/900] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:32.618336 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4e10c-cc6d-4515-a5ae-ee0220a46ec0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:32.762934 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4e10c-cc6d-4515-a5ae-ee0220a46ec0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:32.806724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa8c79-283a-4445-803f-55eae807969a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:32.807485 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa8c79-283a-4445-803f-55eae807969a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:32.807769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa8c79-283a-4445-803f-55eae807969a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:32.808044 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa8c79-283a-4445-803f-55eae807969a None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:32.809311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa8c79-283a-4445-803f-55eae807969a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:32.809756 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa8c79-283a-4445-803f-55eae807969a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:32.812202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa8c79-283a-4445-803f-55eae807969a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:32.825265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:32.836572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 450/901] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:32.839671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cdfcc-3339-49a9-8f86-ca454b4a0a6b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:32.957089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cdfcc-3339-49a9-8f86-ca454b4a0a6b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:32.995739 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c815ddc-bc10-4dc9-b0fb-f20ccd74654f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:32.996984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c815ddc-bc10-4dc9-b0fb-f20ccd74654f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:32.997466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c815ddc-bc10-4dc9-b0fb-f20ccd74654f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:32.997963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c815ddc-bc10-4dc9-b0fb-f20ccd74654f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:33.010983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c815ddc-bc10-4dc9-b0fb-f20ccd74654f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:33.012871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c815ddc-bc10-4dc9-b0fb-f20ccd74654f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0c815ddc-bc10-4dc9-b0fb-f20ccd74654f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:33.031718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:33.033210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:33.034832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:33.034832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:33.034832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:33.034832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:33.034832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:33.034832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:33.034832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:33.034832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:33.034832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:29:33.034832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:33.038119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 452/902] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jul 6 20:29:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:33.048625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa8c79-283a-4445-803f-55eae807969a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:33.180818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa8c79-283a-4445-803f-55eae807969a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:33.221315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d861f-367a-481d-9c34-e490ef82ee44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:33.222051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d861f-367a-481d-9c34-e490ef82ee44 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:33.222339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d861f-367a-481d-9c34-e490ef82ee44 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:33.222615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d861f-367a-481d-9c34-e490ef82ee44 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:33.223497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d861f-367a-481d-9c34-e490ef82ee44 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:33.223807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d861f-367a-481d-9c34-e490ef82ee44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:33.225722 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d861f-367a-481d-9c34-e490ef82ee44 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:33.248705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 451/903] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Jul 6 20:29:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:33.255682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c815ddc-bc10-4dc9-b0fb-f20ccd74654f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:33.282613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:33.400091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c815ddc-bc10-4dc9-b0fb-f20ccd74654f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:33.446500 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14275e44-7fc4-4626-9764-29506f2836e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:33.447999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14275e44-7fc4-4626-9764-29506f2836e5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:33.448496 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14275e44-7fc4-4626-9764-29506f2836e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:33.448964 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14275e44-7fc4-4626-9764-29506f2836e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:33.519702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14275e44-7fc4-4626-9764-29506f2836e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:33.521749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14275e44-7fc4-4626-9764-29506f2836e5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:33.543111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:33.628583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 453/904] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:33 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:29:33.634107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d861f-367a-481d-9c34-e490ef82ee44 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:33.699741 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:33.745228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d861f-367a-481d-9c34-e490ef82ee44 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:33.761742 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cbc6d-bc39-4688-8f4f-5447e6f428cb None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:33.762073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cbc6d-bc39-4688-8f4f-5447e6f428cb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:33.762303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cbc6d-bc39-4688-8f4f-5447e6f428cb None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:33.763965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 454/905] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:33.769223 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec586d2-7615-48b8-8aa2-712c6501b520 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:33.769507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec586d2-7615-48b8-8aa2-712c6501b520 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:33.769779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec586d2-7615-48b8-8aa2-712c6501b520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:33.783695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05f080-fd9d-4a45-93d9-80c249c4927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:33.784504 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05f080-fd9d-4a45-93d9-80c249c4927a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:33.784789 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05f080-fd9d-4a45-93d9-80c249c4927a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:33.785067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05f080-fd9d-4a45-93d9-80c249c4927a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:33.789869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4ec586d2-7615-48b8-8aa2-712c6501b520 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:33.791055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4ec586d2-7615-48b8-8aa2-712c6501b520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:33.800282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05f080-fd9d-4a45-93d9-80c249c4927a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:33.802375 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05f080-fd9d-4a45-93d9-80c249c4927a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-fb05f080-fd9d-4a45-93d9-80c249c4927a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:33.826918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:33.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:33.829676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:33.829676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:33.829676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:33.829676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:33.829676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 452/906] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:33.833760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05f080-fd9d-4a45-93d9-80c249c4927a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:33.866197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 455/907] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:33.892809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec586d2-7615-48b8-8aa2-712c6501b520 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:33.956257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05f080-fd9d-4a45-93d9-80c249c4927a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:33.956444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:33.969441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:33.996898 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7b7b8-22f7-4672-b944-42eeb914be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:33.997714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7b7b8-22f7-4672-b944-42eeb914be63 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:33.998109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7b7b8-22f7-4672-b944-42eeb914be63 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:33.998512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7b7b8-22f7-4672-b944-42eeb914be63 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:33.999909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7b7b8-22f7-4672-b944-42eeb914be63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:34.000321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7b7b8-22f7-4672-b944-42eeb914be63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:34.001816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7b7b8-22f7-4672-b944-42eeb914be63 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:34.014142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 453/908] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:34.019009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec586d2-7615-48b8-8aa2-712c6501b520 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:34.020044 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7b7b8-22f7-4672-b944-42eeb914be63 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:34.065886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e503105-cb0a-4109-8025-c0eb6e2d2719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:34.066828 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e503105-cb0a-4109-8025-c0eb6e2d2719 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:34.067113 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e503105-cb0a-4109-8025-c0eb6e2d2719 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:34.067447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e503105-cb0a-4109-8025-c0eb6e2d2719 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:34.068227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e503105-cb0a-4109-8025-c0eb6e2d2719 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:34.070401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e503105-cb0a-4109-8025-c0eb6e2d2719 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9e503105-cb0a-4109-8025-c0eb6e2d2719 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:34.086403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:34.088310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 20:29:34.089340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:34.092568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 456/909] 10.222.0.33 () {56 vars in 1132 bytes} [Wed Jul 6 20:29:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:34.093556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e503105-cb0a-4109-8025-c0eb6e2d2719 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:34.158290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7b7b8-22f7-4672-b944-42eeb914be63 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:34.202700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad556a-98ad-406b-84fe-0b16e0dd3a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:34.203670 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad556a-98ad-406b-84fe-0b16e0dd3a3a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:34.203954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad556a-98ad-406b-84fe-0b16e0dd3a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:34.204272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad556a-98ad-406b-84fe-0b16e0dd3a3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:34.213150 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad556a-98ad-406b-84fe-0b16e0dd3a3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:34.215086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad556a-98ad-406b-84fe-0b16e0dd3a3a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:34.226314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e503105-cb0a-4109-8025-c0eb6e2d2719 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-5cad556a-98ad-406b-84fe-0b16e0dd3a3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:34.232566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:34.233617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:34.234517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:34.234517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:34.234517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:34.234517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:34.234517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:34.234517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:34.234517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:34.234517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:34.238737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 454/910] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:34.240480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f7251-2812-45bf-a829-5d26fcc3e79c None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:34.240765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f7251-2812-45bf-a829-5d26fcc3e79c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:34.241043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f7251-2812-45bf-a829-5d26fcc3e79c None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:34.241792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:34.242331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 455/911] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:34.243091 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f7251-2812-45bf-a829-5d26fcc3e79c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:34.266883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c99b8b-2172-4f87-bd48-d7989c625436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:34.267577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c99b8b-2172-4f87-bd48-d7989c625436 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:34.267863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c99b8b-2172-4f87-bd48-d7989c625436 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:34.268138 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c99b8b-2172-4f87-bd48-d7989c625436 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:34.268841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c99b8b-2172-4f87-bd48-d7989c625436 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:34.269149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c99b8b-2172-4f87-bd48-d7989c625436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:34.270775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c99b8b-2172-4f87-bd48-d7989c625436 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:34.273209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:34.276144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 457/912] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jul 6 20:29:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:34.277335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3076958-8420-4122-a1c9-fb22d6100f06 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:34.277621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3076958-8420-4122-a1c9-fb22d6100f06 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:34.277897 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3076958-8420-4122-a1c9-fb22d6100f06 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:34.279117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 458/913] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:34.283348 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a7900-7a9f-4dd1-8f03-fd74a65f4b08 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:34.283348 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a7900-7a9f-4dd1-8f03-fd74a65f4b08 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:34.283348 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a7900-7a9f-4dd1-8f03-fd74a65f4b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:34.298117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0a1a7900-7a9f-4dd1-8f03-fd74a65f4b08 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:34.299347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0a1a7900-7a9f-4dd1-8f03-fd74a65f4b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:34.353207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f7251-2812-45bf-a829-5d26fcc3e79c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:34.367714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 459/914] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:34.368548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a7900-7a9f-4dd1-8f03-fd74a65f4b08 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:34.388234 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b648304-4fea-42d1-9111-60a6817c2aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:34.389226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b648304-4fea-42d1-9111-60a6817c2aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:34.389332 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b648304-4fea-42d1-9111-60a6817c2aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:34.390174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b648304-4fea-42d1-9111-60a6817c2aa2 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:34.390953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b648304-4fea-42d1-9111-60a6817c2aa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:34.391292 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b648304-4fea-42d1-9111-60a6817c2aa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:34.392716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b648304-4fea-42d1-9111-60a6817c2aa2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:34.404674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 456/915] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:34.406474 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e79302-b1e3-4e12-afc4-0a7e87f3fef9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:34.406759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e79302-b1e3-4e12-afc4-0a7e87f3fef9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:34.407035 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e79302-b1e3-4e12-afc4-0a7e87f3fef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:34.422807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-94e79302-b1e3-4e12-afc4-0a7e87f3fef9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:34.424034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-94e79302-b1e3-4e12-afc4-0a7e87f3fef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:34.466322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a7900-7a9f-4dd1-8f03-fd74a65f4b08 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:34.475904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:34.489175 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 457/916] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:34.489982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e79302-b1e3-4e12-afc4-0a7e87f3fef9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:34.503006 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40641b7f-9935-4dba-bfaf-8a4302ea20af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:34.503679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40641b7f-9935-4dba-bfaf-8a4302ea20af None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:34.503964 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40641b7f-9935-4dba-bfaf-8a4302ea20af None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:34.504232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40641b7f-9935-4dba-bfaf-8a4302ea20af None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:34.504938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40641b7f-9935-4dba-bfaf-8a4302ea20af None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:34.505243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40641b7f-9935-4dba-bfaf-8a4302ea20af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:34.506616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40641b7f-9935-4dba-bfaf-8a4302ea20af None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:34.516581 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 460/917] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jul 6 20:29:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:34.516737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:34.516837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40641b7f-9935-4dba-bfaf-8a4302ea20af None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:34.597459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e79302-b1e3-4e12-afc4-0a7e87f3fef9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:34.614429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40641b7f-9935-4dba-bfaf-8a4302ea20af None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:34.632620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd669f-d0e8-4252-adb4-62a1efc459e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:34.633297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd669f-d0e8-4252-adb4-62a1efc459e5 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:34.633563 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd669f-d0e8-4252-adb4-62a1efc459e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:34.633837 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd669f-d0e8-4252-adb4-62a1efc459e5 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:34.634973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd669f-d0e8-4252-adb4-62a1efc459e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:34.636528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd669f-d0e8-4252-adb4-62a1efc459e5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:34.648805 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad13f0-0d01-4e8f-8258-77bd0e8a32cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:34.649459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad13f0-0d01-4e8f-8258-77bd0e8a32cc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:34.649750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad13f0-0d01-4e8f-8258-77bd0e8a32cc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:34.649871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 458/918] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:29:34 2022] POST /identity/v3/services => generated 241 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:34.650027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad13f0-0d01-4e8f-8258-77bd0e8a32cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:34.650568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd669f-d0e8-4252-adb4-62a1efc459e5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:34.650878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad13f0-0d01-4e8f-8258-77bd0e8a32cc None admin] RBAC: Adding query filter params (role.id=f352a777e52940a99a854c673ce45f28, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=e1c9cdf941294b4190245ed43d219ef6) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:34.651162 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad13f0-0d01-4e8f-8258-77bd0e8a32cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:34.652625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad13f0-0d01-4e8f-8258-77bd0e8a32cc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:34.659125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 461/919] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:34 2022] GET /identity/v3/role_assignments?user.id=e1c9cdf941294b4190245ed43d219ef6&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=f352a777e52940a99a854c673ce45f28 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:34.659995 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad13f0-0d01-4e8f-8258-77bd0e8a32cc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:34.748476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:34.768180 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:34.803926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd669f-d0e8-4252-adb4-62a1efc459e5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:34.826433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad13f0-0d01-4e8f-8258-77bd0e8a32cc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:34.852589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bef83-3deb-4da8-9d3c-beca51cd604c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:34.853880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bef83-3deb-4da8-9d3c-beca51cd604c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:34.854164 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bef83-3deb-4da8-9d3c-beca51cd604c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:34.854442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bef83-3deb-4da8-9d3c-beca51cd604c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:34.855099 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bef83-3deb-4da8-9d3c-beca51cd604c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:34.856519 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bef83-3deb-4da8-9d3c-beca51cd604c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-288bef83-3deb-4da8-9d3c-beca51cd604c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:34.869089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:34.870101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:34.871541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 459/920] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:29:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:34.875278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831f85d-ac17-4026-a1c2-52b42529369c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:34.875974 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831f85d-ac17-4026-a1c2-52b42529369c None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:34.876219 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831f85d-ac17-4026-a1c2-52b42529369c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:34.876495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831f85d-ac17-4026-a1c2-52b42529369c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:34.877227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831f85d-ac17-4026-a1c2-52b42529369c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:34.877372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bef83-3deb-4da8-9d3c-beca51cd604c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:34.878597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831f85d-ac17-4026-a1c2-52b42529369c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:34.907354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 462/921] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jul 6 20:29:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:35.001571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bef83-3deb-4da8-9d3c-beca51cd604c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:35.048091 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2441d-aa6c-43b8-b77b-3dbfecaa0e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:35.048774 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2441d-aa6c-43b8-b77b-3dbfecaa0e40 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:35.049058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2441d-aa6c-43b8-b77b-3dbfecaa0e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:35.049336 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2441d-aa6c-43b8-b77b-3dbfecaa0e40 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:35.050051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2441d-aa6c-43b8-b77b-3dbfecaa0e40 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:35.050362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2441d-aa6c-43b8-b77b-3dbfecaa0e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:35.051840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2441d-aa6c-43b8-b77b-3dbfecaa0e40 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:35.054096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:35.057922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 460/922] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:29:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:35.064168 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831f85d-ac17-4026-a1c2-52b42529369c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:35.181986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:35.194410 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831f85d-ac17-4026-a1c2-52b42529369c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:35.234890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10619a81-bdc6-470c-ae3d-0fcfee8e4219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:35.235614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10619a81-bdc6-470c-ae3d-0fcfee8e4219 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:35.235900 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10619a81-bdc6-470c-ae3d-0fcfee8e4219 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:35.236178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10619a81-bdc6-470c-ae3d-0fcfee8e4219 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:35.236895 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10619a81-bdc6-470c-ae3d-0fcfee8e4219 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:35.237207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10619a81-bdc6-470c-ae3d-0fcfee8e4219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:35.238587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10619a81-bdc6-470c-ae3d-0fcfee8e4219 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:35.244276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 463/923] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jul 6 20:29:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:35.252295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2441d-aa6c-43b8-b77b-3dbfecaa0e40 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:35.359541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2441d-aa6c-43b8-b77b-3dbfecaa0e40 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:35.393863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e757607-7ccd-4bf3-a7ea-0d6e763eb93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:35.394527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e757607-7ccd-4bf3-a7ea-0d6e763eb93c None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:35.394806 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e757607-7ccd-4bf3-a7ea-0d6e763eb93c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:35.395137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e757607-7ccd-4bf3-a7ea-0d6e763eb93c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:35.396215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e757607-7ccd-4bf3-a7ea-0d6e763eb93c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:35.397582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e757607-7ccd-4bf3-a7ea-0d6e763eb93c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:35.420199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 461/924] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jul 6 20:29:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:36.774157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721af64-4d78-454d-aa98-e60896197b29 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:36.775007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721af64-4d78-454d-aa98-e60896197b29 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:36.775575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721af64-4d78-454d-aa98-e60896197b29 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:36.777411 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 464/925] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:36.785454 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ad187-6e6c-4603-b1e8-0ee8e5ea1f01 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:36.786340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ad187-6e6c-4603-b1e8-0ee8e5ea1f01 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:36.786824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ad187-6e6c-4603-b1e8-0ee8e5ea1f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:36.804218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-449ad187-6e6c-4603-b1e8-0ee8e5ea1f01 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:36.805677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-449ad187-6e6c-4603-b1e8-0ee8e5ea1f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:36.819943 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee147ad-9a13-4eb1-a4a6-d32bdc66ca92 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:36.820511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee147ad-9a13-4eb1-a4a6-d32bdc66ca92 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:36.820992 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee147ad-9a13-4eb1-a4a6-d32bdc66ca92 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:36.822912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 465/926] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:29:36.828584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731947b-110b-4d7e-a28f-f24a4e5cc9d0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:36.829108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731947b-110b-4d7e-a28f-f24a4e5cc9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:36.829579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731947b-110b-4d7e-a28f-f24a4e5cc9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:36.847856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2731947b-110b-4d7e-a28f-f24a4e5cc9d0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:36.849340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2731947b-110b-4d7e-a28f-f24a4e5cc9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:36.863512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:36.893009 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 462/927] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:36.916407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ad187-6e6c-4603-b1e8-0ee8e5ea1f01 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:36.939327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 466/928] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:36.958439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731947b-110b-4d7e-a28f-f24a4e5cc9d0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:37.024002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ad187-6e6c-4603-b1e8-0ee8e5ea1f01 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:37.051333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:37.060096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd1888-b85b-42ab-9299-acebacee695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:37.060913 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd1888-b85b-42ab-9299-acebacee695f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.061206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd1888-b85b-42ab-9299-acebacee695f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.061483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd1888-b85b-42ab-9299-acebacee695f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.068547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731947b-110b-4d7e-a28f-f24a4e5cc9d0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:37.072870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd1888-b85b-42ab-9299-acebacee695f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-30fd1888-b85b-42ab-9299-acebacee695f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:37.081925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:37.082917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:37.084168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:37.084168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:37.084168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:37.084168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:37.084168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:37.084168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:37.084168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:37.084168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:37.084168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:37.084168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:37.084168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:29:37.084168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:37.084168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 463/929] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Jul 6 20:29:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:37.084908 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b141f-149e-48d8-b357-779c89438323 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.084908 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b141f-149e-48d8-b357-779c89438323 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.084908 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b141f-149e-48d8-b357-779c89438323 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.086284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 464/930] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:37.090112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b141f-149e-48d8-b357-779c89438323 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:37.113288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972a2fc-68ed-4d9c-b9e1-2f4ebc6f822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:37.114282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972a2fc-68ed-4d9c-b9e1-2f4ebc6f822b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.114566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972a2fc-68ed-4d9c-b9e1-2f4ebc6f822b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.114832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972a2fc-68ed-4d9c-b9e1-2f4ebc6f822b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.115683 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972a2fc-68ed-4d9c-b9e1-2f4ebc6f822b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:37.117621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972a2fc-68ed-4d9c-b9e1-2f4ebc6f822b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-3972a2fc-68ed-4d9c-b9e1-2f4ebc6f822b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:37.132399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:37.133498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:37.134345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 467/931] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jul 6 20:29:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:37.135129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b68ef-af67-4c3d-a1d1-8dd88ee3e96f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.135129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b68ef-af67-4c3d-a1d1-8dd88ee3e96f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.136193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b68ef-af67-4c3d-a1d1-8dd88ee3e96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.140826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:37.153229 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-792b68ef-af67-4c3d-a1d1-8dd88ee3e96f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:37.154403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-792b68ef-af67-4c3d-a1d1-8dd88ee3e96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:37.205405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b141f-149e-48d8-b357-779c89438323 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:37.224558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 468/932] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:37.225590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b68ef-af67-4c3d-a1d1-8dd88ee3e96f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:37.243873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb30f41-82be-4d88-90eb-3973c461b01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:37.245015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30f41-82be-4d88-90eb-3973c461b01a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.245302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30f41-82be-4d88-90eb-3973c461b01a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.245579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30f41-82be-4d88-90eb-3973c461b01a None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.246653 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb30f41-82be-4d88-90eb-3973c461b01a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:37.246966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb30f41-82be-4d88-90eb-3973c461b01a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:37.248958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb30f41-82be-4d88-90eb-3973c461b01a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:37.258713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 465/933] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jul 6 20:29:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:37.263769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb30f41-82be-4d88-90eb-3973c461b01a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:37.320377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:37.342139 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b68ef-af67-4c3d-a1d1-8dd88ee3e96f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:37.376003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb30f41-82be-4d88-90eb-3973c461b01a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:37.378223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:37.380406 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304b6b7-0410-4a12-9118-e8aba8d89417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:37.381016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b6b7-0410-4a12-9118-e8aba8d89417 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.381300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b6b7-0410-4a12-9118-e8aba8d89417 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.381569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b6b7-0410-4a12-9118-e8aba8d89417 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.382271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304b6b7-0410-4a12-9118-e8aba8d89417 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:37.382579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304b6b7-0410-4a12-9118-e8aba8d89417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:37.384409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304b6b7-0410-4a12-9118-e8aba8d89417 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:37.391025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 469/934] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jul 6 20:29:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:37.392221 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304b6b7-0410-4a12-9118-e8aba8d89417 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:37.414270 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9ace7-77f5-4f74-a2b7-07e44e5eb4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:37.415354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9ace7-77f5-4f74-a2b7-07e44e5eb4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.415690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9ace7-77f5-4f74-a2b7-07e44e5eb4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.415966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9ace7-77f5-4f74-a2b7-07e44e5eb4e2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.416657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9ace7-77f5-4f74-a2b7-07e44e5eb4e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:37.418074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9ace7-77f5-4f74-a2b7-07e44e5eb4e2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-8dc9ace7-77f5-4f74-a2b7-07e44e5eb4e2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:37.431801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:37.432770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:29:37.433585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:37.435753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 466/935] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:37.436652 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9ace7-77f5-4f74-a2b7-07e44e5eb4e2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:37.510263 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304b6b7-0410-4a12-9118-e8aba8d89417 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:37.545121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87215eaa-c167-46b4-aebe-c8ab613ce89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:37.545914 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87215eaa-c167-46b4-aebe-c8ab613ce89f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.546775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87215eaa-c167-46b4-aebe-c8ab613ce89f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.547473 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87215eaa-c167-46b4-aebe-c8ab613ce89f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.547601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9ace7-77f5-4f74-a2b7-07e44e5eb4e2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:37.557007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87215eaa-c167-46b4-aebe-c8ab613ce89f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:37.558435 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87215eaa-c167-46b4-aebe-c8ab613ce89f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:37.560892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-87215eaa-c167-46b4-aebe-c8ab613ce89f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:37.577136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:37.578230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:37.579120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:37.579120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:37.579120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:37.579120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:37.579394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 470/936] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:37.580021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87215eaa-c167-46b4-aebe-c8ab613ce89f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:37.585649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f02b1-1bb3-4e46-b42b-cd0cc0f8a730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:37.586464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f02b1-1bb3-4e46-b42b-cd0cc0f8a730 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.586782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f02b1-1bb3-4e46-b42b-cd0cc0f8a730 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.587068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f02b1-1bb3-4e46-b42b-cd0cc0f8a730 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.588291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f02b1-1bb3-4e46-b42b-cd0cc0f8a730 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:37.588291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f02b1-1bb3-4e46-b42b-cd0cc0f8a730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:37.589512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f02b1-1bb3-4e46-b42b-cd0cc0f8a730 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:37.595487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 467/937] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jul 6 20:29:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:37.596787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d26c9-40c1-4c95-acde-3130243bccc3 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.597055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d26c9-40c1-4c95-acde-3130243bccc3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.597337 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d26c9-40c1-4c95-acde-3130243bccc3 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.598729 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 468/938] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:37.603200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d26c9-40c1-4c95-acde-3130243bccc3 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:37.635161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:37.690250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87215eaa-c167-46b4-aebe-c8ab613ce89f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:37.707895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d26c9-40c1-4c95-acde-3130243bccc3 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:37.724523 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4287722-b5b9-4a06-a897-27d16bf16401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:37.725181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4287722-b5b9-4a06-a897-27d16bf16401 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.725470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4287722-b5b9-4a06-a897-27d16bf16401 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.725744 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4287722-b5b9-4a06-a897-27d16bf16401 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.726434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4287722-b5b9-4a06-a897-27d16bf16401 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:37.726739 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4287722-b5b9-4a06-a897-27d16bf16401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:37.728137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4287722-b5b9-4a06-a897-27d16bf16401 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:37.733067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 471/939] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jul 6 20:29:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:37.734286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4287722-b5b9-4a06-a897-27d16bf16401 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:37.746766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fe42f-6cbc-455f-8792-7c824b7efc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:37.747467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fe42f-6cbc-455f-8792-7c824b7efc8e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.747754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fe42f-6cbc-455f-8792-7c824b7efc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.748036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fe42f-6cbc-455f-8792-7c824b7efc8e None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.748752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fe42f-6cbc-455f-8792-7c824b7efc8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:37.749062 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fe42f-6cbc-455f-8792-7c824b7efc8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:37.751322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fe42f-6cbc-455f-8792-7c824b7efc8e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:37.762912 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 469/940] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:37.764125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b49828-8c0c-405f-addb-288440d63350 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.764409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b49828-8c0c-405f-addb-288440d63350 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.764866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b49828-8c0c-405f-addb-288440d63350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.781908 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a2b49828-8c0c-405f-addb-288440d63350 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:37.783096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a2b49828-8c0c-405f-addb-288440d63350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:37.794134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:37.834499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4287722-b5b9-4a06-a897-27d16bf16401 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:37.849687 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 470/941] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:37.850521 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b49828-8c0c-405f-addb-288440d63350 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:37.868379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6918566-64b8-431f-b5df-6c2abce31f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:37.869040 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6918566-64b8-431f-b5df-6c2abce31f94 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.869326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6918566-64b8-431f-b5df-6c2abce31f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.869646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6918566-64b8-431f-b5df-6c2abce31f94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.870490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6918566-64b8-431f-b5df-6c2abce31f94 None admin] RBAC: Adding query filter params (interface=public, service_id=2d29bc586ea94a398ae764770bc60ca8, region_id=RegionOne) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:37.870760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6918566-64b8-431f-b5df-6c2abce31f94 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:37.872314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6918566-64b8-431f-b5df-6c2abce31f94 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:37.877578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 472/942] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jul 6 20:29:37 2022] GET /identity/v3/endpoints?service_id=2d29bc586ea94a398ae764770bc60ca8&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:37.879226 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6918566-64b8-431f-b5df-6c2abce31f94 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:37.884435 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:37.963092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b49828-8c0c-405f-addb-288440d63350 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:37.976612 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6918566-64b8-431f-b5df-6c2abce31f94 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:37.997182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196dbfc-8fd5-452f-a3f7-4eef50a232d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:37.997839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196dbfc-8fd5-452f-a3f7-4eef50a232d4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:37.998120 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196dbfc-8fd5-452f-a3f7-4eef50a232d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:37.998395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196dbfc-8fd5-452f-a3f7-4eef50a232d4 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:37.999022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:37.999133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196dbfc-8fd5-452f-a3f7-4eef50a232d4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:37.999518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196dbfc-8fd5-452f-a3f7-4eef50a232d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:38.000830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196dbfc-8fd5-452f-a3f7-4eef50a232d4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:38.005399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 471/943] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jul 6 20:29:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:38.006144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196dbfc-8fd5-452f-a3f7-4eef50a232d4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:38.010388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4d663-c46f-45bb-9aa5-b3be303bbdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:38.011251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4d663-c46f-45bb-9aa5-b3be303bbdeb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:38.011543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4d663-c46f-45bb-9aa5-b3be303bbdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:38.011823 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4d663-c46f-45bb-9aa5-b3be303bbdeb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:38.022045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4d663-c46f-45bb-9aa5-b3be303bbdeb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:38.023592 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4d663-c46f-45bb-9aa5-b3be303bbdeb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-6da4d663-c46f-45bb-9aa5-b3be303bbdeb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:38.040583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:38.041840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:38.048644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:38.048644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:38.048644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:38.048644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:38.048644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:38.048644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:38.048644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:38.048644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:38.048644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:29:38.048644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:38.048644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 473/944] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jul 6 20:29:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:38.048644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4d663-c46f-45bb-9aa5-b3be303bbdeb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:38.119867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:38.139665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196dbfc-8fd5-452f-a3f7-4eef50a232d4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:38.161673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4d663-c46f-45bb-9aa5-b3be303bbdeb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:38.180976 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bb62c-6c3d-46d6-be2c-f167085dc7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:38.181639 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bb62c-6c3d-46d6-be2c-f167085dc7cc None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:38.181920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bb62c-6c3d-46d6-be2c-f167085dc7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:38.182191 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bb62c-6c3d-46d6-be2c-f167085dc7cc None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:38.182893 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bb62c-6c3d-46d6-be2c-f167085dc7cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:38.184374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bb62c-6c3d-46d6-be2c-f167085dc7cc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:38.185741 dv-cinder-848900-2-smb devstack@keystone.service[80523]: WARNING keystone.server.flask.common [None req-5f2bb62c-6c3d-46d6-be2c-f167085dc7cc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 06 20:29:38.198482 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19549213-1a19-4f12-bb03-9fd9fda787f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:38.199151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19549213-1a19-4f12-bb03-9fd9fda787f0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:38.199464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19549213-1a19-4f12-bb03-9fd9fda787f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:38.199743 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19549213-1a19-4f12-bb03-9fd9fda787f0 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:38.200429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19549213-1a19-4f12-bb03-9fd9fda787f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:38.202187 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19549213-1a19-4f12-bb03-9fd9fda787f0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:38.204154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.sql.core [None req-5f2bb62c-6c3d-46d6-be2c-f167085dc7cc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 20:29:38.204154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 06 20:29:38.204154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [parameters: {'id': 'a076ce052b314289948ae292aa9bc916', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 06 20:29:38.204154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80523) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 20:29:38.214432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 474/945] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jul 6 20:29:38 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:29:38.214432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19549213-1a19-4f12-bb03-9fd9fda787f0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:38.214697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-5f2bb62c-6c3d-46d6-be2c-f167085dc7cc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a076ce052b314289948ae292aa9bc916.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a076ce052b314289948ae292aa9bc916. Jul 06 20:29:38.214697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:38.214697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 20:29:38.214697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 20:29:38.214697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 20:29:38.214697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 20:29:38.214697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 20:29:38.214697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 20:29:38.214697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 20:29:38.214697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application conn.query(q) Jul 06 20:29:38.214697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 20:29:38.214697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 20:29:38.214697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result.read() Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 06 20:29:38.218816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application next(self.gen) Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application yield resource Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application next(self.gen) Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise self.value Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application session.commit() Jul 06 20:29:38.220074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.session.flush() Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application compat.raise_( Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 20:29:38.221215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 20:29:38.223392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application conn.query(q) Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result.read() Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 20:29:38.224457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [parameters: {'id': 'a076ce052b314289948ae292aa9bc916', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:38.225539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:38.232142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:38.233246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:38.233246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 06 20:29:38.233246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 06 20:29:38.233246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:38.233246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:38.233246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 06 20:29:38.233246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 06 20:29:38.233246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a076ce052b314289948ae292aa9bc916. Jul 06 20:29:38.233246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:38.233246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 472/946] 10.222.0.33 () {60 vars in 1140 bytes} [Wed Jul 6 20:29:38 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:38.233246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bb62c-6c3d-46d6-be2c-f167085dc7cc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:38.322939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:38.360924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bb62c-6c3d-46d6-be2c-f167085dc7cc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:38.385228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19549213-1a19-4f12-bb03-9fd9fda787f0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:38.404047 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a9b63-9890-45c5-911d-a35fa4bb638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:38.404849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a9b63-9890-45c5-911d-a35fa4bb638b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:38.405137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a9b63-9890-45c5-911d-a35fa4bb638b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:38.405416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a9b63-9890-45c5-911d-a35fa4bb638b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:38.413118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a9b63-9890-45c5-911d-a35fa4bb638b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:38.414761 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a9b63-9890-45c5-911d-a35fa4bb638b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-6a8a9b63-9890-45c5-911d-a35fa4bb638b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:38.429133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:38.430077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:38.430966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:38.430966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:38.430966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:38.430966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:38.430966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:38.430966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:38.430966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:38.430966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:38.431446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c1491-cca6-4512-aa8e-6569deaa1c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:38.431546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 473/947] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:38.431630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c1491-cca6-4512-aa8e-6569deaa1c9b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:38.431630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c1491-cca6-4512-aa8e-6569deaa1c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:38.431630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c1491-cca6-4512-aa8e-6569deaa1c9b None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:38.435720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c1491-cca6-4512-aa8e-6569deaa1c9b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:38.435720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c1491-cca6-4512-aa8e-6569deaa1c9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:38.435720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c1491-cca6-4512-aa8e-6569deaa1c9b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:38.438951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a9b63-9890-45c5-911d-a35fa4bb638b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:38.442782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:38.458558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 475/948] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Jul 6 20:29:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:38.465060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c1491-cca6-4512-aa8e-6569deaa1c9b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:38.570284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a9b63-9890-45c5-911d-a35fa4bb638b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:38.571559 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c1491-cca6-4512-aa8e-6569deaa1c9b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:38.580968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:38.611141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2bd08-07e2-46a8-a936-88a1a2510540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:38.612100 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2bd08-07e2-46a8-a936-88a1a2510540 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:38.612487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2bd08-07e2-46a8-a936-88a1a2510540 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:38.612866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2bd08-07e2-46a8-a936-88a1a2510540 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:38.613828 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2bd08-07e2-46a8-a936-88a1a2510540 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:38.614239 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2bd08-07e2-46a8-a936-88a1a2510540 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:38.616118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2bd08-07e2-46a8-a936-88a1a2510540 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:38.618780 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16ee3f-1b9c-407e-8994-c3aa478c4ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:38.619767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16ee3f-1b9c-407e-8994-c3aa478c4ecb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:38.620203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16ee3f-1b9c-407e-8994-c3aa478c4ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:38.621187 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16ee3f-1b9c-407e-8994-c3aa478c4ecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:38.633510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16ee3f-1b9c-407e-8994-c3aa478c4ecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:38.635471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16ee3f-1b9c-407e-8994-c3aa478c4ecb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:38.646364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 474/949] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jul 6 20:29:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-7e16ee3f-1b9c-407e-8994-c3aa478c4ecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:38.655550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:38.656679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:38.657617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:38.657617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:38.657617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:38.657617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:38.659849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 476/950] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:38.668355 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2bd08-07e2-46a8-a936-88a1a2510540 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:38.737378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:38.783272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2bd08-07e2-46a8-a936-88a1a2510540 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:38.820758 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3c4fc-a178-4221-a46f-f2fb8f3854eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:38.821442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3c4fc-a178-4221-a46f-f2fb8f3854eb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:38.821726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3c4fc-a178-4221-a46f-f2fb8f3854eb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:38.822006 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3c4fc-a178-4221-a46f-f2fb8f3854eb None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:38.822803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3c4fc-a178-4221-a46f-f2fb8f3854eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:38.823118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3c4fc-a178-4221-a46f-f2fb8f3854eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:38.824602 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3c4fc-a178-4221-a46f-f2fb8f3854eb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:38.838001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 475/951] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:38.843990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16ee3f-1b9c-407e-8994-c3aa478c4ecb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:38.948501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16ee3f-1b9c-407e-8994-c3aa478c4ecb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:38.984884 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ff6b1-5d54-48d4-9e29-f9a297e3cc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:38.986067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ff6b1-5d54-48d4-9e29-f9a297e3cc81 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:38.986584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ff6b1-5d54-48d4-9e29-f9a297e3cc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:38.987069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ff6b1-5d54-48d4-9e29-f9a297e3cc81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:38.994657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ff6b1-5d54-48d4-9e29-f9a297e3cc81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:38.996490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ff6b1-5d54-48d4-9e29-f9a297e3cc81 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c92ff6b1-5d54-48d4-9e29-f9a297e3cc81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:39.011630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:39.012553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:39.013427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:39.013427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:39.013427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:39.013427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:39.013427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:39.013427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:39.013427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:39.013427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:39.016271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 477/952] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:39.023216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3c4fc-a178-4221-a46f-f2fb8f3854eb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:39.125009 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3c4fc-a178-4221-a46f-f2fb8f3854eb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:39.149201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:39.162381 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8fa2f-6b27-4fa5-acc0-5ce143bbb3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:39.163053 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8fa2f-6b27-4fa5-acc0-5ce143bbb3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:39.163366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8fa2f-6b27-4fa5-acc0-5ce143bbb3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:39.163642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8fa2f-6b27-4fa5-acc0-5ce143bbb3e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:39.164430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8fa2f-6b27-4fa5-acc0-5ce143bbb3e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:39.164745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8fa2f-6b27-4fa5-acc0-5ce143bbb3e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:39.166165 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8fa2f-6b27-4fa5-acc0-5ce143bbb3e9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:39.179127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 476/953] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:39.184498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ff6b1-5d54-48d4-9e29-f9a297e3cc81 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:39.207765 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:39.298259 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ff6b1-5d54-48d4-9e29-f9a297e3cc81 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:39.333916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a02d78-243b-4e7f-bef8-dd40bf2034f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:39.334867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a02d78-243b-4e7f-bef8-dd40bf2034f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:39.335154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a02d78-243b-4e7f-bef8-dd40bf2034f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:39.335495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a02d78-243b-4e7f-bef8-dd40bf2034f0 None admin] PATH_INFO: `/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/e1c9cdf941294b4190245ed43d219ef6/roles/f352a777e52940a99a854c673ce45f28` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:39.337714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a02d78-243b-4e7f-bef8-dd40bf2034f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8eda6c9cf4b1439eb280b0db35b3bce2, user_id=e1c9cdf941294b4190245ed43d219ef6, role_id=f352a777e52940a99a854c673ce45f28)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:39.339161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a02d78-243b-4e7f-bef8-dd40bf2034f0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:39.354436 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 478/954] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:29:39 2022] PUT /identity/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/e1c9cdf941294b4190245ed43d219ef6/roles/f352a777e52940a99a854c673ce45f28 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:29:40.097682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371a693-98f0-48a8-8ea1-25a9ff9ff953 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:40.098699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371a693-98f0-48a8-8ea1-25a9ff9ff953 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:40.099253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371a693-98f0-48a8-8ea1-25a9ff9ff953 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:40.101068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 477/955] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:40.106327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb387f-f015-4405-b047-1e0f8a06f44e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:40.107108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb387f-f015-4405-b047-1e0f8a06f44e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:40.107611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb387f-f015-4405-b047-1e0f8a06f44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:40.125806 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-23fb387f-f015-4405-b047-1e0f8a06f44e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:40.127317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-23fb387f-f015-4405-b047-1e0f8a06f44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:40.198784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 479/956] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:40.221480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371a693-98f0-48a8-8ea1-25a9ff9ff953 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:40.328529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371a693-98f0-48a8-8ea1-25a9ff9ff953 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:40.363790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbaa9c-b731-46a6-af03-f9b4e5fb1f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:40.364795 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbaa9c-b731-46a6-af03-f9b4e5fb1f18 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:40.365274 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbaa9c-b731-46a6-af03-f9b4e5fb1f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:40.365758 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbaa9c-b731-46a6-af03-f9b4e5fb1f18 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:40.366678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbaa9c-b731-46a6-af03-f9b4e5fb1f18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:40.368350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbaa9c-b731-46a6-af03-f9b4e5fb1f18 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:40.385787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 478/957] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:29:40 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:40.419421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9cb0e-7368-4853-bc31-3b93be2425b2 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:40.419743 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9cb0e-7368-4853-bc31-3b93be2425b2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:40.419994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9cb0e-7368-4853-bc31-3b93be2425b2 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:40.423357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 480/958] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:40.428108 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac015106-bf90-4d54-bfa5-245e855cd30c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:40.428403 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac015106-bf90-4d54-bfa5-245e855cd30c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:40.428687 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac015106-bf90-4d54-bfa5-245e855cd30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:40.447084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ac015106-bf90-4d54-bfa5-245e855cd30c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:40.448697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ac015106-bf90-4d54-bfa5-245e855cd30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:40.496485 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:40.543258 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 479/959] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:40.567296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9cb0e-7368-4853-bc31-3b93be2425b2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:40.579938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:40.684043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9cb0e-7368-4853-bc31-3b93be2425b2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:40.721537 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e1417-3351-43ad-b498-31cc2cec8db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:40.722750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e1417-3351-43ad-b498-31cc2cec8db7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:40.723292 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e1417-3351-43ad-b498-31cc2cec8db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:40.723790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e1417-3351-43ad-b498-31cc2cec8db7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:40.724709 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e1417-3351-43ad-b498-31cc2cec8db7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:40.726422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e1417-3351-43ad-b498-31cc2cec8db7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-d12e1417-3351-43ad-b498-31cc2cec8db7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:40.739181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:40.740356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:40.741270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:40.744263 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 481/960] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jul 6 20:29:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:40.751219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac015106-bf90-4d54-bfa5-245e855cd30c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:40.852876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac015106-bf90-4d54-bfa5-245e855cd30c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:40.869675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc57208-14a2-4327-ba71-3b676fadc3f5 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:40.870000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc57208-14a2-4327-ba71-3b676fadc3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:40.870238 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc57208-14a2-4327-ba71-3b676fadc3f5 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:40.871859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 482/961] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:40.877510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c55c9-114b-403e-9a92-29926d0930bc None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:40.877797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c55c9-114b-403e-9a92-29926d0930bc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:40.878076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c55c9-114b-403e-9a92-29926d0930bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:40.890478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28b487-5f76-4c12-924f-e869f2500d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:40.891524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b487-5f76-4c12-924f-e869f2500d3a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:40.891818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b487-5f76-4c12-924f-e869f2500d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:40.892096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b487-5f76-4c12-924f-e869f2500d3a None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:40.892805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28b487-5f76-4c12-924f-e869f2500d3a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:40.893114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28b487-5f76-4c12-924f-e869f2500d3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:40.894582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28b487-5f76-4c12-924f-e869f2500d3a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:40.894824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-564c55c9-114b-403e-9a92-29926d0930bc None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:40.896052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-564c55c9-114b-403e-9a92-29926d0930bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:40.901363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 480/962] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jul 6 20:29:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:40.907219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28b487-5f76-4c12-924f-e869f2500d3a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:40.975539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 483/963] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:40.976920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:40.995591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c55c9-114b-403e-9a92-29926d0930bc None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:40.997950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:41.039338 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28b487-5f76-4c12-924f-e869f2500d3a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:41.078289 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af3741-a6df-4d51-9f9f-a8006051a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:41.078969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3741-a6df-4d51-9f9f-a8006051a86a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:41.079294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3741-a6df-4d51-9f9f-a8006051a86a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:41.079575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3741-a6df-4d51-9f9f-a8006051a86a None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:41.080286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af3741-a6df-4d51-9f9f-a8006051a86a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:41.080599 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af3741-a6df-4d51-9f9f-a8006051a86a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:41.081973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af3741-a6df-4d51-9f9f-a8006051a86a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:41.091661 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 481/964] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jul 6 20:29:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:41.092751 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af3741-a6df-4d51-9f9f-a8006051a86a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:41.126301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c55c9-114b-403e-9a92-29926d0930bc None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:41.164295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08119bb4-fa27-4960-bda6-51c4dd621213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:41.165361 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119bb4-fa27-4960-bda6-51c4dd621213 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:41.165941 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119bb4-fa27-4960-bda6-51c4dd621213 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:41.166427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08119bb4-fa27-4960-bda6-51c4dd621213 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:41.167434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08119bb4-fa27-4960-bda6-51c4dd621213 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:41.169092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08119bb4-fa27-4960-bda6-51c4dd621213 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:41.170622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: WARNING keystone.server.flask.common [None req-08119bb4-fa27-4960-bda6-51c4dd621213 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 06 20:29:41.185725 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.sql.core [None req-08119bb4-fa27-4960-bda6-51c4dd621213 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 20:29:41.185725 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 06 20:29:41.185725 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [parameters: {'user_id': '8203db91452b4d36a62cafe0d6a8f8d5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 06 20:29:41.185725 dv-cinder-848900-2-smb devstack@keystone.service[80524]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80524) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 20:29:41.194060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:41.200360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af3741-a6df-4d51-9f9f-a8006051a86a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-08119bb4-fa27-4960-bda6-51c4dd621213 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application conn.query(q) Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result.read() Jul 06 20:29:41.207824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 20:29:41.208754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application next(self.gen) Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application yield resource Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application next(self.gen) Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise self.value Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application session.commit() Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 20:29:41.209675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.session.flush() Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application compat.raise_( Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 20:29:41.210582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 20:29:41.211505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application conn.query(q) Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result.read() Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 20:29:41.212346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [parameters: {'user_id': '8203db91452b4d36a62cafe0d6a8f8d5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:41.213159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 06 20:29:41.213948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 06 20:29:41.214864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 06 20:29:41.214864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 06 20:29:41.214864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 20:29:41.214864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 20:29:41.214864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 06 20:29:41.214864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:41.218556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 484/965] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Jul 6 20:29:40 2022] POST /identity/v3/users => generated 160 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:41.227292 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08119bb4-fa27-4960-bda6-51c4dd621213 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:41.243820 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c8e3e-615f-461b-b752-b7b92be3b422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:41.244157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c8e3e-615f-461b-b752-b7b92be3b422 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:41.244444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c8e3e-615f-461b-b752-b7b92be3b422 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:41.244775 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c8e3e-615f-461b-b752-b7b92be3b422 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:41.245534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c8e3e-615f-461b-b752-b7b92be3b422 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:41.247013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c8e3e-615f-461b-b752-b7b92be3b422 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:41.270295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 482/966] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jul 6 20:29:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:41.319726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:41.368937 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08119bb4-fa27-4960-bda6-51c4dd621213 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:41.417829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15639b9d-0c26-4bf9-a5ce-eeb6b3a0127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:41.419024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15639b9d-0c26-4bf9-a5ce-eeb6b3a0127a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:41.419544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15639b9d-0c26-4bf9-a5ce-eeb6b3a0127a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:41.420020 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15639b9d-0c26-4bf9-a5ce-eeb6b3a0127a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:41.429463 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15639b9d-0c26-4bf9-a5ce-eeb6b3a0127a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:41.431479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15639b9d-0c26-4bf9-a5ce-eeb6b3a0127a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-15639b9d-0c26-4bf9-a5ce-eeb6b3a0127a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:41.446907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:41.447925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:41.448869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:41.448869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:41.448869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:41.448869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:41.448869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:41.448869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:41.448869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:41.448869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:41.448869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 20:29:41.448869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:41.450853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 485/967] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:29:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:41.457754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c8e3e-615f-461b-b752-b7b92be3b422 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:41.503399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eb112-e1cb-4f2e-909d-1970a345e437 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:41.504041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eb112-e1cb-4f2e-909d-1970a345e437 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:41.504317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eb112-e1cb-4f2e-909d-1970a345e437 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:41.505937 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 486/968] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:41.510751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1435c-ea83-4d47-9cd1-b59cfc53bf85 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:41.511108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1435c-ea83-4d47-9cd1-b59cfc53bf85 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:41.511496 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1435c-ea83-4d47-9cd1-b59cfc53bf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:41.528992 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d5a1435c-ea83-4d47-9cd1-b59cfc53bf85 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:41.530602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d5a1435c-ea83-4d47-9cd1-b59cfc53bf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:41.573528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c8e3e-615f-461b-b752-b7b92be3b422 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:41.613742 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 487/969] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:41.628409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfb32f-c42d-43e6-b90c-1271c9deb12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:41.629135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfb32f-c42d-43e6-b90c-1271c9deb12d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:41.629464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfb32f-c42d-43e6-b90c-1271c9deb12d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:41.629738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfb32f-c42d-43e6-b90c-1271c9deb12d None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:41.630594 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfb32f-c42d-43e6-b90c-1271c9deb12d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:41.630907 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfb32f-c42d-43e6-b90c-1271c9deb12d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:41.632424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfb32f-c42d-43e6-b90c-1271c9deb12d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:41.641863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1435c-ea83-4d47-9cd1-b59cfc53bf85 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:41.675592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 483/970] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jul 6 20:29:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:41.705703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:41.771940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1435c-ea83-4d47-9cd1-b59cfc53bf85 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:41.811209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca1657-f523-456a-9659-f78878eb0245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:41.812128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca1657-f523-456a-9659-f78878eb0245 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:41.812588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca1657-f523-456a-9659-f78878eb0245 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:41.812873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca1657-f523-456a-9659-f78878eb0245 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:41.826531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca1657-f523-456a-9659-f78878eb0245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-20ca1657-f523-456a-9659-f78878eb0245 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:41.835613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:41.836565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:41.837485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:41.837485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:41.837485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:41.837485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:41.837485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:41.837485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:41.837485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:41.837485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:41.837485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:41.837485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:41.837485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:29:41.837485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:41.837485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 488/971] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Jul 6 20:29:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:41.845452 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfb32f-c42d-43e6-b90c-1271c9deb12d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:41.859740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:41.957683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfb32f-c42d-43e6-b90c-1271c9deb12d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:41.994079 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b93955-8cfb-410a-ba52-6b976a1ee087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:41.994751 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b93955-8cfb-410a-ba52-6b976a1ee087 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:41.995038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b93955-8cfb-410a-ba52-6b976a1ee087 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:41.995349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b93955-8cfb-410a-ba52-6b976a1ee087 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:41.996095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b93955-8cfb-410a-ba52-6b976a1ee087 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:41.996406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b93955-8cfb-410a-ba52-6b976a1ee087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:41.997773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b93955-8cfb-410a-ba52-6b976a1ee087 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:42.006822 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 484/972] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jul 6 20:29:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:42.012581 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca1657-f523-456a-9659-f78878eb0245 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:42.117928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca1657-f523-456a-9659-f78878eb0245 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:42.129483 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:42.155000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf3f59-b272-4969-92d9-e466a4796bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:42.156381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf3f59-b272-4969-92d9-e466a4796bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:42.156715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf3f59-b272-4969-92d9-e466a4796bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:42.156956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf3f59-b272-4969-92d9-e466a4796bc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:42.167685 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf3f59-b272-4969-92d9-e466a4796bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:42.169140 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf3f59-b272-4969-92d9-e466a4796bc0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5faf3f59-b272-4969-92d9-e466a4796bc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:42.186719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:42.188016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:42.189372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:42.189372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:42.189372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:42.189372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:42.191308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 489/973] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:42.193649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b93955-8cfb-410a-ba52-6b976a1ee087 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:42.267956 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:42.301650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b93955-8cfb-410a-ba52-6b976a1ee087 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:42.337600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1007d-e2b5-4fe4-aab5-2ec9718d5ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:42.338271 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1007d-e2b5-4fe4-aab5-2ec9718d5ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:42.338556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1007d-e2b5-4fe4-aab5-2ec9718d5ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:42.338836 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1007d-e2b5-4fe4-aab5-2ec9718d5ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:42.339578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1007d-e2b5-4fe4-aab5-2ec9718d5ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:42.339891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1007d-e2b5-4fe4-aab5-2ec9718d5ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:42.341252 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1007d-e2b5-4fe4-aab5-2ec9718d5ca7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:42.353866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 485/974] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:42.359161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf3f59-b272-4969-92d9-e466a4796bc0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:42.461535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf3f59-b272-4969-92d9-e466a4796bc0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:42.496523 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5106ca-f722-4f7d-9f16-25314c07bf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:42.497342 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5106ca-f722-4f7d-9f16-25314c07bf69 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:42.497630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5106ca-f722-4f7d-9f16-25314c07bf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:42.497908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5106ca-f722-4f7d-9f16-25314c07bf69 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:42.506460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5106ca-f722-4f7d-9f16-25314c07bf69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:42.507938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5106ca-f722-4f7d-9f16-25314c07bf69 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0f5106ca-f722-4f7d-9f16-25314c07bf69 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:42.522686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:42.523720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:42.524665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:42.524665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:42.524665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:42.524665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:42.524665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:42.524665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:42.524665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:42.524665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:42.524665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 20:29:42.524665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:42.525972 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 490/975] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jul 6 20:29:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:42.529539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1007d-e2b5-4fe4-aab5-2ec9718d5ca7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:42.636793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1007d-e2b5-4fe4-aab5-2ec9718d5ca7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:42.644467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4a3fa-f867-49a7-9bc8-3b1cb6801813 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:42.645097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4a3fa-f867-49a7-9bc8-3b1cb6801813 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:42.645097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4a3fa-f867-49a7-9bc8-3b1cb6801813 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:42.646935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 491/976] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:42.651576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a40a6-cefd-4eab-a998-3c4fea2cb57b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:42.651756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a40a6-cefd-4eab-a998-3c4fea2cb57b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:42.652030 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a40a6-cefd-4eab-a998-3c4fea2cb57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:42.668666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-495a40a6-cefd-4eab-a998-3c4fea2cb57b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:42.669074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:42.670053 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-495a40a6-cefd-4eab-a998-3c4fea2cb57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:42.675523 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5f097-c214-40b3-b453-8e85a23fb7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:42.676281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5f097-c214-40b3-b453-8e85a23fb7db None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:42.676642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5f097-c214-40b3-b453-8e85a23fb7db None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:42.676978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5f097-c214-40b3-b453-8e85a23fb7db None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:42.677892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5f097-c214-40b3-b453-8e85a23fb7db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:42.678276 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5f097-c214-40b3-b453-8e85a23fb7db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:42.679803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5f097-c214-40b3-b453-8e85a23fb7db None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:42.694268 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:42.704775 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 486/977] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Jul 6 20:29:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:42.705883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5f097-c214-40b3-b453-8e85a23fb7db None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:42.755502 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 492/978] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:42.777376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a40a6-cefd-4eab-a998-3c4fea2cb57b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:42.810161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5f097-c214-40b3-b453-8e85a23fb7db None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:42.846711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69400cb1-0428-424a-a396-fa0259a60843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:42.847540 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69400cb1-0428-424a-a396-fa0259a60843 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:42.847922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69400cb1-0428-424a-a396-fa0259a60843 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:42.848310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69400cb1-0428-424a-a396-fa0259a60843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:42.879779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a40a6-cefd-4eab-a998-3c4fea2cb57b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:42.908304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:42.917478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c003ae-bbd7-45e9-b172-855a5cc9ef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:42.918773 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c003ae-bbd7-45e9-b172-855a5cc9ef8d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:42.919061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c003ae-bbd7-45e9-b172-855a5cc9ef8d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:42.919387 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c003ae-bbd7-45e9-b172-855a5cc9ef8d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:42.920033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c003ae-bbd7-45e9-b172-855a5cc9ef8d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:42.920454 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69400cb1-0428-424a-a396-fa0259a60843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:42.921408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c003ae-bbd7-45e9-b172-855a5cc9ef8d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:42.922664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69400cb1-0428-424a-a396-fa0259a60843 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c4c003ae-bbd7-45e9-b172-855a5cc9ef8d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:42.934569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:42.935860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:42.936726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 493/979] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:42.942179 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c003ae-bbd7-45e9-b172-855a5cc9ef8d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:42.960287 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:43.038574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 487/980] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:42 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 20:29:43.044043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69400cb1-0428-424a-a396-fa0259a60843 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:43.060094 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c003ae-bbd7-45e9-b172-855a5cc9ef8d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:43.097815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2849b5-69f8-4d64-996d-1e6cf83b2e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:43.098490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2849b5-69f8-4d64-996d-1e6cf83b2e85 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:43.098776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2849b5-69f8-4d64-996d-1e6cf83b2e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:43.099054 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2849b5-69f8-4d64-996d-1e6cf83b2e85 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:43.099795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2849b5-69f8-4d64-996d-1e6cf83b2e85 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:43.100107 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2849b5-69f8-4d64-996d-1e6cf83b2e85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:43.101474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2849b5-69f8-4d64-996d-1e6cf83b2e85 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:43.112255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 494/981] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jul 6 20:29:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:43.114044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2849b5-69f8-4d64-996d-1e6cf83b2e85 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:43.143896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:43.154622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69400cb1-0428-424a-a396-fa0259a60843 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:43.191335 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e556206-d478-4660-b3e9-ee89f78ddff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:43.192137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e556206-d478-4660-b3e9-ee89f78ddff4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:43.192421 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e556206-d478-4660-b3e9-ee89f78ddff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:43.192703 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e556206-d478-4660-b3e9-ee89f78ddff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:43.204811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e556206-d478-4660-b3e9-ee89f78ddff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:43.206663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e556206-d478-4660-b3e9-ee89f78ddff4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:43.207972 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-0e556206-d478-4660-b3e9-ee89f78ddff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:43.225157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:43.226077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:43.227013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:43.227013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:43.227013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:43.227013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:43.227013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 488/982] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:43.231466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2849b5-69f8-4d64-996d-1e6cf83b2e85 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:43.232128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e556206-d478-4660-b3e9-ee89f78ddff4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:43.268363 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091055f-132c-4aa1-8576-54f9eca0b8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:43.268999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091055f-132c-4aa1-8576-54f9eca0b8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:43.269287 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091055f-132c-4aa1-8576-54f9eca0b8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:43.269566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091055f-132c-4aa1-8576-54f9eca0b8c0 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:43.270272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091055f-132c-4aa1-8576-54f9eca0b8c0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:43.270580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091055f-132c-4aa1-8576-54f9eca0b8c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:43.272652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091055f-132c-4aa1-8576-54f9eca0b8c0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:43.283134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 495/983] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jul 6 20:29:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:43.285265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091055f-132c-4aa1-8576-54f9eca0b8c0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:43.351671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e556206-d478-4660-b3e9-ee89f78ddff4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:43.389542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee83e60-3d79-4b8d-83e4-2e2c3347fad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:43.390359 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee83e60-3d79-4b8d-83e4-2e2c3347fad8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:43.390772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee83e60-3d79-4b8d-83e4-2e2c3347fad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:43.390772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee83e60-3d79-4b8d-83e4-2e2c3347fad8 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:43.391784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee83e60-3d79-4b8d-83e4-2e2c3347fad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:43.392096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee83e60-3d79-4b8d-83e4-2e2c3347fad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:43.393476 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee83e60-3d79-4b8d-83e4-2e2c3347fad8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:43.400246 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091055f-132c-4aa1-8576-54f9eca0b8c0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:43.410922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 489/984] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:43.411880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee83e60-3d79-4b8d-83e4-2e2c3347fad8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:43.414551 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:43.436803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6a2d0-6dae-486f-b4eb-6fb630304d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:43.438027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6a2d0-6dae-486f-b4eb-6fb630304d60 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:43.438318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6a2d0-6dae-486f-b4eb-6fb630304d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:43.438583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6a2d0-6dae-486f-b4eb-6fb630304d60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:43.439392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6a2d0-6dae-486f-b4eb-6fb630304d60 None admin] RBAC: Adding query filter params (interface=public, service_id=eb5f8be3d0a74ccab23d0c9102016055, region_id=RegionOne) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:43.439703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6a2d0-6dae-486f-b4eb-6fb630304d60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:43.441134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6a2d0-6dae-486f-b4eb-6fb630304d60 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:43.446271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 496/985] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jul 6 20:29:43 2022] GET /identity/v3/endpoints?service_id=eb5f8be3d0a74ccab23d0c9102016055&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:43.447771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33000bc-63c6-4f03-aed2-03f0742ed460 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:43.448113 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33000bc-63c6-4f03-aed2-03f0742ed460 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:43.448481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33000bc-63c6-4f03-aed2-03f0742ed460 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:43.451415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 497/986] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:43.452141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33000bc-63c6-4f03-aed2-03f0742ed460 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:43.463802 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:43.519285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee83e60-3d79-4b8d-83e4-2e2c3347fad8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:43.552941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055189ea-ad02-4bba-a70f-71a79ee5bda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:43.553735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055189ea-ad02-4bba-a70f-71a79ee5bda9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:43.554020 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055189ea-ad02-4bba-a70f-71a79ee5bda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:43.554242 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33000bc-63c6-4f03-aed2-03f0742ed460 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:43.554359 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055189ea-ad02-4bba-a70f-71a79ee5bda9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:43.560875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055189ea-ad02-4bba-a70f-71a79ee5bda9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:43.562316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055189ea-ad02-4bba-a70f-71a79ee5bda9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-055189ea-ad02-4bba-a70f-71a79ee5bda9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:43.576544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:43.577575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:43.578545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:43.578545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:43.578545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:43.578545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:43.578545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:43.578545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:43.578545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:43.578545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:43.579323 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 490/987] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:43.580538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc58ce4-f50c-4c95-8855-c3eaea2ed600 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:43.580826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc58ce4-f50c-4c95-8855-c3eaea2ed600 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:43.581104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc58ce4-f50c-4c95-8855-c3eaea2ed600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:43.596915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7994224-cf9a-4cc4-88e5-c3680db2c1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:43.597595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7994224-cf9a-4cc4-88e5-c3680db2c1eb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:43.597881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7994224-cf9a-4cc4-88e5-c3680db2c1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:43.598165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7994224-cf9a-4cc4-88e5-c3680db2c1eb None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:43.598849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7994224-cf9a-4cc4-88e5-c3680db2c1eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:43.598996 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-6fc58ce4-f50c-4c95-8855-c3eaea2ed600 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:43.600228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6fc58ce4-f50c-4c95-8855-c3eaea2ed600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:43.600337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7994224-cf9a-4cc4-88e5-c3680db2c1eb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:43.606712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 498/988] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jul 6 20:29:43 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:29:43.611022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7994224-cf9a-4cc4-88e5-c3680db2c1eb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:43.668817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:43.681861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 491/989] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:43.699353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:43.706420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc58ce4-f50c-4c95-8855-c3eaea2ed600 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:43.733691 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7994224-cf9a-4cc4-88e5-c3680db2c1eb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:43.772625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768841ad-fac8-4dbf-a60a-4bc3045a5942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:43.773613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768841ad-fac8-4dbf-a60a-4bc3045a5942 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:43.773751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768841ad-fac8-4dbf-a60a-4bc3045a5942 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:43.773952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768841ad-fac8-4dbf-a60a-4bc3045a5942 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:43.774744 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768841ad-fac8-4dbf-a60a-4bc3045a5942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:43.775114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768841ad-fac8-4dbf-a60a-4bc3045a5942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:43.777497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768841ad-fac8-4dbf-a60a-4bc3045a5942 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:43.790974 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 499/990] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:43.797147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768841ad-fac8-4dbf-a60a-4bc3045a5942 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:43.819940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc58ce4-f50c-4c95-8855-c3eaea2ed600 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:43.857713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba5cd5-f252-4094-9c27-684739a7ac25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:43.858424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba5cd5-f252-4094-9c27-684739a7ac25 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:43.858714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba5cd5-f252-4094-9c27-684739a7ac25 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:43.858981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba5cd5-f252-4094-9c27-684739a7ac25 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:43.860089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba5cd5-f252-4094-9c27-684739a7ac25 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:43.861453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba5cd5-f252-4094-9c27-684739a7ac25 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-aeba5cd5-f252-4094-9c27-684739a7ac25 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:43.873678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:43.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:43.876167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 492/991] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jul 6 20:29:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:43.881811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba5cd5-f252-4094-9c27-684739a7ac25 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:43.904825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768841ad-fac8-4dbf-a60a-4bc3045a5942 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:43.936879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:43.943843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0cc8b-5af4-4a15-b513-26077572c164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:43.944515 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0cc8b-5af4-4a15-b513-26077572c164 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:43.944803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0cc8b-5af4-4a15-b513-26077572c164 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:43.945081 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0cc8b-5af4-4a15-b513-26077572c164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:43.945916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0cc8b-5af4-4a15-b513-26077572c164 None admin] RBAC: Adding query filter params (role.id=f352a777e52940a99a854c673ce45f28, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=e1c9cdf941294b4190245ed43d219ef6) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:43.946231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0cc8b-5af4-4a15-b513-26077572c164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:43.947705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0cc8b-5af4-4a15-b513-26077572c164 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:43.963210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 500/992] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:43 2022] GET /identity/v3/role_assignments?user.id=e1c9cdf941294b4190245ed43d219ef6&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=f352a777e52940a99a854c673ce45f28 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:43.965431 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:44.016773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba5cd5-f252-4094-9c27-684739a7ac25 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:44.053732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe43e4-ebcb-466f-93b3-4f1312aa89cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:44.054420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe43e4-ebcb-466f-93b3-4f1312aa89cc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:44.054705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe43e4-ebcb-466f-93b3-4f1312aa89cc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:44.054990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe43e4-ebcb-466f-93b3-4f1312aa89cc None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:44.055738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe43e4-ebcb-466f-93b3-4f1312aa89cc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:44.056050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe43e4-ebcb-466f-93b3-4f1312aa89cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:44.057467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe43e4-ebcb-466f-93b3-4f1312aa89cc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:44.064037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 493/993] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jul 6 20:29:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:44.070037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0cc8b-5af4-4a15-b513-26077572c164 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:44.183126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0cc8b-5af4-4a15-b513-26077572c164 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:44.217556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4bca7-bfad-40ba-9aa0-2d76132ff9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:44.218310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4bca7-bfad-40ba-9aa0-2d76132ff9ec None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:44.218584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4bca7-bfad-40ba-9aa0-2d76132ff9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:44.218863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4bca7-bfad-40ba-9aa0-2d76132ff9ec None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:44.219610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4bca7-bfad-40ba-9aa0-2d76132ff9ec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:44.219922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4bca7-bfad-40ba-9aa0-2d76132ff9ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:44.221287 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4bca7-bfad-40ba-9aa0-2d76132ff9ec None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:44.226477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 501/994] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jul 6 20:29:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:44.232195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe43e4-ebcb-466f-93b3-4f1312aa89cc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:44.336045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe43e4-ebcb-466f-93b3-4f1312aa89cc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:44.355598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:44.370864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efd09b-88f2-41f8-b89e-ff8482d5aecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:44.371546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efd09b-88f2-41f8-b89e-ff8482d5aecc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:44.371828 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efd09b-88f2-41f8-b89e-ff8482d5aecc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:44.372101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efd09b-88f2-41f8-b89e-ff8482d5aecc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:44.372941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efd09b-88f2-41f8-b89e-ff8482d5aecc None admin] RBAC: Adding query filter params (interface=admin, service_id=2d29bc586ea94a398ae764770bc60ca8, region_id=RegionOne) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:44.373253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efd09b-88f2-41f8-b89e-ff8482d5aecc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:44.374606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efd09b-88f2-41f8-b89e-ff8482d5aecc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:44.384747 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 494/995] 10.222.0.33 () {56 vars in 1249 bytes} [Wed Jul 6 20:29:44 2022] GET /identity/v3/endpoints?service_id=2d29bc586ea94a398ae764770bc60ca8&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:44.385997 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4bca7-bfad-40ba-9aa0-2d76132ff9ec None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:44.447487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:44.490451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4bca7-bfad-40ba-9aa0-2d76132ff9ec None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:44.530930 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1bc12-ecba-4595-9b1d-59d4e0d5d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:44.531658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1bc12-ecba-4595-9b1d-59d4e0d5d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:44.531940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1bc12-ecba-4595-9b1d-59d4e0d5d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:44.532216 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1bc12-ecba-4595-9b1d-59d4e0d5d9e8 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:44.532890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1bc12-ecba-4595-9b1d-59d4e0d5d9e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:44.534258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1bc12-ecba-4595-9b1d-59d4e0d5d9e8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:44.543586 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 502/996] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jul 6 20:29:44 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:29:45.686156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c3812-e620-47d2-b486-bcd31f64f4c0 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:45.686672 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c3812-e620-47d2-b486-bcd31f64f4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:45.686748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c3812-e620-47d2-b486-bcd31f64f4c0 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:45.689279 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 495/997] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:45.693905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15f33a-6c6c-4a46-8119-68871d63fc03 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:45.694364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15f33a-6c6c-4a46-8119-68871d63fc03 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:45.694446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15f33a-6c6c-4a46-8119-68871d63fc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:45.711654 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7d15f33a-6c6c-4a46-8119-68871d63fc03 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:45.712835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7d15f33a-6c6c-4a46-8119-68871d63fc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:45.783025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 503/998] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:45.805686 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c3812-e620-47d2-b486-bcd31f64f4c0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:45.909532 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c3812-e620-47d2-b486-bcd31f64f4c0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:45.942518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860e7e8-0394-4d37-93ac-1309a9b1f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:45.943356 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860e7e8-0394-4d37-93ac-1309a9b1f94f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:45.943638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860e7e8-0394-4d37-93ac-1309a9b1f94f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:45.943911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860e7e8-0394-4d37-93ac-1309a9b1f94f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:45.944550 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860e7e8-0394-4d37-93ac-1309a9b1f94f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:45.945910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860e7e8-0394-4d37-93ac-1309a9b1f94f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-3860e7e8-0394-4d37-93ac-1309a9b1f94f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:45.958040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:45.959133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:45.960000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 496/999] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:45.966836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15f33a-6c6c-4a46-8119-68871d63fc03 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:46.022151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:46.032719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ead60-2cdb-4af8-bf0f-1cb6e5c6f5e7 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:46.033378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ead60-2cdb-4af8-bf0f-1cb6e5c6f5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:46.033800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ead60-2cdb-4af8-bf0f-1cb6e5c6f5e7 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:46.035639 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 497/1000] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:29:46.040209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545a88-e7df-42b4-a008-1f1f4e431f1f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:46.040496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545a88-e7df-42b4-a008-1f1f4e431f1f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:46.040782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545a88-e7df-42b4-a008-1f1f4e431f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:46.058051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3f545a88-e7df-42b4-a008-1f1f4e431f1f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:46.059276 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3f545a88-e7df-42b4-a008-1f1f4e431f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:46.079543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15f33a-6c6c-4a46-8119-68871d63fc03 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:46.106358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:46.120032 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bc219-8adc-42af-8642-f1bf155d3737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:46.120736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bc219-8adc-42af-8642-f1bf155d3737 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:46.120986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bc219-8adc-42af-8642-f1bf155d3737 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:46.121263 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bc219-8adc-42af-8642-f1bf155d3737 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:46.121966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bc219-8adc-42af-8642-f1bf155d3737 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:46.122277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bc219-8adc-42af-8642-f1bf155d3737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:46.123903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bc219-8adc-42af-8642-f1bf155d3737 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:46.129984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 504/1001] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jul 6 20:29:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:46.133405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 498/1002] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:46.136175 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bc219-8adc-42af-8642-f1bf155d3737 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:46.157633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f545a88-e7df-42b4-a008-1f1f4e431f1f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:46.240353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bc219-8adc-42af-8642-f1bf155d3737 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:46.257493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:46.274473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f545a88-e7df-42b4-a008-1f1f4e431f1f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:46.277356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda90c97-ad46-4300-9873-9dd28a61dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:46.278308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90c97-ad46-4300-9873-9dd28a61dcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:46.278593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90c97-ad46-4300-9873-9dd28a61dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:46.278869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90c97-ad46-4300-9873-9dd28a61dcb6 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:46.279606 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda90c97-ad46-4300-9873-9dd28a61dcb6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:46.279916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda90c97-ad46-4300-9873-9dd28a61dcb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:46.281959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda90c97-ad46-4300-9873-9dd28a61dcb6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:46.287468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 505/1003] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jul 6 20:29:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:46.292684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda90c97-ad46-4300-9873-9dd28a61dcb6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:46.315803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467e67d-41ff-485b-89c3-3a4694da4aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:46.316594 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467e67d-41ff-485b-89c3-3a4694da4aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:46.316875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467e67d-41ff-485b-89c3-3a4694da4aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:46.317148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467e67d-41ff-485b-89c3-3a4694da4aa4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:46.317780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467e67d-41ff-485b-89c3-3a4694da4aa4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:46.319137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467e67d-41ff-485b-89c3-3a4694da4aa4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-5467e67d-41ff-485b-89c3-3a4694da4aa4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:46.331748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:46.332731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:46.333564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 499/1004] 10.222.0.33 () {56 vars in 1105 bytes} [Wed Jul 6 20:29:46 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:46.338640 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467e67d-41ff-485b-89c3-3a4694da4aa4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:46.386265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:46.399383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda90c97-ad46-4300-9873-9dd28a61dcb6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:46.438678 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcd55b-100f-49b2-a2f2-4de3a6338fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:46.439621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcd55b-100f-49b2-a2f2-4de3a6338fdc None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:46.440067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcd55b-100f-49b2-a2f2-4de3a6338fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:46.440341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcd55b-100f-49b2-a2f2-4de3a6338fdc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:46.441075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcd55b-100f-49b2-a2f2-4de3a6338fdc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:46.442440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcd55b-100f-49b2-a2f2-4de3a6338fdc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:46.448574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467e67d-41ff-485b-89c3-3a4694da4aa4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:46.471279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 506/1005] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jul 6 20:29:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:29:46.503701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c7b3a-7cab-44b0-966d-6f3d7acf992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:46.504290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7b3a-7cab-44b0-966d-6f3d7acf992e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:46.504574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7b3a-7cab-44b0-966d-6f3d7acf992e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:46.504856 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7b3a-7cab-44b0-966d-6f3d7acf992e None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:46.505563 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c7b3a-7cab-44b0-966d-6f3d7acf992e None admin] RBAC: Adding query filter params (name=image) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:46.505872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c7b3a-7cab-44b0-966d-6f3d7acf992e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:46.507273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c7b3a-7cab-44b0-966d-6f3d7acf992e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:46.512859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 500/1006] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:46.518876 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcd55b-100f-49b2-a2f2-4de3a6338fdc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:46.564941 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:46.597289 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ac7b6-cf76-480d-b574-167bdb54a2a1 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:46.597644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ac7b6-cf76-480d-b574-167bdb54a2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:46.597871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ac7b6-cf76-480d-b574-167bdb54a2a1 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:46.599472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 501/1007] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:46.605030 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf5e0-589d-463c-8c85-db67387290b9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:46.605318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf5e0-589d-463c-8c85-db67387290b9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:46.605597 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf5e0-589d-463c-8c85-db67387290b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:46.624067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-04ccf5e0-589d-463c-8c85-db67387290b9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:46.625273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-04ccf5e0-589d-463c-8c85-db67387290b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:46.654207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcd55b-100f-49b2-a2f2-4de3a6338fdc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:46.693471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaa552-ff76-42fe-898a-259ce677d39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:46.694146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaa552-ff76-42fe-898a-259ce677d39c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:46.694696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaa552-ff76-42fe-898a-259ce677d39c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:46.694696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaa552-ff76-42fe-898a-259ce677d39c None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:46.695487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaa552-ff76-42fe-898a-259ce677d39c None admin] RBAC: Adding query filter params (type=image) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:46.695800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaa552-ff76-42fe-898a-259ce677d39c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:46.697177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaa552-ff76-42fe-898a-259ce677d39c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:46.703527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 507/1008] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:46.703690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 502/1009] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:46 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:46.726777 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaa552-ff76-42fe-898a-259ce677d39c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:46.840439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaa552-ff76-42fe-898a-259ce677d39c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:46.842284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:46.880239 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e332f5d-abee-40d2-8ab8-a43a97b6e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:46.881048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e332f5d-abee-40d2-8ab8-a43a97b6e242 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:46.881332 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e332f5d-abee-40d2-8ab8-a43a97b6e242 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:46.881613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e332f5d-abee-40d2-8ab8-a43a97b6e242 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:46.882270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e332f5d-abee-40d2-8ab8-a43a97b6e242 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:46.883770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e332f5d-abee-40d2-8ab8-a43a97b6e242 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4e332f5d-abee-40d2-8ab8-a43a97b6e242 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:46.896430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:46.897950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:46.898940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 508/1010] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jul 6 20:29:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:46.903974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccf5e0-589d-463c-8c85-db67387290b9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:46.934720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:47.005799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccf5e0-589d-463c-8c85-db67387290b9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:47.041108 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267ad78-ccb0-41a4-a981-f8ae23f4debd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:47.041774 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267ad78-ccb0-41a4-a981-f8ae23f4debd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:47.042059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267ad78-ccb0-41a4-a981-f8ae23f4debd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:47.042331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267ad78-ccb0-41a4-a981-f8ae23f4debd None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:47.043027 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267ad78-ccb0-41a4-a981-f8ae23f4debd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:47.043360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267ad78-ccb0-41a4-a981-f8ae23f4debd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:47.044721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267ad78-ccb0-41a4-a981-f8ae23f4debd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:47.050344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 503/1011] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jul 6 20:29:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:47.056067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e332f5d-abee-40d2-8ab8-a43a97b6e242 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:47.162952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e332f5d-abee-40d2-8ab8-a43a97b6e242 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:47.198699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62034f-e871-41c1-b863-4859605dceab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:47.199465 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62034f-e871-41c1-b863-4859605dceab None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:47.199750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62034f-e871-41c1-b863-4859605dceab None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:47.200023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62034f-e871-41c1-b863-4859605dceab None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:47.200722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62034f-e871-41c1-b863-4859605dceab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:47.201025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62034f-e871-41c1-b863-4859605dceab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:47.202382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62034f-e871-41c1-b863-4859605dceab None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:47.208124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 509/1012] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jul 6 20:29:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:47.213538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267ad78-ccb0-41a4-a981-f8ae23f4debd None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:47.313818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:47.320940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267ad78-ccb0-41a4-a981-f8ae23f4debd None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:47.356534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcb746-3b85-425a-853f-48cbf1584bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:47.357195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcb746-3b85-425a-853f-48cbf1584bf5 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:47.357477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcb746-3b85-425a-853f-48cbf1584bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:47.357752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcb746-3b85-425a-853f-48cbf1584bf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:47.358497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcb746-3b85-425a-853f-48cbf1584bf5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:47.361242 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcb746-3b85-425a-853f-48cbf1584bf5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:47.383194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 504/1013] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jul 6 20:29:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:48.650465 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afea90c-4519-4154-aef4-469fe2bfea55 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:48.650980 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afea90c-4519-4154-aef4-469fe2bfea55 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:48.651091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afea90c-4519-4154-aef4-469fe2bfea55 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:48.652631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 510/1014] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:48.658384 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02fc52-6953-40d2-a6a6-dd994be0141c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:48.658800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02fc52-6953-40d2-a6a6-dd994be0141c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:48.658989 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02fc52-6953-40d2-a6a6-dd994be0141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:48.676065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fc02fc52-6953-40d2-a6a6-dd994be0141c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:48.677258 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fc02fc52-6953-40d2-a6a6-dd994be0141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:48.752714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 505/1015] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:48 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:48.755592 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46edce9-686a-4e58-b5c7-e1b84519713a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:48.755882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46edce9-686a-4e58-b5c7-e1b84519713a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:48.756157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46edce9-686a-4e58-b5c7-e1b84519713a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:48.757619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 511/1016] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:48.762444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7873d2-3990-4a92-81a2-ba1534d26163 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:48.762734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7873d2-3990-4a92-81a2-ba1534d26163 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:48.763011 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7873d2-3990-4a92-81a2-ba1534d26163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:48.775973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46edce9-686a-4e58-b5c7-e1b84519713a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:48.780453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-de7873d2-3990-4a92-81a2-ba1534d26163 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:48.782177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-de7873d2-3990-4a92-81a2-ba1534d26163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:48.811412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:48.854570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 506/1017] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:48 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:48.877519 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7873d2-3990-4a92-81a2-ba1534d26163 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:48.891600 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46edce9-686a-4e58-b5c7-e1b84519713a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:48.892578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:48.929984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c802b9-c526-433a-acc5-61121572a852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:48.930575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c802b9-c526-433a-acc5-61121572a852 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:48.930864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c802b9-c526-433a-acc5-61121572a852 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:48.931202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c802b9-c526-433a-acc5-61121572a852 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:48.943408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c802b9-c526-433a-acc5-61121572a852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-17c802b9-c526-433a-acc5-61121572a852 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:48.951585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:48.952510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:48.954031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:48.954031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:48.954031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:48.954031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:48.954031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:48.954031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:48.954031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:48.954031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:48.954031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:48.954031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:48.954031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:29:48.954031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:48.954031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 512/1018] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Jul 6 20:29:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:48.959123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c802b9-c526-433a-acc5-61121572a852 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:48.989965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7873d2-3990-4a92-81a2-ba1534d26163 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:49.031853 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb76e2-56fc-4a68-9e56-0ef67f3fd566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:49.032568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb76e2-56fc-4a68-9e56-0ef67f3fd566 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:49.032853 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb76e2-56fc-4a68-9e56-0ef67f3fd566 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:49.033137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb76e2-56fc-4a68-9e56-0ef67f3fd566 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:49.033858 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb76e2-56fc-4a68-9e56-0ef67f3fd566 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:49.035249 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb76e2-56fc-4a68-9e56-0ef67f3fd566 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:49.051286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 507/1019] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:29:48 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:29:49.061648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:49.073891 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c802b9-c526-433a-acc5-61121572a852 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:49.121106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a1707-5402-4009-b6c8-3760d658ab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:49.121704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a1707-5402-4009-b6c8-3760d658ab6f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:49.121988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a1707-5402-4009-b6c8-3760d658ab6f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:49.122264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a1707-5402-4009-b6c8-3760d658ab6f None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:49.123050 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a1707-5402-4009-b6c8-3760d658ab6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:49.123395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a1707-5402-4009-b6c8-3760d658ab6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:49.124812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a1707-5402-4009-b6c8-3760d658ab6f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:49.138830 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 513/1020] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jul 6 20:29:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:49.140500 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb76e2-56fc-4a68-9e56-0ef67f3fd566 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:49.221452 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:49.255425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb76e2-56fc-4a68-9e56-0ef67f3fd566 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:49.292015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5296c07-c9b5-4980-be9b-ffc20643c250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:49.292818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5296c07-c9b5-4980-be9b-ffc20643c250 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:49.293102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5296c07-c9b5-4980-be9b-ffc20643c250 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:49.293383 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5296c07-c9b5-4980-be9b-ffc20643c250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:49.304834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5296c07-c9b5-4980-be9b-ffc20643c250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:49.306284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5296c07-c9b5-4980-be9b-ffc20643c250 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-b5296c07-c9b5-4980-be9b-ffc20643c250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:49.323948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:49.325019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:49.330691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:49.330691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:49.330691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:49.330691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:49.330691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 508/1021] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:49.332447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a1707-5402-4009-b6c8-3760d658ab6f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:49.436453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a1707-5402-4009-b6c8-3760d658ab6f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:49.445578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dc9c9-31c2-49d7-a0d0-2a5c2fef6ded None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:49.445875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dc9c9-31c2-49d7-a0d0-2a5c2fef6ded None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:49.446154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dc9c9-31c2-49d7-a0d0-2a5c2fef6ded None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:49.447834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 509/1022] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:29:49.452430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53932e-e614-46c4-8bd4-b708b395d79b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:49.452725 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53932e-e614-46c4-8bd4-b708b395d79b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:49.453008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53932e-e614-46c4-8bd4-b708b395d79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:49.470582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5c53932e-e614-46c4-8bd4-b708b395d79b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:49.471932 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5c53932e-e614-46c4-8bd4-b708b395d79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:49.475740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218a51d-0e3b-4eb9-b7d8-f246556a66c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:49.476411 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218a51d-0e3b-4eb9-b7d8-f246556a66c7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:49.476698 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218a51d-0e3b-4eb9-b7d8-f246556a66c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:49.476980 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218a51d-0e3b-4eb9-b7d8-f246556a66c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:49.477701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218a51d-0e3b-4eb9-b7d8-f246556a66c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:49.478015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218a51d-0e3b-4eb9-b7d8-f246556a66c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:49.479435 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218a51d-0e3b-4eb9-b7d8-f246556a66c7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:49.495505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 514/1023] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:49.498744 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218a51d-0e3b-4eb9-b7d8-f246556a66c7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:49.510011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:49.546834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 510/1024] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:49.570130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53932e-e614-46c4-8bd4-b708b395d79b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:49.606900 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218a51d-0e3b-4eb9-b7d8-f246556a66c7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:49.643465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:49.643808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aff191-00c2-41a9-aacf-a6bcb8d27cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:49.644602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aff191-00c2-41a9-aacf-a6bcb8d27cfc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:49.644962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aff191-00c2-41a9-aacf-a6bcb8d27cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:49.645182 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aff191-00c2-41a9-aacf-a6bcb8d27cfc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:49.653400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aff191-00c2-41a9-aacf-a6bcb8d27cfc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:49.654844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aff191-00c2-41a9-aacf-a6bcb8d27cfc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-08aff191-00c2-41a9-aacf-a6bcb8d27cfc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:49.669985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:49.671346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:49.672530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:49.672530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:49.672530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:49.672530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:49.672530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:49.672530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:49.672530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:49.672530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:49.672530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:49.672530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:49.672530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 515/1025] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jul 6 20:29:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:49.676709 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aff191-00c2-41a9-aacf-a6bcb8d27cfc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:49.698772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53932e-e614-46c4-8bd4-b708b395d79b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:49.735765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70136a-79a7-4be8-b7bf-30dd175d0bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:49.737336 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70136a-79a7-4be8-b7bf-30dd175d0bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:49.737832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70136a-79a7-4be8-b7bf-30dd175d0bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:49.738392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70136a-79a7-4be8-b7bf-30dd175d0bd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:49.739779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70136a-79a7-4be8-b7bf-30dd175d0bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:49.741397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70136a-79a7-4be8-b7bf-30dd175d0bd4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:49.743298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 511/1026] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:49.748957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70136a-79a7-4be8-b7bf-30dd175d0bd4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:49.756379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:49.791203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aff191-00c2-41a9-aacf-a6bcb8d27cfc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:49.824800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e3d9-2e1c-4175-91bf-d724d2057f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:49.825474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e3d9-2e1c-4175-91bf-d724d2057f68 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:49.825755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e3d9-2e1c-4175-91bf-d724d2057f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:49.826030 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e3d9-2e1c-4175-91bf-d724d2057f68 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:49.826854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23e3d9-2e1c-4175-91bf-d724d2057f68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:49.827163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23e3d9-2e1c-4175-91bf-d724d2057f68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:49.828850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23e3d9-2e1c-4175-91bf-d724d2057f68 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:49.846391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 516/1027] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jul 6 20:29:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:49.851682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e3d9-2e1c-4175-91bf-d724d2057f68 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:49.859595 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70136a-79a7-4be8-b7bf-30dd175d0bd4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:49.884373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:49.898732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44adf6-c1c0-466f-9f3e-9d01a78ed62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:49.899417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44adf6-c1c0-466f-9f3e-9d01a78ed62c None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:49.899700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44adf6-c1c0-466f-9f3e-9d01a78ed62c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:49.899975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44adf6-c1c0-466f-9f3e-9d01a78ed62c None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:49.900674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44adf6-c1c0-466f-9f3e-9d01a78ed62c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:49.902087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44adf6-c1c0-466f-9f3e-9d01a78ed62c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:49.939207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 512/1028] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:29:49 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:49.967501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e3d9-2e1c-4175-91bf-d724d2057f68 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:49.997776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:50.008987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3c32a-93a2-4170-a3b0-3fa411b50a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:50.009661 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c32a-93a2-4170-a3b0-3fa411b50a31 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:50.009951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c32a-93a2-4170-a3b0-3fa411b50a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:50.010234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c32a-93a2-4170-a3b0-3fa411b50a31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:50.083114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3c32a-93a2-4170-a3b0-3fa411b50a31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:50.084619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3c32a-93a2-4170-a3b0-3fa411b50a31 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:50.190691 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 517/1029] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 20:29:50.196867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44adf6-c1c0-466f-9f3e-9d01a78ed62c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:50.298883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44adf6-c1c0-466f-9f3e-9d01a78ed62c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:50.332260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3aadc-3f1a-4f90-94df-09b7b92c6ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:50.333057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3aadc-3f1a-4f90-94df-09b7b92c6ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:50.333342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3aadc-3f1a-4f90-94df-09b7b92c6ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:50.333620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3aadc-3f1a-4f90-94df-09b7b92c6ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:50.345196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3aadc-3f1a-4f90-94df-09b7b92c6ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:50.346659 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3aadc-3f1a-4f90-94df-09b7b92c6ae1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-c3a3aadc-3f1a-4f90-94df-09b7b92c6ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:50.364127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:50.364995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:50.365894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:50.365894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:50.365894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:50.365894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:50.366637 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 513/1030] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:50.371091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3c32a-93a2-4170-a3b0-3fa411b50a31 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:50.397653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:50.471450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3c32a-93a2-4170-a3b0-3fa411b50a31 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:50.505911 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016cd4-f4a5-4559-a179-3449a76b7cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:50.506578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016cd4-f4a5-4559-a179-3449a76b7cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:50.506863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016cd4-f4a5-4559-a179-3449a76b7cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:50.507141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016cd4-f4a5-4559-a179-3449a76b7cd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:50.507883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae016cd4-f4a5-4559-a179-3449a76b7cd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:50.508194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae016cd4-f4a5-4559-a179-3449a76b7cd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:50.509566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae016cd4-f4a5-4559-a179-3449a76b7cd3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:50.525404 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 518/1031] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:50.526686 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3aadc-3f1a-4f90-94df-09b7b92c6ae1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:50.555536 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:50.637561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3aadc-3f1a-4f90-94df-09b7b92c6ae1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:50.671297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526a2aa-71a9-4c7a-9dbb-a02b39890798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:50.672729 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526a2aa-71a9-4c7a-9dbb-a02b39890798 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:50.673153 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526a2aa-71a9-4c7a-9dbb-a02b39890798 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:50.673436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526a2aa-71a9-4c7a-9dbb-a02b39890798 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:50.680263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526a2aa-71a9-4c7a-9dbb-a02b39890798 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:50.681705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526a2aa-71a9-4c7a-9dbb-a02b39890798 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-e526a2aa-71a9-4c7a-9dbb-a02b39890798 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:50.696072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:50.696969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:50.697883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:50.697883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:50.697883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:50.697883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:50.697883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:50.697883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:50.697883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:50.697883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:50.697883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 514/1032] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:50.704984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016cd4-f4a5-4559-a179-3449a76b7cd3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:50.791554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:50.807369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016cd4-f4a5-4559-a179-3449a76b7cd3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:50.840481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05373793-eabd-4e64-890a-aa5c9389e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:50.841148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05373793-eabd-4e64-890a-aa5c9389e432 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:50.841442 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05373793-eabd-4e64-890a-aa5c9389e432 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:50.841720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05373793-eabd-4e64-890a-aa5c9389e432 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:50.842496 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05373793-eabd-4e64-890a-aa5c9389e432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:50.842808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05373793-eabd-4e64-890a-aa5c9389e432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:50.844970 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05373793-eabd-4e64-890a-aa5c9389e432 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:50.857556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 519/1033] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:50.863375 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526a2aa-71a9-4c7a-9dbb-a02b39890798 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:50.947861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:50.964391 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526a2aa-71a9-4c7a-9dbb-a02b39890798 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:50.998371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e941c-f483-49c8-8f93-947e252c85af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:50.999036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e941c-f483-49c8-8f93-947e252c85af None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:50.999349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e941c-f483-49c8-8f93-947e252c85af None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:50.999630 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e941c-f483-49c8-8f93-947e252c85af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:51.000828 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e941c-f483-49c8-8f93-947e252c85af None admin] RBAC: Adding query filter params (role.id=f352a777e52940a99a854c673ce45f28, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=3d68c8fdb65343b8b2f58070addeaf13) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:51.001333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e941c-f483-49c8-8f93-947e252c85af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:51.003224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e941c-f483-49c8-8f93-947e252c85af None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:51.015203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 515/1034] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:50 2022] GET /identity/v3/role_assignments?user.id=3d68c8fdb65343b8b2f58070addeaf13&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=f352a777e52940a99a854c673ce45f28 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:51.159469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aeef8-5e12-4e59-bd9c-60e9c6a3245d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:51.159770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aeef8-5e12-4e59-bd9c-60e9c6a3245d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:51.159957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aeef8-5e12-4e59-bd9c-60e9c6a3245d None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:51.161495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 520/1035] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:51.166817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285b74e-958a-4790-af67-4c01f574099f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:51.167109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285b74e-958a-4790-af67-4c01f574099f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:51.167416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285b74e-958a-4790-af67-4c01f574099f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:51.184925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7285b74e-958a-4790-af67-4c01f574099f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:51.186117 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7285b74e-958a-4790-af67-4c01f574099f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:51.256147 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 516/1036] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:51.278781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aeef8-5e12-4e59-bd9c-60e9c6a3245d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:51.380124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aeef8-5e12-4e59-bd9c-60e9c6a3245d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:51.415379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c80812-a955-49a7-9cf6-109ff3241f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:51.416153 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c80812-a955-49a7-9cf6-109ff3241f02 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:51.416438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c80812-a955-49a7-9cf6-109ff3241f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:51.416763 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c80812-a955-49a7-9cf6-109ff3241f02 None admin] PATH_INFO: `/v3/services/image` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:51.417412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c80812-a955-49a7-9cf6-109ff3241f02 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:51.418795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c80812-a955-49a7-9cf6-109ff3241f02 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-16c80812-a955-49a7-9cf6-109ff3241f02 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:51.430901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:51.432070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:29:51.432962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:51.435531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 521/1037] 10.222.0.33 () {56 vars in 1105 bytes} [Wed Jul 6 20:29:51 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:51.438486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285b74e-958a-4790-af67-4c01f574099f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:51.522572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:51.543058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285b74e-958a-4790-af67-4c01f574099f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:51.577364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3834c6-0e87-48d7-a64a-e9536b294c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:51.578025 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3834c6-0e87-48d7-a64a-e9536b294c09 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:51.578861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3834c6-0e87-48d7-a64a-e9536b294c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:51.579238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3834c6-0e87-48d7-a64a-e9536b294c09 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:51.579856 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3834c6-0e87-48d7-a64a-e9536b294c09 None admin] RBAC: Adding query filter params (name=image) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:51.580160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3834c6-0e87-48d7-a64a-e9536b294c09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:51.581622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3834c6-0e87-48d7-a64a-e9536b294c09 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:51.596413 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 517/1038] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:51.597919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c80812-a955-49a7-9cf6-109ff3241f02 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:51.611201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:51.702853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c80812-a955-49a7-9cf6-109ff3241f02 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:51.737469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086361f6-1eea-413b-aeca-bcad135eb914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:51.738112 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086361f6-1eea-413b-aeca-bcad135eb914 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:51.738400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086361f6-1eea-413b-aeca-bcad135eb914 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:51.738668 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086361f6-1eea-413b-aeca-bcad135eb914 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:51.739386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086361f6-1eea-413b-aeca-bcad135eb914 None admin] RBAC: Adding query filter params (type=image) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:51.739692 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086361f6-1eea-413b-aeca-bcad135eb914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:51.741044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086361f6-1eea-413b-aeca-bcad135eb914 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:51.751236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 522/1039] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:51.752760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3834c6-0e87-48d7-a64a-e9536b294c09 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:51.855014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3834c6-0e87-48d7-a64a-e9536b294c09 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:51.888837 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5597dec-1767-415d-8e38-73948813b86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:51.889580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5597dec-1767-415d-8e38-73948813b86e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:51.889782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5597dec-1767-415d-8e38-73948813b86e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:51.890042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5597dec-1767-415d-8e38-73948813b86e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:51.890913 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5597dec-1767-415d-8e38-73948813b86e None admin] RBAC: Adding query filter params (interface=public, service_id=913ba423918f40f99fefaf93dde1c4ea, region_id=RegionOne) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:51.891269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5597dec-1767-415d-8e38-73948813b86e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:51.892610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5597dec-1767-415d-8e38-73948813b86e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:51.902245 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 518/1040] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jul 6 20:29:51 2022] GET /identity/v3/endpoints?service_id=913ba423918f40f99fefaf93dde1c4ea&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:51.903452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086361f6-1eea-413b-aeca-bcad135eb914 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:51.982229 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:52.010085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086361f6-1eea-413b-aeca-bcad135eb914 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:52.022170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b165f-56c2-464e-8e4b-b8cbea748c9a None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:52.022722 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b165f-56c2-464e-8e4b-b8cbea748c9a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:52.023002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b165f-56c2-464e-8e4b-b8cbea748c9a None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:52.024401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 519/1041] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:29:52.029311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed31dc5-8a7f-453b-b1bf-1351127d1ad9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:52.029603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed31dc5-8a7f-453b-b1bf-1351127d1ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:52.029888 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed31dc5-8a7f-453b-b1bf-1351127d1ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:52.048072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2ed31dc5-8a7f-453b-b1bf-1351127d1ad9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:52.049649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2ed31dc5-8a7f-453b-b1bf-1351127d1ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:52.050021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f41308-b3ba-48fe-b86a-d862ff97bd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:52.050694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f41308-b3ba-48fe-b86a-d862ff97bd16 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:52.050975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f41308-b3ba-48fe-b86a-d862ff97bd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:52.051275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f41308-b3ba-48fe-b86a-d862ff97bd16 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:52.051701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:52.051950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f41308-b3ba-48fe-b86a-d862ff97bd16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:52.053323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f41308-b3ba-48fe-b86a-d862ff97bd16 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:52.060633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 523/1042] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jul 6 20:29:51 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:29:52.141868 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 520/1043] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:52.167309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f41308-b3ba-48fe-b86a-d862ff97bd16 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:52.274505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f41308-b3ba-48fe-b86a-d862ff97bd16 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:52.309419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c3b33-a126-49b7-9add-d89cc64d979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:52.310272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3b33-a126-49b7-9add-d89cc64d979e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:52.310553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3b33-a126-49b7-9add-d89cc64d979e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:52.310878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3b33-a126-49b7-9add-d89cc64d979e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:52.312056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c3b33-a126-49b7-9add-d89cc64d979e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:52.314259 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c3b33-a126-49b7-9add-d89cc64d979e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:52.316127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 524/1044] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:52.321798 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed31dc5-8a7f-453b-b1bf-1351127d1ad9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:52.421658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed31dc5-8a7f-453b-b1bf-1351127d1ad9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:52.456547 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af2a58-8d11-4976-81a8-c4004169e021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:52.457500 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af2a58-8d11-4976-81a8-c4004169e021 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:52.457959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af2a58-8d11-4976-81a8-c4004169e021 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:52.458423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af2a58-8d11-4976-81a8-c4004169e021 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:52.459340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af2a58-8d11-4976-81a8-c4004169e021 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:52.460950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af2a58-8d11-4976-81a8-c4004169e021 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:52.470838 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:52.488376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 521/1045] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:29:52 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:29:53.094532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021423-7777-428a-9626-cdc0d56bc836 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:53.095051 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021423-7777-428a-9626-cdc0d56bc836 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:53.095129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021423-7777-428a-9626-cdc0d56bc836 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:53.096525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 525/1046] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:53.101651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e559e8-39d3-4b19-8552-804085eed1cf None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:53.102049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e559e8-39d3-4b19-8552-804085eed1cf None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:53.102221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e559e8-39d3-4b19-8552-804085eed1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:53.119453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-87e559e8-39d3-4b19-8552-804085eed1cf None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:53.120633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-87e559e8-39d3-4b19-8552-804085eed1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:53.195678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 522/1047] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:53.218311 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021423-7777-428a-9626-cdc0d56bc836 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:53.228757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:53.325762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021423-7777-428a-9626-cdc0d56bc836 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:53.358363 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39bc56-b838-4c7e-ac32-20409233ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:53.359104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39bc56-b838-4c7e-ac32-20409233ffbe None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:53.359576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39bc56-b838-4c7e-ac32-20409233ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:53.360392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39bc56-b838-4c7e-ac32-20409233ffbe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:53.370587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39bc56-b838-4c7e-ac32-20409233ffbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4d39bc56-b838-4c7e-ac32-20409233ffbe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:53.379200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:53.380126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:53.385969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:53.385969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:53.385969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:53.385969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:53.385969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:53.385969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:53.385969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:53.385969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:53.385969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:53.385969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:53.385969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:29:53.385969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:53.385969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 526/1048] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Jul 6 20:29:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:53.388168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e559e8-39d3-4b19-8552-804085eed1cf None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:53.490457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e559e8-39d3-4b19-8552-804085eed1cf None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:53.513711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:53.527296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69a887-38e6-4324-b522-9438b2297c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:53.527973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69a887-38e6-4324-b522-9438b2297c14 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:53.528262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69a887-38e6-4324-b522-9438b2297c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:53.528541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69a887-38e6-4324-b522-9438b2297c14 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:53.529286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69a887-38e6-4324-b522-9438b2297c14 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:53.529595 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69a887-38e6-4324-b522-9438b2297c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:53.530962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69a887-38e6-4324-b522-9438b2297c14 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:53.544037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 523/1049] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jul 6 20:29:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:53.545588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39bc56-b838-4c7e-ac32-20409233ffbe None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:53.617662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:53.654867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39bc56-b838-4c7e-ac32-20409233ffbe None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:53.692824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106e91f-85b6-4c80-ab8b-9c5375cbe79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:53.693618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106e91f-85b6-4c80-ab8b-9c5375cbe79f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:53.693898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106e91f-85b6-4c80-ab8b-9c5375cbe79f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:53.694172 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106e91f-85b6-4c80-ab8b-9c5375cbe79f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:53.704569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106e91f-85b6-4c80-ab8b-9c5375cbe79f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:53.706021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106e91f-85b6-4c80-ab8b-9c5375cbe79f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9106e91f-85b6-4c80-ab8b-9c5375cbe79f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:53.723323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:53.724204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:53.725093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:53.725093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:53.725093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:53.725093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:53.727488 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 527/1050] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:53.730319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69a887-38e6-4324-b522-9438b2297c14 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:53.831180 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69a887-38e6-4324-b522-9438b2297c14 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:53.867477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b79b-028b-4b1c-b27e-4f3eadb155cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:53.868192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b79b-028b-4b1c-b27e-4f3eadb155cd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:53.868418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b79b-028b-4b1c-b27e-4f3eadb155cd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:53.868693 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b79b-028b-4b1c-b27e-4f3eadb155cd None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:53.869405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749b79b-028b-4b1c-b27e-4f3eadb155cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:53.869711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749b79b-028b-4b1c-b27e-4f3eadb155cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:53.871064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749b79b-028b-4b1c-b27e-4f3eadb155cd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:53.884944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 524/1051] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:53.890445 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106e91f-85b6-4c80-ab8b-9c5375cbe79f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:53.989444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106e91f-85b6-4c80-ab8b-9c5375cbe79f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:54.006675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:54.025351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf127156-b284-4613-9b99-4ff92aef6562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:54.026144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf127156-b284-4613-9b99-4ff92aef6562 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:54.026427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf127156-b284-4613-9b99-4ff92aef6562 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:54.026702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf127156-b284-4613-9b99-4ff92aef6562 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:54.034362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf127156-b284-4613-9b99-4ff92aef6562 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:54.035831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf127156-b284-4613-9b99-4ff92aef6562 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-bf127156-b284-4613-9b99-4ff92aef6562 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:54.050104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:54.051063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:54.052046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:54.052046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:54.052046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:54.052046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:54.052046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:54.052046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:54.052046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:54.052046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:54.052046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:54.052046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:54.055521 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 528/1052] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jul 6 20:29:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:54.057200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b79b-028b-4b1c-b27e-4f3eadb155cd None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:54.104961 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:54.117936 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf2284-7ac9-4540-978a-ce0ca6292caa None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:54.118494 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf2284-7ac9-4540-978a-ce0ca6292caa None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:54.118494 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf2284-7ac9-4540-978a-ce0ca6292caa None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:54.120036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 529/1053] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:54.124756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ef624-1815-4382-8179-f368033a7d73 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:54.125051 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ef624-1815-4382-8179-f368033a7d73 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:54.125341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ef624-1815-4382-8179-f368033a7d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:54.143120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a90ef624-1815-4382-8179-f368033a7d73 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:54.144360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a90ef624-1815-4382-8179-f368033a7d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:54.165585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b79b-028b-4b1c-b27e-4f3eadb155cd None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:54.202414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e1c04-a136-4f2d-b251-5c2d305e95b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:54.203086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e1c04-a136-4f2d-b251-5c2d305e95b2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:54.203393 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e1c04-a136-4f2d-b251-5c2d305e95b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:54.203718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e1c04-a136-4f2d-b251-5c2d305e95b2 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:54.205034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e1c04-a136-4f2d-b251-5c2d305e95b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:54.205146 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e1c04-a136-4f2d-b251-5c2d305e95b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:54.206574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e1c04-a136-4f2d-b251-5c2d305e95b2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:54.216270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 530/1054] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:54.225350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 525/1055] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jul 6 20:29:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:54.230814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ef624-1815-4382-8179-f368033a7d73 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:54.239610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e1c04-a136-4f2d-b251-5c2d305e95b2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:54.337638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ef624-1815-4382-8179-f368033a7d73 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:54.346711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e1c04-a136-4f2d-b251-5c2d305e95b2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:54.347783 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:54.349069 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:54.377766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ede49-47d7-4ee3-b16f-02b4204ad4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:54.378478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ede49-47d7-4ee3-b16f-02b4204ad4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:54.378763 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ede49-47d7-4ee3-b16f-02b4204ad4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:54.379045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ede49-47d7-4ee3-b16f-02b4204ad4e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:54.383898 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12521267-9916-45eb-9780-75c587c05c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:54.384916 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12521267-9916-45eb-9780-75c587c05c8b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:54.385379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12521267-9916-45eb-9780-75c587c05c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:54.385846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12521267-9916-45eb-9780-75c587c05c8b None admin] PATH_INFO: `/v3/services/image` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:54.386497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12521267-9916-45eb-9780-75c587c05c8b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:54.387895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12521267-9916-45eb-9780-75c587c05c8b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:54.389518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ede49-47d7-4ee3-b16f-02b4204ad4e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:54.391501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ede49-47d7-4ee3-b16f-02b4204ad4e8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-12521267-9916-45eb-9780-75c587c05c8b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:54.400780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:54.401749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 20:29:54.402598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:54.409494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 526/1056] 10.222.0.33 () {56 vars in 1105 bytes} [Wed Jul 6 20:29:54 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-701ede49-47d7-4ee3-b16f-02b4204ad4e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:54.409626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:54.410452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:54.411372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:54.411372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:54.411372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:54.411372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:54.411596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12521267-9916-45eb-9780-75c587c05c8b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:54.411667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 531/1057] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:54.416194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ede49-47d7-4ee3-b16f-02b4204ad4e8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:54.525320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12521267-9916-45eb-9780-75c587c05c8b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:54.525995 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ede49-47d7-4ee3-b16f-02b4204ad4e8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:54.559521 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73126be6-b99a-4b43-94aa-7e8ad44eec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:54.560186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126be6-b99a-4b43-94aa-7e8ad44eec18 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:54.560469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126be6-b99a-4b43-94aa-7e8ad44eec18 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:54.560744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126be6-b99a-4b43-94aa-7e8ad44eec18 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:54.561433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73126be6-b99a-4b43-94aa-7e8ad44eec18 None admin] RBAC: Adding query filter params (name=image) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:54.561740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73126be6-b99a-4b43-94aa-7e8ad44eec18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:54.563313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73126be6-b99a-4b43-94aa-7e8ad44eec18 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:54.564150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526e2b2-22c9-4a4e-af3e-ccb051da1e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:54.564825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526e2b2-22c9-4a4e-af3e-ccb051da1e6c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:54.565112 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526e2b2-22c9-4a4e-af3e-ccb051da1e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:54.565399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526e2b2-22c9-4a4e-af3e-ccb051da1e6c None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:54.566121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526e2b2-22c9-4a4e-af3e-ccb051da1e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:54.566433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526e2b2-22c9-4a4e-af3e-ccb051da1e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:54.567827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526e2b2-22c9-4a4e-af3e-ccb051da1e6c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:54.568859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 527/1058] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:54.574329 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73126be6-b99a-4b43-94aa-7e8ad44eec18 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:54.587467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 532/1059] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:54.588389 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526e2b2-22c9-4a4e-af3e-ccb051da1e6c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:54.614071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:54.614576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:54.683017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73126be6-b99a-4b43-94aa-7e8ad44eec18 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:54.695648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526e2b2-22c9-4a4e-af3e-ccb051da1e6c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:54.716542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f3720-9fff-497f-a0a1-de3736033d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:54.717201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f3720-9fff-497f-a0a1-de3736033d69 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:54.717494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f3720-9fff-497f-a0a1-de3736033d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:54.717774 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f3720-9fff-497f-a0a1-de3736033d69 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:54.718473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f3720-9fff-497f-a0a1-de3736033d69 None admin] RBAC: Adding query filter params (type=image) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:54.718783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f3720-9fff-497f-a0a1-de3736033d69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:54.720818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f3720-9fff-497f-a0a1-de3736033d69 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:54.725600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 528/1060] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:54.726794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058af9-ae89-4627-b374-19ceee8a7250 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:54.727085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058af9-ae89-4627-b374-19ceee8a7250 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:54.727394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058af9-ae89-4627-b374-19ceee8a7250 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:54.728622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 529/1061] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:54.731099 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62058af9-ae89-4627-b374-19ceee8a7250 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:54.731922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a73338-cf3a-4cab-afa7-2a32c63e1082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:54.732813 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a73338-cf3a-4cab-afa7-2a32c63e1082 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:54.733097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a73338-cf3a-4cab-afa7-2a32c63e1082 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:54.733375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a73338-cf3a-4cab-afa7-2a32c63e1082 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:54.741731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a73338-cf3a-4cab-afa7-2a32c63e1082 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:54.743201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a73338-cf3a-4cab-afa7-2a32c63e1082 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-77a73338-cf3a-4cab-afa7-2a32c63e1082 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:54.757718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:54.758756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:54.764893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:54.764893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:54.764893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:54.764893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:54.764893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:54.764893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:54.764893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:54.764893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:54.764893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 533/1062] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:54.764893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33920cdb-228f-4efb-847e-d22bd3da4e7e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:54.764893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33920cdb-228f-4efb-847e-d22bd3da4e7e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:54.765651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33920cdb-228f-4efb-847e-d22bd3da4e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:54.778101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-33920cdb-228f-4efb-847e-d22bd3da4e7e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:54.779340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-33920cdb-228f-4efb-847e-d22bd3da4e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:54.827084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:54.834373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62058af9-ae89-4627-b374-19ceee8a7250 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:54.846514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 534/1063] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:54.847383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33920cdb-228f-4efb-847e-d22bd3da4e7e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:54.869868 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aba44c-d16f-4651-9fc0-e447545b2c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:54.870453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:54.870595 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba44c-d16f-4651-9fc0-e447545b2c6c None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:54.870795 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba44c-d16f-4651-9fc0-e447545b2c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:54.871075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba44c-d16f-4651-9fc0-e447545b2c6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:54.872215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aba44c-d16f-4651-9fc0-e447545b2c6c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:54.873578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aba44c-d16f-4651-9fc0-e447545b2c6c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:54.898278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 530/1064] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jul 6 20:29:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:29:54.898278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aba44c-d16f-4651-9fc0-e447545b2c6c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:54.979703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33920cdb-228f-4efb-847e-d22bd3da4e7e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:55.013298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aba44c-d16f-4651-9fc0-e447545b2c6c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:55.019687 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6402-4cdb-41e7-b110-4a3d65f53534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:55.020416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6402-4cdb-41e7-b110-4a3d65f53534 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:55.020707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6402-4cdb-41e7-b110-4a3d65f53534 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:55.020981 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6402-4cdb-41e7-b110-4a3d65f53534 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:55.021784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e6402-4cdb-41e7-b110-4a3d65f53534 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:55.022944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e6402-4cdb-41e7-b110-4a3d65f53534 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:55.024937 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e6402-4cdb-41e7-b110-4a3d65f53534 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:55.043224 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 535/1065] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:55.046111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6402-4cdb-41e7-b110-4a3d65f53534 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:55.053576 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ada486-4866-4a07-b99c-80797598282a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:55.054385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ada486-4866-4a07-b99c-80797598282a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:55.055226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ada486-4866-4a07-b99c-80797598282a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:55.055490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ada486-4866-4a07-b99c-80797598282a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:55.070088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ada486-4866-4a07-b99c-80797598282a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-b9ada486-4866-4a07-b99c-80797598282a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:55.078376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:55.079941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:55.080983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:55.080983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:55.080983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:55.080983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:55.080983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:55.080983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:55.080983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:55.080983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:55.080983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:55.080983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:55.080983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:55.080983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:55.080983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 531/1066] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:29:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:29:55.086171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ada486-4866-4a07-b99c-80797598282a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:55.100268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:55.127241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:55.160630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6402-4cdb-41e7-b110-4a3d65f53534 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:55.197281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5efc9-d6da-451d-aa93-dd74e82f453e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:55.198176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5efc9-d6da-451d-aa93-dd74e82f453e None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:55.198463 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5efc9-d6da-451d-aa93-dd74e82f453e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:55.198737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5efc9-d6da-451d-aa93-dd74e82f453e None admin] PATH_INFO: `/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/3d68c8fdb65343b8b2f58070addeaf13/roles/f352a777e52940a99a854c673ce45f28` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:55.200793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ada486-4866-4a07-b99c-80797598282a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:55.201281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5efc9-d6da-451d-aa93-dd74e82f453e None admin] RBAC: Authorizing `identity:create_grant(project_id=8eda6c9cf4b1439eb280b0db35b3bce2, user_id=3d68c8fdb65343b8b2f58070addeaf13, role_id=f352a777e52940a99a854c673ce45f28)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:55.202470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5efc9-d6da-451d-aa93-dd74e82f453e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:55.227200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 536/1067] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:29:55 2022] PUT /identity/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/3d68c8fdb65343b8b2f58070addeaf13/roles/f352a777e52940a99a854c673ce45f28 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:29:55.249546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9985acc-3eb8-4755-ba23-7bd24e105dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:55.250250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9985acc-3eb8-4755-ba23-7bd24e105dfe None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:55.251458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9985acc-3eb8-4755-ba23-7bd24e105dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:55.251822 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9985acc-3eb8-4755-ba23-7bd24e105dfe None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:55.252676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9985acc-3eb8-4755-ba23-7bd24e105dfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:55.253062 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9985acc-3eb8-4755-ba23-7bd24e105dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:55.254561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9985acc-3eb8-4755-ba23-7bd24e105dfe None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:55.269670 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 532/1068] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:29:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:55.271421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5efc9-d6da-451d-aa93-dd74e82f453e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:55.383909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5efc9-d6da-451d-aa93-dd74e82f453e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:55.414025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:55.421648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d11736-c518-4946-9150-fe2aa1d41f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:55.422628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d11736-c518-4946-9150-fe2aa1d41f35 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:55.423146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d11736-c518-4946-9150-fe2aa1d41f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:55.423482 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d11736-c518-4946-9150-fe2aa1d41f35 None admin] PATH_INFO: `/v3/users/a9d0202b062a4af59f6680b26ff43fb8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:55.438472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d11736-c518-4946-9150-fe2aa1d41f35 None admin] RBAC: Authorizing `identity:get_user(user_id=a9d0202b062a4af59f6680b26ff43fb8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:55.440020 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d11736-c518-4946-9150-fe2aa1d41f35 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:55.446379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 537/1069] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:29:55 2022] GET /identity/v3/users/a9d0202b062a4af59f6680b26ff43fb8 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:55.447795 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9985acc-3eb8-4755-ba23-7bd24e105dfe None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:55.520219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:55.553758 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9985acc-3eb8-4755-ba23-7bd24e105dfe None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:55.593451 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2f5dd-554e-46c8-844c-9a397c0c8e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:55.594113 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2f5dd-554e-46c8-844c-9a397c0c8e1f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:55.594981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2f5dd-554e-46c8-844c-9a397c0c8e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:55.595276 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2f5dd-554e-46c8-844c-9a397c0c8e1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:55.664168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2f5dd-554e-46c8-844c-9a397c0c8e1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:55.665613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2f5dd-554e-46c8-844c-9a397c0c8e1f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:55.733444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:55.771962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 533/1070] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:29:55.773976 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d11736-c518-4946-9150-fe2aa1d41f35 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:55.873323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d11736-c518-4946-9150-fe2aa1d41f35 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:55.907549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1790a62-72f9-40b1-8780-436f469ddff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:55.908406 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1790a62-72f9-40b1-8780-436f469ddff0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:55.908689 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1790a62-72f9-40b1-8780-436f469ddff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:55.908965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1790a62-72f9-40b1-8780-436f469ddff0 None admin] PATH_INFO: `/v3/projects/5693d56a32144994a915cdc5d76ce431` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:55.910137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1790a62-72f9-40b1-8780-436f469ddff0 None admin] RBAC: Authorizing `identity:get_project(project_id=5693d56a32144994a915cdc5d76ce431)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:55.911596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1790a62-72f9-40b1-8780-436f469ddff0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:55.913447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 538/1071] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:29:55 2022] GET /identity/v3/projects/5693d56a32144994a915cdc5d76ce431 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:55.919409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2f5dd-554e-46c8-844c-9a397c0c8e1f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:56.021935 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2f5dd-554e-46c8-844c-9a397c0c8e1f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:56.057661 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b594b9-2c8a-4c0d-b89f-9966fbc01cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:56.058321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b594b9-2c8a-4c0d-b89f-9966fbc01cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:56.058603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b594b9-2c8a-4c0d-b89f-9966fbc01cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:56.058877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b594b9-2c8a-4c0d-b89f-9966fbc01cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:56.059724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b594b9-2c8a-4c0d-b89f-9966fbc01cc3 None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=5693d56a32144994a915cdc5d76ce431, user.id=a9d0202b062a4af59f6680b26ff43fb8) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:56.060037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b594b9-2c8a-4c0d-b89f-9966fbc01cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:56.061451 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b594b9-2c8a-4c0d-b89f-9966fbc01cc3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:56.075274 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 534/1072] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:55 2022] GET /identity/v3/role_assignments?user.id=a9d0202b062a4af59f6680b26ff43fb8&scope.project.id=5693d56a32144994a915cdc5d76ce431&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:56.986300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2944388-757c-42b1-a45e-e3dda18477dd None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:56.986790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2944388-757c-42b1-a45e-e3dda18477dd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:56.986790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2944388-757c-42b1-a45e-e3dda18477dd None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:56.988222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 539/1073] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:29:56.993293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404e3f-e70e-4292-b171-d1077f599355 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:56.993707 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404e3f-e70e-4292-b171-d1077f599355 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:56.993875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404e3f-e70e-4292-b171-d1077f599355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:57.012372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b8404e3f-e70e-4292-b171-d1077f599355 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:57.013580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b8404e3f-e70e-4292-b171-d1077f599355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:57.042138 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:57.084734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 535/1074] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:29:57.107252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2944388-757c-42b1-a45e-e3dda18477dd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:57.167913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:57.214776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2944388-757c-42b1-a45e-e3dda18477dd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:57.247977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5fae5-1844-4bbc-b496-c7a83b81f177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:57.248554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5fae5-1844-4bbc-b496-c7a83b81f177 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:57.248835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5fae5-1844-4bbc-b496-c7a83b81f177 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:57.249107 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5fae5-1844-4bbc-b496-c7a83b81f177 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:57.290982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589061b-4ef0-490a-9a94-3533f46062e7 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:57.291314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589061b-4ef0-490a-9a94-3533f46062e7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:57.291581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589061b-4ef0-490a-9a94-3533f46062e7 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:57.293095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 536/1075] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:29:57.298324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951055b-547a-4cc6-b2a1-9b745d9c91d0 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:57.298614 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951055b-547a-4cc6-b2a1-9b745d9c91d0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:57.298895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951055b-547a-4cc6-b2a1-9b745d9c91d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:57.316632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b951055b-547a-4cc6-b2a1-9b745d9c91d0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:57.317821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b951055b-547a-4cc6-b2a1-9b745d9c91d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:57.319610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5fae5-1844-4bbc-b496-c7a83b81f177 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:57.321024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5fae5-1844-4bbc-b496-c7a83b81f177 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:57.378071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:57.386109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 537/1076] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:57.409460 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951055b-547a-4cc6-b2a1-9b745d9c91d0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:57.427563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 540/1077] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:29:57.430234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5fae5-1844-4bbc-b496-c7a83b81f177 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:57.509874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:57.518871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951055b-547a-4cc6-b2a1-9b745d9c91d0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:57.536320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5fae5-1844-4bbc-b496-c7a83b81f177 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:57.556798 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c40d18-a128-41c8-9548-45fd4d18475e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:57.557619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c40d18-a128-41c8-9548-45fd4d18475e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:57.558326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c40d18-a128-41c8-9548-45fd4d18475e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:57.558614 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c40d18-a128-41c8-9548-45fd4d18475e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:57.569763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c40d18-a128-41c8-9548-45fd4d18475e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:57.572468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87981-da94-46fd-8718-e9b1eeadadd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:57.573262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87981-da94-46fd-8718-e9b1eeadadd0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:57.573545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87981-da94-46fd-8718-e9b1eeadadd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:57.573820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87981-da94-46fd-8718-e9b1eeadadd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-a5c40d18-a128-41c8-9548-45fd4d18475e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:57.578340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:57.580368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:57.581214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:57.581214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:57.581214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:57.581214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:57.581214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:57.581214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:57.581214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:57.581214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:57.581214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:57.581214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:57.581214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 20:29:57.581214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:57.586803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 538/1078] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Jul 6 20:29:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:57.586803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c40d18-a128-41c8-9548-45fd4d18475e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:57.593595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e87981-da94-46fd-8718-e9b1eeadadd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:57.593595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e87981-da94-46fd-8718-e9b1eeadadd0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-14e87981-da94-46fd-8718-e9b1eeadadd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:57.610785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:57.612048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:57.612939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:57.612939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:57.612939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:57.612939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:57.612939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 541/1079] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:57.617955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87981-da94-46fd-8718-e9b1eeadadd0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:57.628938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:57.705101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c40d18-a128-41c8-9548-45fd4d18475e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:57.727395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87981-da94-46fd-8718-e9b1eeadadd0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:57.740025 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b51692-e46e-4ba1-9a5d-d49787abbb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:57.740800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b51692-e46e-4ba1-9a5d-d49787abbb17 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:57.741090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b51692-e46e-4ba1-9a5d-d49787abbb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:57.741369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b51692-e46e-4ba1-9a5d-d49787abbb17 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:57.742114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b51692-e46e-4ba1-9a5d-d49787abbb17 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:57.742427 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b51692-e46e-4ba1-9a5d-d49787abbb17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:57.743837 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b51692-e46e-4ba1-9a5d-d49787abbb17 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:57.752788 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 539/1080] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jul 6 20:29:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:57.758289 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b51692-e46e-4ba1-9a5d-d49787abbb17 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:57.769750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df295b-5a70-4f14-8460-16425a765eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:57.770351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df295b-5a70-4f14-8460-16425a765eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:57.770640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df295b-5a70-4f14-8460-16425a765eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:57.770928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df295b-5a70-4f14-8460-16425a765eb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:57.771686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df295b-5a70-4f14-8460-16425a765eb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:57.772075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df295b-5a70-4f14-8460-16425a765eb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:57.773640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df295b-5a70-4f14-8460-16425a765eb2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:57.777802 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:57.786798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 542/1081] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:57.872252 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b51692-e46e-4ba1-9a5d-d49787abbb17 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:57.909268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b31582-5aa6-4995-b458-f92d430838b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:57.910080 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b31582-5aa6-4995-b458-f92d430838b5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:57.910369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b31582-5aa6-4995-b458-f92d430838b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:57.910637 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b31582-5aa6-4995-b458-f92d430838b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:57.922388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b31582-5aa6-4995-b458-f92d430838b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:57.924372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b31582-5aa6-4995-b458-f92d430838b5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-42b31582-5aa6-4995-b458-f92d430838b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:57.943411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:57.944374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:57.945264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:57.945264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:57.945264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:57.945264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:57.945264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 540/1082] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:57.950549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df295b-5a70-4f14-8460-16425a765eb2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:58.026831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:58.064059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df295b-5a70-4f14-8460-16425a765eb2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:58.093083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cffde1-8a63-4038-8544-fea9a6ecc681 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:58.093614 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cffde1-8a63-4038-8544-fea9a6ecc681 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:58.093710 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cffde1-8a63-4038-8544-fea9a6ecc681 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:58.095652 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 541/1083] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:29:58.100444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89a1a5-0b42-46c1-b0d1-7703b1fa2ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:58.100797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f4266-a128-4f53-aaf9-89ca33dd894d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:58.101086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f4266-a128-4f53-aaf9-89ca33dd894d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:58.101180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89a1a5-0b42-46c1-b0d1-7703b1fa2ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:58.101363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f4266-a128-4f53-aaf9-89ca33dd894d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:58.101454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89a1a5-0b42-46c1-b0d1-7703b1fa2ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:58.101649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89a1a5-0b42-46c1-b0d1-7703b1fa2ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:58.102376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89a1a5-0b42-46c1-b0d1-7703b1fa2ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:58.102686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89a1a5-0b42-46c1-b0d1-7703b1fa2ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:58.104080 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89a1a5-0b42-46c1-b0d1-7703b1fa2ee0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:58.118477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 543/1084] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:58.119780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-456f4266-a128-4f53-aaf9-89ca33dd894d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:29:58.120984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-456f4266-a128-4f53-aaf9-89ca33dd894d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:29:58.123969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89a1a5-0b42-46c1-b0d1-7703b1fa2ee0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:58.184244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:58.190165 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 542/1085] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:29:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:29:58.212548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f4266-a128-4f53-aaf9-89ca33dd894d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:58.221970 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89a1a5-0b42-46c1-b0d1-7703b1fa2ee0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:58.247673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:58.256170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb51b6f-e862-4a1e-95f4-79054dcb9fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:58.256989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb51b6f-e862-4a1e-95f4-79054dcb9fec None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:58.257315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb51b6f-e862-4a1e-95f4-79054dcb9fec None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:58.257560 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb51b6f-e862-4a1e-95f4-79054dcb9fec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:58.264575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb51b6f-e862-4a1e-95f4-79054dcb9fec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:58.266052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb51b6f-e862-4a1e-95f4-79054dcb9fec None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-afb51b6f-e862-4a1e-95f4-79054dcb9fec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:29:58.281166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:58.282760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:58.283815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:58.283815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:58.283815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:29:58.283815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:29:58.283815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:29:58.283815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:29:58.283815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:29:58.283815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:29:58.283815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 20:29:58.283815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:58.283815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 544/1086] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jul 6 20:29:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:58.288688 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb51b6f-e862-4a1e-95f4-79054dcb9fec None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:58.314917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f4266-a128-4f53-aaf9-89ca33dd894d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:58.354632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4e6ea-c6ab-4140-8de2-8191d2a2a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:58.355451 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4e6ea-c6ab-4140-8de2-8191d2a2a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:58.355734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4e6ea-c6ab-4140-8de2-8191d2a2a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:58.356011 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4e6ea-c6ab-4140-8de2-8191d2a2a9f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:58.366650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4e6ea-c6ab-4140-8de2-8191d2a2a9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-12d4e6ea-c6ab-4140-8de2-8191d2a2a9f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:29:58.374155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:58.375156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:58.376611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:58.376611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:58.376611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:58.376611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:58.376611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:29:58.376611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:29:58.376611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:29:58.376611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:29:58.376611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:29:58.376611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:29:58.376611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:29:58.376611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:58.376611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 543/1087] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:29:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:58.381929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4e6ea-c6ab-4140-8de2-8191d2a2a9f2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:58.392181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb51b6f-e862-4a1e-95f4-79054dcb9fec None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:58.426007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8df39-fa78-4d62-937a-10ddbbb92761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:58.426741 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8df39-fa78-4d62-937a-10ddbbb92761 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:58.426944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8df39-fa78-4d62-937a-10ddbbb92761 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:58.427253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8df39-fa78-4d62-937a-10ddbbb92761 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:58.428081 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8df39-fa78-4d62-937a-10ddbbb92761 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:58.428388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8df39-fa78-4d62-937a-10ddbbb92761 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:58.429808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8df39-fa78-4d62-937a-10ddbbb92761 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:58.439249 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:58.446986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 545/1088] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jul 6 20:29:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:58.452710 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8df39-fa78-4d62-937a-10ddbbb92761 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:58.482359 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4e6ea-c6ab-4140-8de2-8191d2a2a9f2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:58.498705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:58.515444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77df68-129e-4c48-b507-26bca4d29b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:58.516102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77df68-129e-4c48-b507-26bca4d29b8c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:58.516469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77df68-129e-4c48-b507-26bca4d29b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:58.516751 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77df68-129e-4c48-b507-26bca4d29b8c None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:58.517548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77df68-129e-4c48-b507-26bca4d29b8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:58.517855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77df68-129e-4c48-b507-26bca4d29b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:58.519222 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77df68-129e-4c48-b507-26bca4d29b8c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:58.527639 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 544/1089] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:29:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:58.534160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77df68-129e-4c48-b507-26bca4d29b8c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:58.552332 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8df39-fa78-4d62-937a-10ddbbb92761 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:58.586150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331474ce-7f24-4160-b570-6307106e73a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:58.586830 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331474ce-7f24-4160-b570-6307106e73a6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:58.587119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331474ce-7f24-4160-b570-6307106e73a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:58.587420 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331474ce-7f24-4160-b570-6307106e73a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:58.632691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77df68-129e-4c48-b507-26bca4d29b8c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:58.657854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:58.661408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331474ce-7f24-4160-b570-6307106e73a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:58.662913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331474ce-7f24-4160-b570-6307106e73a6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:58.674622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090993fa-7080-451e-8c58-53c5d88d6b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:58.675568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090993fa-7080-451e-8c58-53c5d88d6b5c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:58.675854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090993fa-7080-451e-8c58-53c5d88d6b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:58.676142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090993fa-7080-451e-8c58-53c5d88d6b5c None admin] PATH_INFO: `/v3/users/a9d0202b062a4af59f6680b26ff43fb8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:58.677343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090993fa-7080-451e-8c58-53c5d88d6b5c None admin] RBAC: Authorizing `identity:get_user(user_id=a9d0202b062a4af59f6680b26ff43fb8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:58.678838 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090993fa-7080-451e-8c58-53c5d88d6b5c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:58.680429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 545/1090] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:29:58 2022] GET /identity/v3/users/a9d0202b062a4af59f6680b26ff43fb8 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:58.686319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090993fa-7080-451e-8c58-53c5d88d6b5c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:58.714025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:58.768423 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 546/1091] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:29:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 20:29:58.774324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331474ce-7f24-4160-b570-6307106e73a6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:58.786934 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090993fa-7080-451e-8c58-53c5d88d6b5c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:58.821535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b753b-8b39-483e-bb22-1c3500a2dc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:58.822387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b753b-8b39-483e-bb22-1c3500a2dc86 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:58.822673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b753b-8b39-483e-bb22-1c3500a2dc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:58.822950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b753b-8b39-483e-bb22-1c3500a2dc86 None admin] PATH_INFO: `/v3/projects/5693d56a32144994a915cdc5d76ce431` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:58.824160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b753b-8b39-483e-bb22-1c3500a2dc86 None admin] RBAC: Authorizing `identity:get_project(project_id=5693d56a32144994a915cdc5d76ce431)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:58.825580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b753b-8b39-483e-bb22-1c3500a2dc86 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:58.827542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 546/1092] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:29:58 2022] GET /identity/v3/projects/5693d56a32144994a915cdc5d76ce431 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:58.834171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b753b-8b39-483e-bb22-1c3500a2dc86 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:58.870679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331474ce-7f24-4160-b570-6307106e73a6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:58.889085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:58.905274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826b5bf-655f-49ee-9804-c8ba6c2e44f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:58.906056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826b5bf-655f-49ee-9804-c8ba6c2e44f9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:58.906338 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826b5bf-655f-49ee-9804-c8ba6c2e44f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:58.906610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826b5bf-655f-49ee-9804-c8ba6c2e44f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:58.916367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826b5bf-655f-49ee-9804-c8ba6c2e44f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:58.917798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826b5bf-655f-49ee-9804-c8ba6c2e44f9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:58.924749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:58.935246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b753b-8b39-483e-bb22-1c3500a2dc86 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2826b5bf-655f-49ee-9804-c8ba6c2e44f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:29:58.936228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:58.937252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:58.939935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:29:58.939935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:29:58.939935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:29:58.939935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:29:58.939935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 547/1093] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:58.943625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826b5bf-655f-49ee-9804-c8ba6c2e44f9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:58.974482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77bba5-68a0-455d-8081-f75798bd9a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:58.975402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77bba5-68a0-455d-8081-f75798bd9a04 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:58.975689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77bba5-68a0-455d-8081-f75798bd9a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:58.975967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77bba5-68a0-455d-8081-f75798bd9a04 None admin] PATH_INFO: `/v3/projects/5693d56a32144994a915cdc5d76ce431/users/a9d0202b062a4af59f6680b26ff43fb8/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:58.977966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77bba5-68a0-455d-8081-f75798bd9a04 None admin] RBAC: Authorizing `identity:create_grant(project_id=5693d56a32144994a915cdc5d76ce431, user_id=a9d0202b062a4af59f6680b26ff43fb8, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:58.979422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77bba5-68a0-455d-8081-f75798bd9a04 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:58.992769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 547/1094] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:29:58 2022] PUT /identity/v3/projects/5693d56a32144994a915cdc5d76ce431/users/a9d0202b062a4af59f6680b26ff43fb8/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:29:59.053276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826b5bf-655f-49ee-9804-c8ba6c2e44f9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:59.090611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff326f26-7868-451d-900a-94f289d785a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:59.091313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff326f26-7868-451d-900a-94f289d785a3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:59.091600 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff326f26-7868-451d-900a-94f289d785a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:59.091876 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff326f26-7868-451d-900a-94f289d785a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:59.092612 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff326f26-7868-451d-900a-94f289d785a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:59.092923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff326f26-7868-451d-900a-94f289d785a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:59.094395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff326f26-7868-451d-900a-94f289d785a3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:59.107844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 548/1095] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:29:59.114353 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77bba5-68a0-455d-8081-f75798bd9a04 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:59.218832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77bba5-68a0-455d-8081-f75798bd9a04 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:59.234256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:59.253636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427003e-4b60-4076-aca5-f5c98195de45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:59.254428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427003e-4b60-4076-aca5-f5c98195de45 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:59.254711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427003e-4b60-4076-aca5-f5c98195de45 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:59.254986 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427003e-4b60-4076-aca5-f5c98195de45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:59.261611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427003e-4b60-4076-aca5-f5c98195de45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:59.263043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427003e-4b60-4076-aca5-f5c98195de45 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-2427003e-4b60-4076-aca5-f5c98195de45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:29:59.277205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:29:59.278114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:29:59.279259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:29:59.279259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:29:59.279259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:29:59.279259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:29:59.279259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:29:59.279259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:29:59.279259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:29:59.279259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:29:59.279259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 548/1096] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:29:59.284729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff326f26-7868-451d-900a-94f289d785a3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:59.342871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:29:59.385859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff326f26-7868-451d-900a-94f289d785a3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:59.419478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b39b51-2a3d-4150-82f9-15db4fbf91f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:59.420137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b39b51-2a3d-4150-82f9-15db4fbf91f8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:59.420421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b39b51-2a3d-4150-82f9-15db4fbf91f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:59.420697 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b39b51-2a3d-4150-82f9-15db4fbf91f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:59.421473 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b39b51-2a3d-4150-82f9-15db4fbf91f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:59.421782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b39b51-2a3d-4150-82f9-15db4fbf91f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:59.423371 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b39b51-2a3d-4150-82f9-15db4fbf91f8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:59.435163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 549/1097] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:29:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:29:59.441933 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427003e-4b60-4076-aca5-f5c98195de45 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:29:59.539865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427003e-4b60-4076-aca5-f5c98195de45 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:29:59.572815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6240fbe-6fbe-46a5-b75c-f7e11e79f23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:29:59.573463 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6240fbe-6fbe-46a5-b75c-f7e11e79f23a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:29:59.573774 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6240fbe-6fbe-46a5-b75c-f7e11e79f23a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:29:59.574050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6240fbe-6fbe-46a5-b75c-f7e11e79f23a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:29:59.574875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6240fbe-6fbe-46a5-b75c-f7e11e79f23a None admin] RBAC: Adding query filter params (role.id=f352a777e52940a99a854c673ce45f28, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=3d68c8fdb65343b8b2f58070addeaf13) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:29:59.575212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6240fbe-6fbe-46a5-b75c-f7e11e79f23a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:29:59.576641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6240fbe-6fbe-46a5-b75c-f7e11e79f23a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:29:59.583830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 549/1098] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:29:59 2022] GET /identity/v3/role_assignments?user.id=3d68c8fdb65343b8b2f58070addeaf13&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=f352a777e52940a99a854c673ce45f28 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:01.014183 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c729-e8fd-40f9-85b3-156f4a530dbe None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:01.014707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c729-e8fd-40f9-85b3-156f4a530dbe None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:01.014707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c729-e8fd-40f9-85b3-156f4a530dbe None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:01.016039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 550/1099] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:01.021403 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c50f1-86b1-444c-9c8a-d1b2892ea4de None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:01.021821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c50f1-86b1-444c-9c8a-d1b2892ea4de None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:01.021960 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c50f1-86b1-444c-9c8a-d1b2892ea4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:01.039022 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-de3c50f1-86b1-444c-9c8a-d1b2892ea4de None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:01.040217 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-de3c50f1-86b1-444c-9c8a-d1b2892ea4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:01.073182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:01.106080 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 550/1100] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:01.130496 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c729-e8fd-40f9-85b3-156f4a530dbe None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:01.228395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c729-e8fd-40f9-85b3-156f4a530dbe None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:01.246075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:01.262737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47411b8d-1d01-4fd4-9799-8cc9f7021140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:01.263542 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47411b8d-1d01-4fd4-9799-8cc9f7021140 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:01.263825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47411b8d-1d01-4fd4-9799-8cc9f7021140 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:01.264095 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47411b8d-1d01-4fd4-9799-8cc9f7021140 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:01.274145 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47411b8d-1d01-4fd4-9799-8cc9f7021140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-47411b8d-1d01-4fd4-9799-8cc9f7021140 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:30:01.282072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:30:01.283011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:30:01.283902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:30:01.283902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:30:01.283902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:30:01.283902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:30:01.283902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:30:01.283902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:30:01.283902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:30:01.283902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:30:01.283902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:30:01.283902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:30:01.283902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:01.283902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:30:01.283902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 551/1101] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:30:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:30:01.289341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c50f1-86b1-444c-9c8a-d1b2892ea4de None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:01.386322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c50f1-86b1-444c-9c8a-d1b2892ea4de None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:01.418645 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edeb942-a140-448f-a649-6b02719edaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:01.419320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeb942-a140-448f-a649-6b02719edaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:01.419606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeb942-a140-448f-a649-6b02719edaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:01.419882 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeb942-a140-448f-a649-6b02719edaa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:01.420617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edeb942-a140-448f-a649-6b02719edaa5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:01.420925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edeb942-a140-448f-a649-6b02719edaa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:01.422285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edeb942-a140-448f-a649-6b02719edaa5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:01.430763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 551/1102] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:30:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:01.436295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47411b8d-1d01-4fd4-9799-8cc9f7021140 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:01.537810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47411b8d-1d01-4fd4-9799-8cc9f7021140 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:01.570745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca57593-5a08-455e-a604-f3060b3b77cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:01.571617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca57593-5a08-455e-a604-f3060b3b77cf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:01.571909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca57593-5a08-455e-a604-f3060b3b77cf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:01.572191 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca57593-5a08-455e-a604-f3060b3b77cf None admin] PATH_INFO: `/v3/users/a9d0202b062a4af59f6680b26ff43fb8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:01.573364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca57593-5a08-455e-a604-f3060b3b77cf None admin] RBAC: Authorizing `identity:get_user(user_id=a9d0202b062a4af59f6680b26ff43fb8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:01.574797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca57593-5a08-455e-a604-f3060b3b77cf None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:01.576422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 552/1103] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:30:01 2022] GET /identity/v3/users/a9d0202b062a4af59f6680b26ff43fb8 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:01.582043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edeb942-a140-448f-a649-6b02719edaa5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:01.614876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:01.681962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edeb942-a140-448f-a649-6b02719edaa5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:01.713471 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267c845-eb79-44db-97e5-8e061048cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:01.714105 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267c845-eb79-44db-97e5-8e061048cdc3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:01.714388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267c845-eb79-44db-97e5-8e061048cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:01.714666 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267c845-eb79-44db-97e5-8e061048cdc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:01.778878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267c845-eb79-44db-97e5-8e061048cdc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:01.780350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267c845-eb79-44db-97e5-8e061048cdc3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:01.809410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:01.874992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 552/1104] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:30:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:30:01.881273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca57593-5a08-455e-a604-f3060b3b77cf None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:01.926188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:01.976706 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca57593-5a08-455e-a604-f3060b3b77cf None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:02.008662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0af135-935e-4ce7-a7d4-c0a9539e8983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:02.009503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0af135-935e-4ce7-a7d4-c0a9539e8983 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:02.009785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0af135-935e-4ce7-a7d4-c0a9539e8983 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:02.010059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0af135-935e-4ce7-a7d4-c0a9539e8983 None admin] PATH_INFO: `/v3/projects/5693d56a32144994a915cdc5d76ce431` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:02.011232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0af135-935e-4ce7-a7d4-c0a9539e8983 None admin] RBAC: Authorizing `identity:get_project(project_id=5693d56a32144994a915cdc5d76ce431)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:02.012649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0af135-935e-4ce7-a7d4-c0a9539e8983 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:02.014308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 553/1105] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:30:01 2022] GET /identity/v3/projects/5693d56a32144994a915cdc5d76ce431 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:02.020742 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267c845-eb79-44db-97e5-8e061048cdc3 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:02.117338 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267c845-eb79-44db-97e5-8e061048cdc3 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:02.145695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:02.151456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4eccd-9da4-4de0-8ca6-b9ffbdd4c103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:02.152107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4eccd-9da4-4de0-8ca6-b9ffbdd4c103 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:02.152395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4eccd-9da4-4de0-8ca6-b9ffbdd4c103 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:02.152683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4eccd-9da4-4de0-8ca6-b9ffbdd4c103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:02.153505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4eccd-9da4-4de0-8ca6-b9ffbdd4c103 None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=5693d56a32144994a915cdc5d76ce431, user.id=a9d0202b062a4af59f6680b26ff43fb8) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:02.153822 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4eccd-9da4-4de0-8ca6-b9ffbdd4c103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:02.155267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4eccd-9da4-4de0-8ca6-b9ffbdd4c103 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:02.161391 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 553/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:30:02 2022] GET /identity/v3/role_assignments?user.id=a9d0202b062a4af59f6680b26ff43fb8&scope.project.id=5693d56a32144994a915cdc5d76ce431&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:04.183749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959775e-16d4-4108-87c8-1669cba68b57 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:04.184280 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959775e-16d4-4108-87c8-1669cba68b57 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:04.184280 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959775e-16d4-4108-87c8-1669cba68b57 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:04.185675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 554/1107] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:04.190950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54155b7-4f59-46e2-a34c-d00fd931d4da None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:04.191385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54155b7-4f59-46e2-a34c-d00fd931d4da None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:04.191536 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54155b7-4f59-46e2-a34c-d00fd931d4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:04.208735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f54155b7-4f59-46e2-a34c-d00fd931d4da None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:04.209913 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f54155b7-4f59-46e2-a34c-d00fd931d4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:04.274553 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 554/1108] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:04.300316 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959775e-16d4-4108-87c8-1669cba68b57 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:04.405836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959775e-16d4-4108-87c8-1669cba68b57 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:04.418858 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:04.439676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee31d9f-221a-4363-a732-165064e1d7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:04.440392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31d9f-221a-4363-a732-165064e1d7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:04.440674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31d9f-221a-4363-a732-165064e1d7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:04.440949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31d9f-221a-4363-a732-165064e1d7d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:04.442241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee31d9f-221a-4363-a732-165064e1d7d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:04.443707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee31d9f-221a-4363-a732-165064e1d7d8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:04.445352 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 555/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:30:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:04.451097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54155b7-4f59-46e2-a34c-d00fd931d4da None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:04.546069 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54155b7-4f59-46e2-a34c-d00fd931d4da None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:04.570521 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:04.579382 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd78b67-7263-4f1c-86d0-cca26e94068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:04.580041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd78b67-7263-4f1c-86d0-cca26e94068a None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:04.580324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd78b67-7263-4f1c-86d0-cca26e94068a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:04.580599 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd78b67-7263-4f1c-86d0-cca26e94068a None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:04.581291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd78b67-7263-4f1c-86d0-cca26e94068a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:04.582705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd78b67-7263-4f1c-86d0-cca26e94068a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:04.606419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 555/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:30:04 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:06.657830 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7a192-e2cb-4725-8075-5ba790fec774 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:06.658398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7a192-e2cb-4725-8075-5ba790fec774 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:06.658398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7a192-e2cb-4725-8075-5ba790fec774 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:06.659760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 556/1111] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:06.664944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676776c2-87c2-4bf9-91b8-3b287aeee849 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:06.665339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676776c2-87c2-4bf9-91b8-3b287aeee849 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:06.665501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676776c2-87c2-4bf9-91b8-3b287aeee849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:06.682319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-676776c2-87c2-4bf9-91b8-3b287aeee849 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:06.683517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-676776c2-87c2-4bf9-91b8-3b287aeee849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:06.747479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 556/1112] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:06.770964 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7a192-e2cb-4725-8075-5ba790fec774 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:06.867950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7a192-e2cb-4725-8075-5ba790fec774 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:06.899855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa01b4a-595a-4adf-9689-5f19bfb544f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:06.900686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa01b4a-595a-4adf-9689-5f19bfb544f6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:06.900966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa01b4a-595a-4adf-9689-5f19bfb544f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:06.901239 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa01b4a-595a-4adf-9689-5f19bfb544f6 None admin] PATH_INFO: `/v3/roles/4f0522c790e94492976ef2674f85ad66` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:06.902673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa01b4a-595a-4adf-9689-5f19bfb544f6 None admin] RBAC: Authorizing `identity:get_role(role_id=4f0522c790e94492976ef2674f85ad66)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:06.904068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa01b4a-595a-4adf-9689-5f19bfb544f6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:06.905404 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 557/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:30:06 2022] GET /identity/v3/roles/4f0522c790e94492976ef2674f85ad66 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:06.911688 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676776c2-87c2-4bf9-91b8-3b287aeee849 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:07.007704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676776c2-87c2-4bf9-91b8-3b287aeee849 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:07.020262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:07.041813 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e2b94-c499-442a-b891-67e308512d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:07.042671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e2b94-c499-442a-b891-67e308512d89 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:07.042952 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e2b94-c499-442a-b891-67e308512d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:07.043253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e2b94-c499-442a-b891-67e308512d89 None admin] PATH_INFO: `/v3/users/fa95a3c1b25b4d12852ff96bab7e02af` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:07.056339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e2b94-c499-442a-b891-67e308512d89 None admin] RBAC: Authorizing `identity:get_user(user_id=fa95a3c1b25b4d12852ff96bab7e02af)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:07.057762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e2b94-c499-442a-b891-67e308512d89 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:07.059410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 557/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:30:06 2022] GET /identity/v3/users/fa95a3c1b25b4d12852ff96bab7e02af => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:07.065058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa01b4a-595a-4adf-9689-5f19bfb544f6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:07.113522 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:07.161874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa01b4a-595a-4adf-9689-5f19bfb544f6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:07.193126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb696d-505b-4096-bd4e-231828adebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:07.193762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb696d-505b-4096-bd4e-231828adebd4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:07.194047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb696d-505b-4096-bd4e-231828adebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:07.194326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb696d-505b-4096-bd4e-231828adebd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:07.259543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb696d-505b-4096-bd4e-231828adebd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:07.260979 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb696d-505b-4096-bd4e-231828adebd4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:07.311378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:07.360934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 558/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:30:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:30:07.367002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e2b94-c499-442a-b891-67e308512d89 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:07.464951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e2b94-c499-442a-b891-67e308512d89 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:07.498154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d56078-0cf8-45d3-9a61-27377f5e9156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:07.499000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d56078-0cf8-45d3-9a61-27377f5e9156 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:07.499311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d56078-0cf8-45d3-9a61-27377f5e9156 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:07.499589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d56078-0cf8-45d3-9a61-27377f5e9156 None admin] PATH_INFO: `/v3/projects/5693d56a32144994a915cdc5d76ce431` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:07.500752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d56078-0cf8-45d3-9a61-27377f5e9156 None admin] RBAC: Authorizing `identity:get_project(project_id=5693d56a32144994a915cdc5d76ce431)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:07.502744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d56078-0cf8-45d3-9a61-27377f5e9156 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:07.504478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 558/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:30:07 2022] GET /identity/v3/projects/5693d56a32144994a915cdc5d76ce431 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:07.510508 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb696d-505b-4096-bd4e-231828adebd4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:07.608852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb696d-505b-4096-bd4e-231828adebd4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:07.642361 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09fb6f-de57-4a4b-976b-939b41fc119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:07.643001 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09fb6f-de57-4a4b-976b-939b41fc119a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:07.643315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09fb6f-de57-4a4b-976b-939b41fc119a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:07.643596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09fb6f-de57-4a4b-976b-939b41fc119a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:07.644418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09fb6f-de57-4a4b-976b-939b41fc119a None admin] RBAC: Adding query filter params (role.id=4f0522c790e94492976ef2674f85ad66, scope.project.id=5693d56a32144994a915cdc5d76ce431, user.id=fa95a3c1b25b4d12852ff96bab7e02af) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:07.644732 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09fb6f-de57-4a4b-976b-939b41fc119a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:07.646158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09fb6f-de57-4a4b-976b-939b41fc119a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:07.651715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 559/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:30:07 2022] GET /identity/v3/role_assignments?user.id=fa95a3c1b25b4d12852ff96bab7e02af&scope.project.id=5693d56a32144994a915cdc5d76ce431&role.id=4f0522c790e94492976ef2674f85ad66 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:09.634701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a1993-f856-4107-8a30-1f67cc6c401d None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:09.635259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a1993-f856-4107-8a30-1f67cc6c401d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:09.635368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a1993-f856-4107-8a30-1f67cc6c401d None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:09.636735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 559/1118] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:09.642429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09711bcf-278a-4207-bdac-121d95f565bb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:09.642814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09711bcf-278a-4207-bdac-121d95f565bb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:09.643015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09711bcf-278a-4207-bdac-121d95f565bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:09.660423 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-09711bcf-278a-4207-bdac-121d95f565bb None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:09.661601 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-09711bcf-278a-4207-bdac-121d95f565bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:09.670467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:09.726077 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 560/1119] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:09.748741 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a1993-f856-4107-8a30-1f67cc6c401d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:09.789700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:09.849337 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a1993-f856-4107-8a30-1f67cc6c401d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:09.882969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70ab2c-ff15-4275-8ea4-88efc22512fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:09.883836 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70ab2c-ff15-4275-8ea4-88efc22512fd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:09.884124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70ab2c-ff15-4275-8ea4-88efc22512fd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:09.884402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70ab2c-ff15-4275-8ea4-88efc22512fd None admin] PATH_INFO: `/v3/roles/4f0522c790e94492976ef2674f85ad66` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:09.885865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70ab2c-ff15-4275-8ea4-88efc22512fd None admin] RBAC: Authorizing `identity:get_role(role_id=4f0522c790e94492976ef2674f85ad66)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:09.887257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70ab2c-ff15-4275-8ea4-88efc22512fd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:09.888618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 560/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:30:09 2022] GET /identity/v3/roles/4f0522c790e94492976ef2674f85ad66 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:09.894542 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09711bcf-278a-4207-bdac-121d95f565bb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:09.989400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09711bcf-278a-4207-bdac-121d95f565bb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:10.021826 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e33c08-1d7a-4044-acd0-f03da36a0c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:10.022672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e33c08-1d7a-4044-acd0-f03da36a0c25 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:10.022957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e33c08-1d7a-4044-acd0-f03da36a0c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:10.023262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e33c08-1d7a-4044-acd0-f03da36a0c25 None admin] PATH_INFO: `/v3/users/fa95a3c1b25b4d12852ff96bab7e02af` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:10.024691 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e33c08-1d7a-4044-acd0-f03da36a0c25 None admin] RBAC: Authorizing `identity:get_user(user_id=fa95a3c1b25b4d12852ff96bab7e02af)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:10.026111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e33c08-1d7a-4044-acd0-f03da36a0c25 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:10.027742 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 561/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:30:09 2022] GET /identity/v3/users/fa95a3c1b25b4d12852ff96bab7e02af => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:10.033890 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70ab2c-ff15-4275-8ea4-88efc22512fd None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:10.128448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70ab2c-ff15-4275-8ea4-88efc22512fd None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:10.135314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:10.161971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e308fc-cbe4-4256-b459-8c4fb438bd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:10.162813 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e308fc-cbe4-4256-b459-8c4fb438bd74 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:10.163092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e308fc-cbe4-4256-b459-8c4fb438bd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:10.163394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e308fc-cbe4-4256-b459-8c4fb438bd74 None admin] PATH_INFO: `/v3/projects/5693d56a32144994a915cdc5d76ce431` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:10.164546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e308fc-cbe4-4256-b459-8c4fb438bd74 None admin] RBAC: Authorizing `identity:get_project(project_id=5693d56a32144994a915cdc5d76ce431)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:10.165962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e308fc-cbe4-4256-b459-8c4fb438bd74 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:10.167646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 561/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:30:10 2022] GET /identity/v3/projects/5693d56a32144994a915cdc5d76ce431 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:30:10.174059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e33c08-1d7a-4044-acd0-f03da36a0c25 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:10.188301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:10.271695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e33c08-1d7a-4044-acd0-f03da36a0c25 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:10.306299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e31bf7-b4b6-42d3-8c53-04d602119347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:10.307225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e31bf7-b4b6-42d3-8c53-04d602119347 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:10.307514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e31bf7-b4b6-42d3-8c53-04d602119347 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:10.307792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e31bf7-b4b6-42d3-8c53-04d602119347 None admin] PATH_INFO: `/v3/projects/5693d56a32144994a915cdc5d76ce431/users/fa95a3c1b25b4d12852ff96bab7e02af/roles/4f0522c790e94492976ef2674f85ad66` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:10.310003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e31bf7-b4b6-42d3-8c53-04d602119347 None admin] RBAC: Authorizing `identity:create_grant(project_id=5693d56a32144994a915cdc5d76ce431, user_id=fa95a3c1b25b4d12852ff96bab7e02af, role_id=4f0522c790e94492976ef2674f85ad66)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:10.311467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e31bf7-b4b6-42d3-8c53-04d602119347 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:10.326544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 562/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:30:10 2022] PUT /identity/v3/projects/5693d56a32144994a915cdc5d76ce431/users/fa95a3c1b25b4d12852ff96bab7e02af/roles/4f0522c790e94492976ef2674f85ad66 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:12.347997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d4933-ba01-44fb-9d76-fe8f253437e4 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:12.348557 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d4933-ba01-44fb-9d76-fe8f253437e4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:12.348557 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d4933-ba01-44fb-9d76-fe8f253437e4 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:12.349919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 562/1124] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:12.354879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4ccd9-97dd-49fb-a2f7-39575db5426a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:12.355345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4ccd9-97dd-49fb-a2f7-39575db5426a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:12.355519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4ccd9-97dd-49fb-a2f7-39575db5426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:12.371805 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a1e4ccd9-97dd-49fb-a2f7-39575db5426a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:12.372973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a1e4ccd9-97dd-49fb-a2f7-39575db5426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:12.437072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 563/1125] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:12.460587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d4933-ba01-44fb-9d76-fe8f253437e4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:12.557713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d4933-ba01-44fb-9d76-fe8f253437e4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:12.593255 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069846ce-8d30-4ba5-8274-9642cf3eadc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:12.594093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069846ce-8d30-4ba5-8274-9642cf3eadc6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:12.594372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069846ce-8d30-4ba5-8274-9642cf3eadc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:12.594644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069846ce-8d30-4ba5-8274-9642cf3eadc6 None admin] PATH_INFO: `/v3/roles/4f0522c790e94492976ef2674f85ad66` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:12.596170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069846ce-8d30-4ba5-8274-9642cf3eadc6 None admin] RBAC: Authorizing `identity:get_role(role_id=4f0522c790e94492976ef2674f85ad66)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:12.597533 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069846ce-8d30-4ba5-8274-9642cf3eadc6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:12.598948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 563/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:30:12 2022] GET /identity/v3/roles/4f0522c790e94492976ef2674f85ad66 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:12.604750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4ccd9-97dd-49fb-a2f7-39575db5426a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:12.606930 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:12.703338 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4ccd9-97dd-49fb-a2f7-39575db5426a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:12.735408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a7e9f-9331-49f4-8806-6404517c2006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:12.736872 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a7e9f-9331-49f4-8806-6404517c2006 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:12.737152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a7e9f-9331-49f4-8806-6404517c2006 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:12.737425 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a7e9f-9331-49f4-8806-6404517c2006 None admin] PATH_INFO: `/v3/users/fa95a3c1b25b4d12852ff96bab7e02af` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:12.738601 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a7e9f-9331-49f4-8806-6404517c2006 None admin] RBAC: Authorizing `identity:get_user(user_id=fa95a3c1b25b4d12852ff96bab7e02af)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:12.740065 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a7e9f-9331-49f4-8806-6404517c2006 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:12.741676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 564/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:30:12 2022] GET /identity/v3/users/fa95a3c1b25b4d12852ff96bab7e02af => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:12.747334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069846ce-8d30-4ba5-8274-9642cf3eadc6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:12.789656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:12.843573 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069846ce-8d30-4ba5-8274-9642cf3eadc6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:12.876752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631a851-401a-48bb-b15d-97e2dff48748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:12.877316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631a851-401a-48bb-b15d-97e2dff48748 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:12.877596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631a851-401a-48bb-b15d-97e2dff48748 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:12.877872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631a851-401a-48bb-b15d-97e2dff48748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:12.941978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631a851-401a-48bb-b15d-97e2dff48748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:12.943426 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631a851-401a-48bb-b15d-97e2dff48748 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:12.982322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:13.038241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 564/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:30:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:30:13.044050 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a7e9f-9331-49f4-8806-6404517c2006 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:13.109813 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:13.139652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a7e9f-9331-49f4-8806-6404517c2006 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:13.173343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a7019-47f5-40a8-ba07-d8ec5872f6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:13.174194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a7019-47f5-40a8-ba07-d8ec5872f6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:13.174470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a7019-47f5-40a8-ba07-d8ec5872f6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:13.174742 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a7019-47f5-40a8-ba07-d8ec5872f6c4 None admin] PATH_INFO: `/v3/projects/5693d56a32144994a915cdc5d76ce431` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:13.175912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a7019-47f5-40a8-ba07-d8ec5872f6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=5693d56a32144994a915cdc5d76ce431)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:13.177338 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a7019-47f5-40a8-ba07-d8ec5872f6c4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:13.178996 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 565/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:30:13 2022] GET /identity/v3/projects/5693d56a32144994a915cdc5d76ce431 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:13.185032 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631a851-401a-48bb-b15d-97e2dff48748 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:13.284134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631a851-401a-48bb-b15d-97e2dff48748 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:13.317342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cd353-dfc4-471d-b54c-3b55dce66595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:13.318347 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd353-dfc4-471d-b54c-3b55dce66595 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:13.318638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd353-dfc4-471d-b54c-3b55dce66595 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:13.318921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd353-dfc4-471d-b54c-3b55dce66595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:13.319781 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cd353-dfc4-471d-b54c-3b55dce66595 None admin] RBAC: Adding query filter params (role.id=4f0522c790e94492976ef2674f85ad66, scope.project.id=5693d56a32144994a915cdc5d76ce431, user.id=fa95a3c1b25b4d12852ff96bab7e02af) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:13.320103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cd353-dfc4-471d-b54c-3b55dce66595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:13.322321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cd353-dfc4-471d-b54c-3b55dce66595 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:13.328803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 565/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:30:13 2022] GET /identity/v3/role_assignments?user.id=fa95a3c1b25b4d12852ff96bab7e02af&scope.project.id=5693d56a32144994a915cdc5d76ce431&role.id=4f0522c790e94492976ef2674f85ad66 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:15.396097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5540d-aa87-4770-bf34-b1db40135bba None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:15.396627 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5540d-aa87-4770-bf34-b1db40135bba None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:15.396627 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5540d-aa87-4770-bf34-b1db40135bba None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:15.398014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 566/1131] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:15.403267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e521ef-c7cd-4a7b-a7c0-35b6e319f4ef None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:15.403709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e521ef-c7cd-4a7b-a7c0-35b6e319f4ef None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:15.403807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e521ef-c7cd-4a7b-a7c0-35b6e319f4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:15.415284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:15.421283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c1e521ef-c7cd-4a7b-a7c0-35b6e319f4ef None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:15.422456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c1e521ef-c7cd-4a7b-a7c0-35b6e319f4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:15.485260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 566/1132] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:15.508665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5540d-aa87-4770-bf34-b1db40135bba None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:15.610034 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5540d-aa87-4770-bf34-b1db40135bba None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:15.643306 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28452331-75ba-4513-8ef4-24b88232d162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:15.644085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28452331-75ba-4513-8ef4-24b88232d162 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:15.644365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28452331-75ba-4513-8ef4-24b88232d162 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:15.644634 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28452331-75ba-4513-8ef4-24b88232d162 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:15.645785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28452331-75ba-4513-8ef4-24b88232d162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:15.647279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28452331-75ba-4513-8ef4-24b88232d162 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:15.648827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 567/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:30:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:15.655007 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e521ef-c7cd-4a7b-a7c0-35b6e319f4ef None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:15.752609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e521ef-c7cd-4a7b-a7c0-35b6e319f4ef None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:15.786411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789b1a5-d805-40ed-ba5d-22835bd318a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:15.787057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789b1a5-d805-40ed-ba5d-22835bd318a8 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:15.787371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789b1a5-d805-40ed-ba5d-22835bd318a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:15.787654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789b1a5-d805-40ed-ba5d-22835bd318a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:15.788345 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789b1a5-d805-40ed-ba5d-22835bd318a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:15.789762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789b1a5-d805-40ed-ba5d-22835bd318a8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:15.793736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:15.815365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 567/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:30:15 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:17.850040 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4352633-cd10-434e-b9f9-acb9b63864f0 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:17.850554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4352633-cd10-434e-b9f9-acb9b63864f0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:17.850554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4352633-cd10-434e-b9f9-acb9b63864f0 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:17.851912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 568/1135] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:17.857192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e060c-1f40-437a-bbdf-4c518e409197 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:17.857596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e060c-1f40-437a-bbdf-4c518e409197 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:17.857753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e060c-1f40-437a-bbdf-4c518e409197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:17.874632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b80e060c-1f40-437a-bbdf-4c518e409197 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:17.875833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b80e060c-1f40-437a-bbdf-4c518e409197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:17.940850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 568/1136] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:17.964827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4352633-cd10-434e-b9f9-acb9b63864f0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:17.973521 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:18.063726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4352633-cd10-434e-b9f9-acb9b63864f0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:18.096253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9893c-aaef-458a-a289-879e56d3c1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:18.097040 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9893c-aaef-458a-a289-879e56d3c1db None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:18.097323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9893c-aaef-458a-a289-879e56d3c1db None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:18.097594 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9893c-aaef-458a-a289-879e56d3c1db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:18.098753 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9893c-aaef-458a-a289-879e56d3c1db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:18.100249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9893c-aaef-458a-a289-879e56d3c1db None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:18.101791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 569/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:30:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:18.107439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e060c-1f40-437a-bbdf-4c518e409197 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:18.202457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e060c-1f40-437a-bbdf-4c518e409197 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:18.218817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:18.237360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be481e4d-f211-4a24-9fe8-265b5e1ef0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:18.238015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be481e4d-f211-4a24-9fe8-265b5e1ef0a8 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:18.238300 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be481e4d-f211-4a24-9fe8-265b5e1ef0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:18.238581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be481e4d-f211-4a24-9fe8-265b5e1ef0a8 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:18.239323 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be481e4d-f211-4a24-9fe8-265b5e1ef0a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:18.240745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be481e4d-f211-4a24-9fe8-265b5e1ef0a8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:18.259426 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 569/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:30:18 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:20.311726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27246d-4c7a-4312-ae52-7c797445284b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:20.312285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27246d-4c7a-4312-ae52-7c797445284b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:20.312285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27246d-4c7a-4312-ae52-7c797445284b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:20.313631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 570/1139] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:20.319297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7314c5a-25a0-498e-b727-160596e5b459 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:20.319685 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7314c5a-25a0-498e-b727-160596e5b459 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:20.319852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7314c5a-25a0-498e-b727-160596e5b459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:20.336674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f7314c5a-25a0-498e-b727-160596e5b459 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:20.337846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f7314c5a-25a0-498e-b727-160596e5b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:20.402318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 570/1140] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:20.425384 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27246d-4c7a-4312-ae52-7c797445284b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:20.498959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:20.525286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27246d-4c7a-4312-ae52-7c797445284b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:20.557472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe46d30-21e4-4d51-904a-45e5d5f88caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:20.558258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe46d30-21e4-4d51-904a-45e5d5f88caf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:20.558543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe46d30-21e4-4d51-904a-45e5d5f88caf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:20.558820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe46d30-21e4-4d51-904a-45e5d5f88caf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:20.569125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe46d30-21e4-4d51-904a-45e5d5f88caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-bbe46d30-21e4-4d51-904a-45e5d5f88caf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:30:20.576684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:30:20.577851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:30:20.579188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:30:20.579188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:30:20.579188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:30:20.579188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:30:20.579188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:30:20.579188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:30:20.579188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:30:20.579188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:30:20.579188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:30:20.579188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:30:20.579188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:20.579188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:30:20.579188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 571/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:30:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:30:20.583993 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7314c5a-25a0-498e-b727-160596e5b459 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:20.680357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7314c5a-25a0-498e-b727-160596e5b459 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:20.682574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:20.714183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45484a2-6973-4736-940e-ccb1adc217da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:20.714844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45484a2-6973-4736-940e-ccb1adc217da None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:20.715133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45484a2-6973-4736-940e-ccb1adc217da None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:20.715444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45484a2-6973-4736-940e-ccb1adc217da None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:20.716183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45484a2-6973-4736-940e-ccb1adc217da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:20.716495 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45484a2-6973-4736-940e-ccb1adc217da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:20.717859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45484a2-6973-4736-940e-ccb1adc217da None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:20.726861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 571/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:30:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:20.732535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe46d30-21e4-4d51-904a-45e5d5f88caf None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:20.830406 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe46d30-21e4-4d51-904a-45e5d5f88caf None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:20.863131 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01117f3-599a-443c-9c4b-ea4fa64fe45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:20.864013 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01117f3-599a-443c-9c4b-ea4fa64fe45d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:20.864303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01117f3-599a-443c-9c4b-ea4fa64fe45d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:20.864584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01117f3-599a-443c-9c4b-ea4fa64fe45d None admin] PATH_INFO: `/v3/users/9277480226784790b8e18c2a46bbd825` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:20.866468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:20.879293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01117f3-599a-443c-9c4b-ea4fa64fe45d None admin] RBAC: Authorizing `identity:get_user(user_id=9277480226784790b8e18c2a46bbd825)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:20.880732 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01117f3-599a-443c-9c4b-ea4fa64fe45d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:20.882372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 572/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:30:20 2022] GET /identity/v3/users/9277480226784790b8e18c2a46bbd825 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:20.888085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45484a2-6973-4736-940e-ccb1adc217da None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:20.984791 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45484a2-6973-4736-940e-ccb1adc217da None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:21.017083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca17a1f-0493-4081-89c8-d3e2d0ca3ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:21.018426 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca17a1f-0493-4081-89c8-d3e2d0ca3ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:21.018711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca17a1f-0493-4081-89c8-d3e2d0ca3ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:21.018989 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca17a1f-0493-4081-89c8-d3e2d0ca3ad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:21.050525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:21.083785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca17a1f-0493-4081-89c8-d3e2d0ca3ad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:21.085140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca17a1f-0493-4081-89c8-d3e2d0ca3ad0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:21.177649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 572/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:30:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:30:21.183493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01117f3-599a-443c-9c4b-ea4fa64fe45d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:21.278176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01117f3-599a-443c-9c4b-ea4fa64fe45d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:21.310433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954faeb5-a87b-4a5f-9a38-13a3a4ce6af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:21.311307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954faeb5-a87b-4a5f-9a38-13a3a4ce6af7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:21.311591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954faeb5-a87b-4a5f-9a38-13a3a4ce6af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:21.311866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954faeb5-a87b-4a5f-9a38-13a3a4ce6af7 None admin] PATH_INFO: `/v3/projects/69350d03839c4a149bb33f24c0c8d622` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:21.313036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954faeb5-a87b-4a5f-9a38-13a3a4ce6af7 None admin] RBAC: Authorizing `identity:get_project(project_id=69350d03839c4a149bb33f24c0c8d622)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:21.314998 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954faeb5-a87b-4a5f-9a38-13a3a4ce6af7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:21.316695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 573/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:30:21 2022] GET /identity/v3/projects/69350d03839c4a149bb33f24c0c8d622 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:21.322689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca17a1f-0493-4081-89c8-d3e2d0ca3ad0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:21.385943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:21.420610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca17a1f-0493-4081-89c8-d3e2d0ca3ad0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:21.452657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8ee07-67a4-4c70-be66-7553caaf9153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:21.453299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8ee07-67a4-4c70-be66-7553caaf9153 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:21.453581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8ee07-67a4-4c70-be66-7553caaf9153 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:21.453857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8ee07-67a4-4c70-be66-7553caaf9153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:21.455212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8ee07-67a4-4c70-be66-7553caaf9153 None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=69350d03839c4a149bb33f24c0c8d622, user.id=9277480226784790b8e18c2a46bbd825) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:21.455578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8ee07-67a4-4c70-be66-7553caaf9153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:21.456996 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8ee07-67a4-4c70-be66-7553caaf9153 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:21.462269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 573/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:30:21 2022] GET /identity/v3/role_assignments?user.id=9277480226784790b8e18c2a46bbd825&scope.project.id=69350d03839c4a149bb33f24c0c8d622&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:23.444557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46c2e1-2b39-4b42-bac0-a2867abcd3e4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:23.445189 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46c2e1-2b39-4b42-bac0-a2867abcd3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:23.445189 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46c2e1-2b39-4b42-bac0-a2867abcd3e4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:23.446455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 574/1147] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:23.451626 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3226b9-b120-4cc7-ad5f-dce84a99402f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:23.452003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3226b9-b120-4cc7-ad5f-dce84a99402f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:23.452189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3226b9-b120-4cc7-ad5f-dce84a99402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:23.469216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3d3226b9-b120-4cc7-ad5f-dce84a99402f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:23.470438 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3d3226b9-b120-4cc7-ad5f-dce84a99402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:23.535712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 574/1148] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:30:23.557467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46c2e1-2b39-4b42-bac0-a2867abcd3e4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:23.616806 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:23.658340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46c2e1-2b39-4b42-bac0-a2867abcd3e4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:23.691324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac447b7-ee4a-43c5-8033-2c349dfc5416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:23.692105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac447b7-ee4a-43c5-8033-2c349dfc5416 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:23.692387 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac447b7-ee4a-43c5-8033-2c349dfc5416 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:23.692660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac447b7-ee4a-43c5-8033-2c349dfc5416 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:23.702300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac447b7-ee4a-43c5-8033-2c349dfc5416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-dac447b7-ee4a-43c5-8033-2c349dfc5416 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:30:23.709749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:30:23.710862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:30:23.711792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:30:23.711792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:30:23.711792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:30:23.711792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:30:23.711792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:30:23.711792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:30:23.711792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:30:23.711792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:30:23.711792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:30:23.711792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:30:23.711792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:23.711792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:30:23.711792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 575/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:30:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:30:23.717076 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3226b9-b120-4cc7-ad5f-dce84a99402f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:23.776340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:23.816572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3226b9-b120-4cc7-ad5f-dce84a99402f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:23.849344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6be0c-1733-446a-8863-72b742f2ef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:23.849996 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6be0c-1733-446a-8863-72b742f2ef42 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:23.850283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6be0c-1733-446a-8863-72b742f2ef42 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:23.850560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6be0c-1733-446a-8863-72b742f2ef42 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:23.851333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6be0c-1733-446a-8863-72b742f2ef42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:23.851648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6be0c-1733-446a-8863-72b742f2ef42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:23.853012 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6be0c-1733-446a-8863-72b742f2ef42 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:23.860858 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 575/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:30:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:23.867261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac447b7-ee4a-43c5-8033-2c349dfc5416 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:23.962796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac447b7-ee4a-43c5-8033-2c349dfc5416 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:23.981085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:23.995657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c0c81-541e-4ff6-be2f-f4203ccbe2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:23.996499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c0c81-541e-4ff6-be2f-f4203ccbe2dc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:23.996778 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c0c81-541e-4ff6-be2f-f4203ccbe2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:23.997048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c0c81-541e-4ff6-be2f-f4203ccbe2dc None admin] PATH_INFO: `/v3/users/9277480226784790b8e18c2a46bbd825` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:23.998217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c0c81-541e-4ff6-be2f-f4203ccbe2dc None admin] RBAC: Authorizing `identity:get_user(user_id=9277480226784790b8e18c2a46bbd825)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:23.999678 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c0c81-541e-4ff6-be2f-f4203ccbe2dc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:24.001273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 576/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:30:23 2022] GET /identity/v3/users/9277480226784790b8e18c2a46bbd825 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:24.007229 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6be0c-1733-446a-8863-72b742f2ef42 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:24.105202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6be0c-1733-446a-8863-72b742f2ef42 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:24.127250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:24.138928 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2e721-12cf-494d-871b-993f58956bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:24.139805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2e721-12cf-494d-871b-993f58956bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:24.140089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2e721-12cf-494d-871b-993f58956bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:24.140366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2e721-12cf-494d-871b-993f58956bf6 None admin] PATH_INFO: `/v3/projects/69350d03839c4a149bb33f24c0c8d622` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:24.141549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2e721-12cf-494d-871b-993f58956bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=69350d03839c4a149bb33f24c0c8d622)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:24.143091 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2e721-12cf-494d-871b-993f58956bf6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:24.144801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 576/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:30:24 2022] GET /identity/v3/projects/69350d03839c4a149bb33f24c0c8d622 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:24.151307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c0c81-541e-4ff6-be2f-f4203ccbe2dc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:24.248281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c0c81-541e-4ff6-be2f-f4203ccbe2dc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:24.279829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbc6e9-ca73-459f-a112-68f423892308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:24.280703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbc6e9-ca73-459f-a112-68f423892308 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:24.280987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbc6e9-ca73-459f-a112-68f423892308 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:24.281265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbc6e9-ca73-459f-a112-68f423892308 None admin] PATH_INFO: `/v3/projects/69350d03839c4a149bb33f24c0c8d622/users/9277480226784790b8e18c2a46bbd825/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:24.283760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbc6e9-ca73-459f-a112-68f423892308 None admin] RBAC: Authorizing `identity:create_grant(project_id=69350d03839c4a149bb33f24c0c8d622, user_id=9277480226784790b8e18c2a46bbd825, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:24.285191 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbc6e9-ca73-459f-a112-68f423892308 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:24.302876 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 577/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:30:24 2022] PUT /identity/v3/projects/69350d03839c4a149bb33f24c0c8d622/users/9277480226784790b8e18c2a46bbd825/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:26.294869 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820367f1-e88b-4e95-9a08-4d4a790b3b1f None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:26.295423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820367f1-e88b-4e95-9a08-4d4a790b3b1f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:26.295535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820367f1-e88b-4e95-9a08-4d4a790b3b1f None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:26.296883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 577/1154] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:26.303096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6bcf9-bdbe-45fb-ac01-abd35207a303 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:26.303502 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6bcf9-bdbe-45fb-ac01-abd35207a303 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:26.303691 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6bcf9-bdbe-45fb-ac01-abd35207a303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:26.320702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-63a6bcf9-bdbe-45fb-ac01-abd35207a303 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:26.321893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-63a6bcf9-bdbe-45fb-ac01-abd35207a303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:26.366801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:26.390915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 578/1155] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:26.416733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820367f1-e88b-4e95-9a08-4d4a790b3b1f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:26.516839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820367f1-e88b-4e95-9a08-4d4a790b3b1f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:26.551977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc2c3a-53a4-4855-ad3c-e470ea0a98c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:26.552693 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2c3a-53a4-4855-ad3c-e470ea0a98c2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:26.552980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2c3a-53a4-4855-ad3c-e470ea0a98c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:26.553258 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2c3a-53a4-4855-ad3c-e470ea0a98c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:26.563336 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc2c3a-53a4-4855-ad3c-e470ea0a98c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-82dc2c3a-53a4-4855-ad3c-e470ea0a98c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:30:26.572066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:30:26.573179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:30:26.574379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:30:26.574379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:30:26.574379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:30:26.574379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:30:26.574379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:30:26.574379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:30:26.574379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:30:26.574379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:30:26.574379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:30:26.574379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:30:26.574379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:26.574379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:30:26.574379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 578/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:30:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:30:26.579255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6bcf9-bdbe-45fb-ac01-abd35207a303 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:26.684302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6bcf9-bdbe-45fb-ac01-abd35207a303 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:26.719546 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616985c-e440-48d4-994d-bb055f1218d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:26.720207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616985c-e440-48d4-994d-bb055f1218d0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:26.720921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616985c-e440-48d4-994d-bb055f1218d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:26.721223 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616985c-e440-48d4-994d-bb055f1218d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:26.721975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616985c-e440-48d4-994d-bb055f1218d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:26.722287 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616985c-e440-48d4-994d-bb055f1218d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:26.723695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616985c-e440-48d4-994d-bb055f1218d0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:26.731541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 579/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:30:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:26.738259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc2c3a-53a4-4855-ad3c-e470ea0a98c2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:26.788003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:26.839550 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc2c3a-53a4-4855-ad3c-e470ea0a98c2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:26.871505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6598adf-3b2c-4faa-81de-91b48169451f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:26.872366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6598adf-3b2c-4faa-81de-91b48169451f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:26.872650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6598adf-3b2c-4faa-81de-91b48169451f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:26.872928 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6598adf-3b2c-4faa-81de-91b48169451f None admin] PATH_INFO: `/v3/users/9277480226784790b8e18c2a46bbd825` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:26.874101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6598adf-3b2c-4faa-81de-91b48169451f None admin] RBAC: Authorizing `identity:get_user(user_id=9277480226784790b8e18c2a46bbd825)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:26.875552 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6598adf-3b2c-4faa-81de-91b48169451f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:26.877911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 579/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:30:26 2022] GET /identity/v3/users/9277480226784790b8e18c2a46bbd825 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:26.883585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616985c-e440-48d4-994d-bb055f1218d0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:26.924733 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:26.980016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616985c-e440-48d4-994d-bb055f1218d0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:27.012628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ad22-856d-4db5-ab5e-cd09e730edf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:27.013267 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ad22-856d-4db5-ab5e-cd09e730edf6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:27.013550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ad22-856d-4db5-ab5e-cd09e730edf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:27.013826 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ad22-856d-4db5-ab5e-cd09e730edf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:27.079018 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02ad22-856d-4db5-ab5e-cd09e730edf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:27.081135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02ad22-856d-4db5-ab5e-cd09e730edf6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:27.120071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:27.178834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 580/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:30:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:30:27.184644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6598adf-3b2c-4faa-81de-91b48169451f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:27.287439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6598adf-3b2c-4faa-81de-91b48169451f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:27.304274 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:27.321080 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3263d3-d137-4478-9fd1-95028812a126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:27.321929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3263d3-d137-4478-9fd1-95028812a126 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:27.322209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3263d3-d137-4478-9fd1-95028812a126 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:27.322486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3263d3-d137-4478-9fd1-95028812a126 None admin] PATH_INFO: `/v3/projects/69350d03839c4a149bb33f24c0c8d622` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:27.323668 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3263d3-d137-4478-9fd1-95028812a126 None admin] RBAC: Authorizing `identity:get_project(project_id=69350d03839c4a149bb33f24c0c8d622)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:27.325091 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3263d3-d137-4478-9fd1-95028812a126 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:27.326776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 580/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:30:27 2022] GET /identity/v3/projects/69350d03839c4a149bb33f24c0c8d622 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:30:27.333681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ad22-856d-4db5-ab5e-cd09e730edf6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:27.429428 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ad22-856d-4db5-ab5e-cd09e730edf6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:27.462767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a46635-9bb4-4322-a91c-72a3cefc01ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:27.463429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a46635-9bb4-4322-a91c-72a3cefc01ec None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:27.463714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a46635-9bb4-4322-a91c-72a3cefc01ec None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:27.463985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a46635-9bb4-4322-a91c-72a3cefc01ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:27.464800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a46635-9bb4-4322-a91c-72a3cefc01ec None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=69350d03839c4a149bb33f24c0c8d622, user.id=9277480226784790b8e18c2a46bbd825) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:27.465110 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a46635-9bb4-4322-a91c-72a3cefc01ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:27.466519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a46635-9bb4-4322-a91c-72a3cefc01ec None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:27.472161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 581/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:30:27 2022] GET /identity/v3/role_assignments?user.id=9277480226784790b8e18c2a46bbd825&scope.project.id=69350d03839c4a149bb33f24c0c8d622&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:29.548539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc434fc-2ce1-42a3-a177-59a6f0046e8b None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:29.549803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc434fc-2ce1-42a3-a177-59a6f0046e8b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:29.549803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc434fc-2ce1-42a3-a177-59a6f0046e8b None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:29.551098 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 581/1162] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:29.556334 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e7d30-3445-4ef4-9731-c2de279490a1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:29.556715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e7d30-3445-4ef4-9731-c2de279490a1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:29.556898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e7d30-3445-4ef4-9731-c2de279490a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:29.562836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:29.574591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3f9e7d30-3445-4ef4-9731-c2de279490a1 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:29.575821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3f9e7d30-3445-4ef4-9731-c2de279490a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:29.646072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 582/1163] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:29.669091 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc434fc-2ce1-42a3-a177-59a6f0046e8b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:29.768195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc434fc-2ce1-42a3-a177-59a6f0046e8b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:29.801140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa65bb-cbd3-41d1-bc0c-ff142876ea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:29.801721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa65bb-cbd3-41d1-bc0c-ff142876ea9d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:29.802001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa65bb-cbd3-41d1-bc0c-ff142876ea9d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:29.802274 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa65bb-cbd3-41d1-bc0c-ff142876ea9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:29.853814 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:29.867679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa65bb-cbd3-41d1-bc0c-ff142876ea9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:29.869112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa65bb-cbd3-41d1-bc0c-ff142876ea9d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:29.963538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 582/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:30:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:30:29.969559 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e7d30-3445-4ef4-9731-c2de279490a1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:30.066135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e7d30-3445-4ef4-9731-c2de279490a1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:30.098975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad2db2-1a74-425b-a410-aacf67184edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:30.099793 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad2db2-1a74-425b-a410-aacf67184edf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:30.100073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad2db2-1a74-425b-a410-aacf67184edf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:30.100356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad2db2-1a74-425b-a410-aacf67184edf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:30.102218 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:30.107438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad2db2-1a74-425b-a410-aacf67184edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:30.109052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad2db2-1a74-425b-a410-aacf67184edf None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-06ad2db2-1a74-425b-a410-aacf67184edf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:30:30.123577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:30:30.124776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:30:30.125626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 583/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jul 6 20:30:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:30:30.130628 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa65bb-cbd3-41d1-bc0c-ff142876ea9d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:30.213278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:30.229207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa65bb-cbd3-41d1-bc0c-ff142876ea9d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:30.262234 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fe022-28c3-493d-b840-41419b1243fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:30.262884 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe022-28c3-493d-b840-41419b1243fc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:30.263192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe022-28c3-493d-b840-41419b1243fc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:30.263472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe022-28c3-493d-b840-41419b1243fc None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:30.264185 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fe022-28c3-493d-b840-41419b1243fc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:30.264493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fe022-28c3-493d-b840-41419b1243fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:30.265864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fe022-28c3-493d-b840-41419b1243fc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:30.274609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 583/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jul 6 20:30:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:32.290683 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd559e6f-1f88-4640-85d6-c9d85e09fa2e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:32.291239 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd559e6f-1f88-4640-85d6-c9d85e09fa2e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:32.291349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd559e6f-1f88-4640-85d6-c9d85e09fa2e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:32.292661 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 584/1167] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:32.297701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd457-c024-4357-8d65-550497324e38 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:32.298107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd457-c024-4357-8d65-550497324e38 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:32.298254 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd457-c024-4357-8d65-550497324e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:32.315208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7b7dd457-c024-4357-8d65-550497324e38 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:32.316397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7b7dd457-c024-4357-8d65-550497324e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:32.382357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 584/1168] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:32.408754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd559e6f-1f88-4640-85d6-c9d85e09fa2e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:32.514649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd559e6f-1f88-4640-85d6-c9d85e09fa2e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:32.550473 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e0570-dc75-4031-8215-64e6170d36b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:32.551129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e0570-dc75-4031-8215-64e6170d36b6 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:32.551444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e0570-dc75-4031-8215-64e6170d36b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:32.551723 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e0570-dc75-4031-8215-64e6170d36b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:32.552470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e0570-dc75-4031-8215-64e6170d36b6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:32.553845 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e0570-dc75-4031-8215-64e6170d36b6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:32.570941 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 585/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Wed Jul 6 20:30:32 2022] POST /identity/v3/domains => generated 267 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:34.698803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929062a9-db6b-4883-9ca2-3f7ed5a990f4 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:34.699359 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929062a9-db6b-4883-9ca2-3f7ed5a990f4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:34.699447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929062a9-db6b-4883-9ca2-3f7ed5a990f4 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:34.700762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 585/1170] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:34.706454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49ec3-68a9-4a29-aa48-270f12d91803 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:34.706852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49ec3-68a9-4a29-aa48-270f12d91803 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:34.707011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49ec3-68a9-4a29-aa48-270f12d91803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:34.723814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b0b49ec3-68a9-4a29-aa48-270f12d91803 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:34.724987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b0b49ec3-68a9-4a29-aa48-270f12d91803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:34.773239 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:34.791361 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 586/1171] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:34.814790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929062a9-db6b-4883-9ca2-3f7ed5a990f4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:34.895249 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:34.915383 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929062a9-db6b-4883-9ca2-3f7ed5a990f4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:34.948894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3448aa-fd04-4c38-8597-4dc28234c695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:34.949748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3448aa-fd04-4c38-8597-4dc28234c695 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:34.950034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3448aa-fd04-4c38-8597-4dc28234c695 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:34.950313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3448aa-fd04-4c38-8597-4dc28234c695 None admin] PATH_INFO: `/v3/domains/77bc2b7370c14e7aa8e5902ad07cdfc2` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:34.961231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3448aa-fd04-4c38-8597-4dc28234c695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=77bc2b7370c14e7aa8e5902ad07cdfc2)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:34.962663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3448aa-fd04-4c38-8597-4dc28234c695 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:34.964336 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 586/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Wed Jul 6 20:30:34 2022] GET /identity/v3/domains/77bc2b7370c14e7aa8e5902ad07cdfc2 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:34.970217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b49ec3-68a9-4a29-aa48-270f12d91803 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:35.065687 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b49ec3-68a9-4a29-aa48-270f12d91803 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:35.098474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b3aeb-7409-446a-8042-1aad3788ffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:35.099122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b3aeb-7409-446a-8042-1aad3788ffff None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:35.099438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b3aeb-7409-446a-8042-1aad3788ffff None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:35.099712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b3aeb-7409-446a-8042-1aad3788ffff None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:35.100414 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b3aeb-7409-446a-8042-1aad3788ffff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:35.101842 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b3aeb-7409-446a-8042-1aad3788ffff None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:35.126385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 587/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:30:34 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:37.188763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c8dd5-2703-4df8-a28e-84164fdb5f7d None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:37.189396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c8dd5-2703-4df8-a28e-84164fdb5f7d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:37.189396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c8dd5-2703-4df8-a28e-84164fdb5f7d None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:37.190759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 587/1174] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:37.195973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fc304-95b0-4888-9e12-0caaf855eecd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:37.196361 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fc304-95b0-4888-9e12-0caaf855eecd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:37.196538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fc304-95b0-4888-9e12-0caaf855eecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:37.213461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-343fc304-95b0-4888-9e12-0caaf855eecd None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:37.214641 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-343fc304-95b0-4888-9e12-0caaf855eecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:37.242498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:37.282077 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 588/1175] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:37.307257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c8dd5-2703-4df8-a28e-84164fdb5f7d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:37.407924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c8dd5-2703-4df8-a28e-84164fdb5f7d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:37.442898 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d43a25-4193-4967-9e0c-236b4cf182c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:37.443703 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d43a25-4193-4967-9e0c-236b4cf182c4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:37.443988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d43a25-4193-4967-9e0c-236b4cf182c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:37.444265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d43a25-4193-4967-9e0c-236b4cf182c4 None admin] PATH_INFO: `/v3/domains/77bc2b7370c14e7aa8e5902ad07cdfc2` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:37.445426 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d43a25-4193-4967-9e0c-236b4cf182c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=77bc2b7370c14e7aa8e5902ad07cdfc2)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:37.446859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d43a25-4193-4967-9e0c-236b4cf182c4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:37.448507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 588/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Wed Jul 6 20:30:37 2022] GET /identity/v3/domains/77bc2b7370c14e7aa8e5902ad07cdfc2 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:37.454265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fc304-95b0-4888-9e12-0caaf855eecd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:37.551058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fc304-95b0-4888-9e12-0caaf855eecd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:37.583602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf917d9c-934e-4ac1-8862-fb5a27c8b4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:37.584272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf917d9c-934e-4ac1-8862-fb5a27c8b4ec None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:37.584555 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf917d9c-934e-4ac1-8862-fb5a27c8b4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:37.584831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf917d9c-934e-4ac1-8862-fb5a27c8b4ec None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:37.585535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf917d9c-934e-4ac1-8862-fb5a27c8b4ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:37.586966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf917d9c-934e-4ac1-8862-fb5a27c8b4ec None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:37.607622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 589/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:30:37 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:30:39.756684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7f14b-a437-4f56-af39-1ed78c54d92e None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:39.757228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7f14b-a437-4f56-af39-1ed78c54d92e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:39.757228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7f14b-a437-4f56-af39-1ed78c54d92e None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:39.758598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 589/1178] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:39.763858 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a00ec-d023-438f-993d-8d5a60f74fef None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:39.764275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a00ec-d023-438f-993d-8d5a60f74fef None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:39.764417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a00ec-d023-438f-993d-8d5a60f74fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:39.781837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-788a00ec-d023-438f-993d-8d5a60f74fef None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:39.783017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-788a00ec-d023-438f-993d-8d5a60f74fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:39.799066 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:39.851015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 590/1179] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:39.874603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7f14b-a437-4f56-af39-1ed78c54d92e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:39.885776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:39.973713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7f14b-a437-4f56-af39-1ed78c54d92e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.010757 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b279493-059a-4f09-930c-35f09bed5752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.011566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b279493-059a-4f09-930c-35f09bed5752 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.011846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b279493-059a-4f09-930c-35f09bed5752 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.012120 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b279493-059a-4f09-930c-35f09bed5752 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.021812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b279493-059a-4f09-930c-35f09bed5752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-4b279493-059a-4f09-930c-35f09bed5752 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:30:40.029588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:30:40.030683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:30:40.031633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:30:40.031633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:30:40.031633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:30:40.031633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:30:40.031633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:30:40.031633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:30:40.031633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:30:40.031633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:30:40.031633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:30:40.031633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:30:40.031633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:40.031633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:30:40.031633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 590/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:30:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:30:40.037405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a00ec-d023-438f-993d-8d5a60f74fef None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.132538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a00ec-d023-438f-993d-8d5a60f74fef None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.166245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4e017-a797-4a49-84d1-93dcf1085222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.166904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4e017-a797-4a49-84d1-93dcf1085222 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.167197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4e017-a797-4a49-84d1-93dcf1085222 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.167477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4e017-a797-4a49-84d1-93dcf1085222 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.168207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4e017-a797-4a49-84d1-93dcf1085222 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:40.168509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4e017-a797-4a49-84d1-93dcf1085222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:40.169866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4e017-a797-4a49-84d1-93dcf1085222 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:40.177573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 591/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:30:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:40.183431 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b279493-059a-4f09-930c-35f09bed5752 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.247481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:40.281815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b279493-059a-4f09-930c-35f09bed5752 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.315382 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb7e4a-93fe-4f96-b792-d85b51e3b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.316245 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb7e4a-93fe-4f96-b792-d85b51e3b543 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.316521 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb7e4a-93fe-4f96-b792-d85b51e3b543 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.316791 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb7e4a-93fe-4f96-b792-d85b51e3b543 None admin] PATH_INFO: `/v3/users/75438948c062401196ff3348196e8d77` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.329415 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb7e4a-93fe-4f96-b792-d85b51e3b543 None admin] RBAC: Authorizing `identity:get_user(user_id=75438948c062401196ff3348196e8d77)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:40.330874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb7e4a-93fe-4f96-b792-d85b51e3b543 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:40.332536 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 591/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:30:40 2022] GET /identity/v3/users/75438948c062401196ff3348196e8d77 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:40.338405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4e017-a797-4a49-84d1-93dcf1085222 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.354253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:40.435855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4e017-a797-4a49-84d1-93dcf1085222 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.468313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72007f0-76a9-43cd-ab1e-640f1956c70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.468956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72007f0-76a9-43cd-ab1e-640f1956c70b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.469240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72007f0-76a9-43cd-ab1e-640f1956c70b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.469514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72007f0-76a9-43cd-ab1e-640f1956c70b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.534737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72007f0-76a9-43cd-ab1e-640f1956c70b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:40.536197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72007f0-76a9-43cd-ab1e-640f1956c70b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:40.550372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:40.632532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 592/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:30:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:30:40.638347 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb7e4a-93fe-4f96-b792-d85b51e3b543 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.736148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb7e4a-93fe-4f96-b792-d85b51e3b543 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.761467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:40.771360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f030ba9-7a4b-4bfe-a0a2-aac9b9c216ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.772232 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f030ba9-7a4b-4bfe-a0a2-aac9b9c216ae None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.772516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f030ba9-7a4b-4bfe-a0a2-aac9b9c216ae None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.772794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f030ba9-7a4b-4bfe-a0a2-aac9b9c216ae None admin] PATH_INFO: `/v3/projects/dc67e101f33749c8bd7bd73db47e8270` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.774070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f030ba9-7a4b-4bfe-a0a2-aac9b9c216ae None admin] RBAC: Authorizing `identity:get_project(project_id=dc67e101f33749c8bd7bd73db47e8270)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:40.775902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f030ba9-7a4b-4bfe-a0a2-aac9b9c216ae None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:40.777642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 592/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:30:40 2022] GET /identity/v3/projects/dc67e101f33749c8bd7bd73db47e8270 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:40.783840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72007f0-76a9-43cd-ab1e-640f1956c70b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:40.878982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72007f0-76a9-43cd-ab1e-640f1956c70b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:40.893156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:40.913417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13bdf5-c980-4386-85df-f8b9acc3382d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:40.914064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13bdf5-c980-4386-85df-f8b9acc3382d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:40.914348 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13bdf5-c980-4386-85df-f8b9acc3382d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:40.914626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13bdf5-c980-4386-85df-f8b9acc3382d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:40.915493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13bdf5-c980-4386-85df-f8b9acc3382d None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=dc67e101f33749c8bd7bd73db47e8270, user.id=75438948c062401196ff3348196e8d77) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:40.915808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13bdf5-c980-4386-85df-f8b9acc3382d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:40.917261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13bdf5-c980-4386-85df-f8b9acc3382d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:40.922531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 593/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:30:40 2022] GET /identity/v3/role_assignments?user.id=75438948c062401196ff3348196e8d77&scope.project.id=dc67e101f33749c8bd7bd73db47e8270&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:42.900329 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fbd9e-6aee-42df-b1f2-223e8604ce9b None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.901077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fbd9e-6aee-42df-b1f2-223e8604ce9b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.901077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fbd9e-6aee-42df-b1f2-223e8604ce9b None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.902447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 593/1186] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:42.907776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cbf02-ef29-4ccc-bae8-cd3591aa11c3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:42.908222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cbf02-ef29-4ccc-bae8-cd3591aa11c3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:42.908474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cbf02-ef29-4ccc-bae8-cd3591aa11c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:42.925570 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-510cbf02-ef29-4ccc-bae8-cd3591aa11c3 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:42.926762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-510cbf02-ef29-4ccc-bae8-cd3591aa11c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:42.992761 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 594/1187] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:43.015482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fbd9e-6aee-42df-b1f2-223e8604ce9b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:43.115632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fbd9e-6aee-42df-b1f2-223e8604ce9b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:43.147898 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccee9e-86be-4a4a-99b6-38882b8a44d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:43.148679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccee9e-86be-4a4a-99b6-38882b8a44d0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.148965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccee9e-86be-4a4a-99b6-38882b8a44d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.149245 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccee9e-86be-4a4a-99b6-38882b8a44d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.159989 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccee9e-86be-4a4a-99b6-38882b8a44d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-4fccee9e-86be-4a4a-99b6-38882b8a44d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:30:43.167475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:30:43.168554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:30:43.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:30:43.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:30:43.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:30:43.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:30:43.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:30:43.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:30:43.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:30:43.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:30:43.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:30:43.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:30:43.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:43.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:30:43.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 594/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:30:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:30:43.175883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cbf02-ef29-4ccc-bae8-cd3591aa11c3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:43.275911 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cbf02-ef29-4ccc-bae8-cd3591aa11c3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:43.286034 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:43.313143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6898e02-1e59-48fb-992e-26391a32ebc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:43.313814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6898e02-1e59-48fb-992e-26391a32ebc9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.314102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6898e02-1e59-48fb-992e-26391a32ebc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.314933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6898e02-1e59-48fb-992e-26391a32ebc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.316277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6898e02-1e59-48fb-992e-26391a32ebc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:43.316854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6898e02-1e59-48fb-992e-26391a32ebc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:43.319495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6898e02-1e59-48fb-992e-26391a32ebc9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:43.333076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 595/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:30:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:43.338812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccee9e-86be-4a4a-99b6-38882b8a44d0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:43.392437 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:43.441070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccee9e-86be-4a4a-99b6-38882b8a44d0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:43.474562 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d915ed7-a64d-484b-bebf-5aff1f226f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:43.475440 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d915ed7-a64d-484b-bebf-5aff1f226f10 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.475727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d915ed7-a64d-484b-bebf-5aff1f226f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.476008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d915ed7-a64d-484b-bebf-5aff1f226f10 None admin] PATH_INFO: `/v3/users/75438948c062401196ff3348196e8d77` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.477211 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d915ed7-a64d-484b-bebf-5aff1f226f10 None admin] RBAC: Authorizing `identity:get_user(user_id=75438948c062401196ff3348196e8d77)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:43.478682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d915ed7-a64d-484b-bebf-5aff1f226f10 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:43.480347 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 595/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:30:43 2022] GET /identity/v3/users/75438948c062401196ff3348196e8d77 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:43.486161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6898e02-1e59-48fb-992e-26391a32ebc9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:43.583771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6898e02-1e59-48fb-992e-26391a32ebc9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:43.617062 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66c6a1-e32e-4c06-8f60-a4cb72560d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:43.617925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66c6a1-e32e-4c06-8f60-a4cb72560d0f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.618212 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66c6a1-e32e-4c06-8f60-a4cb72560d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.618489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66c6a1-e32e-4c06-8f60-a4cb72560d0f None admin] PATH_INFO: `/v3/projects/dc67e101f33749c8bd7bd73db47e8270` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.619695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66c6a1-e32e-4c06-8f60-a4cb72560d0f None admin] RBAC: Authorizing `identity:get_project(project_id=dc67e101f33749c8bd7bd73db47e8270)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:43.621109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66c6a1-e32e-4c06-8f60-a4cb72560d0f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:43.622800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 596/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:30:43 2022] GET /identity/v3/projects/dc67e101f33749c8bd7bd73db47e8270 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:43.629957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d915ed7-a64d-484b-bebf-5aff1f226f10 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:43.734388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d915ed7-a64d-484b-bebf-5aff1f226f10 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:43.757260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:43.769579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eaaa9f-3b88-46aa-be84-6206d4b1ac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:43.770461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaaa9f-3b88-46aa-be84-6206d4b1ac6b None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:43.770752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaaa9f-3b88-46aa-be84-6206d4b1ac6b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:43.771032 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaaa9f-3b88-46aa-be84-6206d4b1ac6b None admin] PATH_INFO: `/v3/projects/dc67e101f33749c8bd7bd73db47e8270/users/75438948c062401196ff3348196e8d77/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:43.773027 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eaaa9f-3b88-46aa-be84-6206d4b1ac6b None admin] RBAC: Authorizing `identity:create_grant(project_id=dc67e101f33749c8bd7bd73db47e8270, user_id=75438948c062401196ff3348196e8d77, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:43.774460 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eaaa9f-3b88-46aa-be84-6206d4b1ac6b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:43.787194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 596/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:30:43 2022] PUT /identity/v3/projects/dc67e101f33749c8bd7bd73db47e8270/users/75438948c062401196ff3348196e8d77/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:30:45.813129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ab5f2-0868-47d3-8ed1-47ccc6ac530c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:45.813637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ab5f2-0868-47d3-8ed1-47ccc6ac530c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:45.813760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ab5f2-0868-47d3-8ed1-47ccc6ac530c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:45.815644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 597/1193] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:30:45.820719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e8620-eb58-4308-b4f0-209ebb5f1b7f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:45.821093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e8620-eb58-4308-b4f0-209ebb5f1b7f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:45.821288 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e8620-eb58-4308-b4f0-209ebb5f1b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:45.839235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-271e8620-eb58-4308-b4f0-209ebb5f1b7f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:30:45.840370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-271e8620-eb58-4308-b4f0-209ebb5f1b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:30:45.906767 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 597/1194] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:30:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:30:45.934382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ab5f2-0868-47d3-8ed1-47ccc6ac530c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:45.976371 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:46.036091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ab5f2-0868-47d3-8ed1-47ccc6ac530c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:46.067305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1777d-a37e-48dd-876c-f63498e8602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:46.068081 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1777d-a37e-48dd-876c-f63498e8602a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:46.068362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1777d-a37e-48dd-876c-f63498e8602a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:46.068636 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1777d-a37e-48dd-876c-f63498e8602a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:46.078836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1777d-a37e-48dd-876c-f63498e8602a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f2b1777d-a37e-48dd-876c-f63498e8602a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:30:46.086852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:30:46.087984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:30:46.088989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:30:46.088989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:30:46.088989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:30:46.088989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:30:46.088989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:30:46.088989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:30:46.088989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:30:46.088989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:30:46.088989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:30:46.088989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:30:46.088989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:30:46.088989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:30:46.088989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 598/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:30:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:30:46.094196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e8620-eb58-4308-b4f0-209ebb5f1b7f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:46.190350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e8620-eb58-4308-b4f0-209ebb5f1b7f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:46.202988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:46.225970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1532625-c31d-43a6-aa7c-3d706b71af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:46.226634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532625-c31d-43a6-aa7c-3d706b71af28 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:46.226921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532625-c31d-43a6-aa7c-3d706b71af28 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:46.227222 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532625-c31d-43a6-aa7c-3d706b71af28 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:46.227971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1532625-c31d-43a6-aa7c-3d706b71af28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:46.228282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1532625-c31d-43a6-aa7c-3d706b71af28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:46.229645 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1532625-c31d-43a6-aa7c-3d706b71af28 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:46.238095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 598/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:30:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:46.243914 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1777d-a37e-48dd-876c-f63498e8602a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:46.341178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:46.344769 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1777d-a37e-48dd-876c-f63498e8602a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:46.377448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10506dba-7b89-495d-8067-071dc90255a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:46.378310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10506dba-7b89-495d-8067-071dc90255a9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:46.378592 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10506dba-7b89-495d-8067-071dc90255a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:46.378868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10506dba-7b89-495d-8067-071dc90255a9 None admin] PATH_INFO: `/v3/users/75438948c062401196ff3348196e8d77` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:46.380072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10506dba-7b89-495d-8067-071dc90255a9 None admin] RBAC: Authorizing `identity:get_user(user_id=75438948c062401196ff3348196e8d77)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:46.381504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10506dba-7b89-495d-8067-071dc90255a9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:46.383125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 599/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jul 6 20:30:46 2022] GET /identity/v3/users/75438948c062401196ff3348196e8d77 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:46.388988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1532625-c31d-43a6-aa7c-3d706b71af28 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:46.486930 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1532625-c31d-43a6-aa7c-3d706b71af28 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:46.519709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860744f1-ddb8-41d4-ab7e-fa94ff413991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:46.520369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860744f1-ddb8-41d4-ab7e-fa94ff413991 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:46.520635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860744f1-ddb8-41d4-ab7e-fa94ff413991 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:46.520914 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860744f1-ddb8-41d4-ab7e-fa94ff413991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:46.561683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:46.588829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860744f1-ddb8-41d4-ab7e-fa94ff413991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:46.590310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860744f1-ddb8-41d4-ab7e-fa94ff413991 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:46.686711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 599/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:30:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:30:46.693116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10506dba-7b89-495d-8067-071dc90255a9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:46.789631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10506dba-7b89-495d-8067-071dc90255a9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:46.822565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ea48a-3084-4198-a07f-5d9554d670e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:46.823442 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ea48a-3084-4198-a07f-5d9554d670e4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:46.823725 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ea48a-3084-4198-a07f-5d9554d670e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:46.824001 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ea48a-3084-4198-a07f-5d9554d670e4 None admin] PATH_INFO: `/v3/projects/dc67e101f33749c8bd7bd73db47e8270` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:46.825165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ea48a-3084-4198-a07f-5d9554d670e4 None admin] RBAC: Authorizing `identity:get_project(project_id=dc67e101f33749c8bd7bd73db47e8270)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:46.826581 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ea48a-3084-4198-a07f-5d9554d670e4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:46.828289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 600/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jul 6 20:30:46 2022] GET /identity/v3/projects/dc67e101f33749c8bd7bd73db47e8270 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:46.834796 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860744f1-ddb8-41d4-ab7e-fa94ff413991 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:30:46.907045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:46.932795 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860744f1-ddb8-41d4-ab7e-fa94ff413991 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:30:46.966300 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8809d-d39e-4f39-b1a3-3d11d6b11aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:30:46.966892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8809d-d39e-4f39-b1a3-3d11d6b11aaf None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:30:46.967193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8809d-d39e-4f39-b1a3-3d11d6b11aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:30:46.967468 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8809d-d39e-4f39-b1a3-3d11d6b11aaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:30:46.968280 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8809d-d39e-4f39-b1a3-3d11d6b11aaf None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=dc67e101f33749c8bd7bd73db47e8270, user.id=75438948c062401196ff3348196e8d77) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:30:46.968589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8809d-d39e-4f39-b1a3-3d11d6b11aaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:30:46.970003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8809d-d39e-4f39-b1a3-3d11d6b11aaf None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:30:46.976584 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 600/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:30:46 2022] GET /identity/v3/role_assignments?user.id=75438948c062401196ff3348196e8d77&scope.project.id=dc67e101f33749c8bd7bd73db47e8270&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:30:56.818126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=83 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:30:56.974404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=31 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:42.962652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71774ec5-0b99-4653-aaac-ac3e85d253ef None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:42.963226 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71774ec5-0b99-4653-aaac-ac3e85d253ef None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:42.963226 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71774ec5-0b99-4653-aaac-ac3e85d253ef None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:42.964587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 601/1201] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:31:42.969862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd6365-34ef-47c5-937a-acec585c39a5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:42.970484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd6365-34ef-47c5-937a-acec585c39a5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:42.970625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd6365-34ef-47c5-937a-acec585c39a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:42.995031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ffcd6365-34ef-47c5-937a-acec585c39a5 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:42.996384 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ffcd6365-34ef-47c5-937a-acec585c39a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:43.099223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 601/1202] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:31:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:31:43.121654 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71774ec5-0b99-4653-aaac-ac3e85d253ef None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:43.251013 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71774ec5-0b99-4653-aaac-ac3e85d253ef None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:43.296760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e20b98-661a-4d4d-9d59-f985925e4711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:43.297573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e20b98-661a-4d4d-9d59-f985925e4711 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:43.297865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e20b98-661a-4d4d-9d59-f985925e4711 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:43.298182 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e20b98-661a-4d4d-9d59-f985925e4711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:43.316613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e20b98-661a-4d4d-9d59-f985925e4711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:43.318541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e20b98-661a-4d4d-9d59-f985925e4711 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-75e20b98-661a-4d4d-9d59-f985925e4711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:31:43.340437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:43.341516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:43.342483 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:31:43.342483 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:31:43.342483 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:43.342483 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:31:43.342483 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 602/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:31:43.348418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd6365-34ef-47c5-937a-acec585c39a5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:43.480072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd6365-34ef-47c5-937a-acec585c39a5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:43.523086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:43.532453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a086181-3b0e-4a8f-8517-035af7325d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:43.533842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a086181-3b0e-4a8f-8517-035af7325d42 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:43.534130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a086181-3b0e-4a8f-8517-035af7325d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:43.534417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a086181-3b0e-4a8f-8517-035af7325d42 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:43.535154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a086181-3b0e-4a8f-8517-035af7325d42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:43.535574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a086181-3b0e-4a8f-8517-035af7325d42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:43.539092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a086181-3b0e-4a8f-8517-035af7325d42 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:43.552566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 602/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:43.558339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e20b98-661a-4d4d-9d59-f985925e4711 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:43.625296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:43.692595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e20b98-661a-4d4d-9d59-f985925e4711 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:43.752120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d82ee0-a9dd-43d2-95a3-697b4e80cfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:43.753293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d82ee0-a9dd-43d2-95a3-697b4e80cfce None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:43.753794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d82ee0-a9dd-43d2-95a3-697b4e80cfce None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:43.754278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d82ee0-a9dd-43d2-95a3-697b4e80cfce None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:43.755255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d82ee0-a9dd-43d2-95a3-697b4e80cfce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:43.756735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d82ee0-a9dd-43d2-95a3-697b4e80cfce None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:43.787669 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 603/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jul 6 20:31:43 2022] POST /identity/v3/users => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:31:46.062940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8939f1-cacc-46db-8450-557f3c9e32cb None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.063531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8939f1-cacc-46db-8450-557f3c9e32cb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.063531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8939f1-cacc-46db-8450-557f3c9e32cb None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.067204 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 603/1206] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:31:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:31:46.072661 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2da6e-eae5-476d-9019-8b55f974ab25 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.073194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2da6e-eae5-476d-9019-8b55f974ab25 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.073362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2da6e-eae5-476d-9019-8b55f974ab25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.092370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d4c2da6e-eae5-476d-9019-8b55f974ab25 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:46.093661 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d4c2da6e-eae5-476d-9019-8b55f974ab25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:46.178956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 604/1207] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:31:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:31:46.203209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8939f1-cacc-46db-8450-557f3c9e32cb None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:46.331513 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8939f1-cacc-46db-8450-557f3c9e32cb None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:46.371727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc1dd5-bf51-459a-b764-eace21288e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:46.372520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc1dd5-bf51-459a-b764-eace21288e8a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.375924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc1dd5-bf51-459a-b764-eace21288e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.375924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc1dd5-bf51-459a-b764-eace21288e8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.389572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc1dd5-bf51-459a-b764-eace21288e8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-0fdc1dd5-bf51-459a-b764-eace21288e8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:31:46.398348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:46.399929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:46.401065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:46.401065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:46.401065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:46.401065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:46.401065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:31:46.401065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:31:46.401065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:31:46.401065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:31:46.401065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:31:46.401065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:31:46.401065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:31:46.401065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:31:46.401065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 604/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:31:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:31:46.406003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2da6e-eae5-476d-9019-8b55f974ab25 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:46.450768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:46.536303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2da6e-eae5-476d-9019-8b55f974ab25 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:46.574011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce26766-c64e-40cc-85fe-74fd097cd21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:46.574817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce26766-c64e-40cc-85fe-74fd097cd21f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.575248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce26766-c64e-40cc-85fe-74fd097cd21f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.575534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce26766-c64e-40cc-85fe-74fd097cd21f None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.576409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce26766-c64e-40cc-85fe-74fd097cd21f None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:46.576722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce26766-c64e-40cc-85fe-74fd097cd21f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:46.578339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce26766-c64e-40cc-85fe-74fd097cd21f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:46.593906 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 605/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:31:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:46.596416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc1dd5-bf51-459a-b764-eace21288e8a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:46.658801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:46.721530 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc1dd5-bf51-459a-b764-eace21288e8a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:46.762762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddfb31-45f3-4ad6-b3dc-dcb586eafa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:46.763870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddfb31-45f3-4ad6-b3dc-dcb586eafa1c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.764149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddfb31-45f3-4ad6-b3dc-dcb586eafa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.764419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddfb31-45f3-4ad6-b3dc-dcb586eafa1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.776923 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddfb31-45f3-4ad6-b3dc-dcb586eafa1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:46.778529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddfb31-45f3-4ad6-b3dc-dcb586eafa1c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-71ddfb31-45f3-4ad6-b3dc-dcb586eafa1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:31:46.796182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:46.797290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:46.799080 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:31:46.799080 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:31:46.799080 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:46.799080 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:31:46.799080 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 605/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:31:46.803975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce26766-c64e-40cc-85fe-74fd097cd21f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:46.915148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:46.918259 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce26766-c64e-40cc-85fe-74fd097cd21f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:46.955431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329393a-25f1-416e-8dfd-e8e5a5eb0fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:46.956098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329393a-25f1-416e-8dfd-e8e5a5eb0fbc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:46.956434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329393a-25f1-416e-8dfd-e8e5a5eb0fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:46.956679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329393a-25f1-416e-8dfd-e8e5a5eb0fbc None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:46.957421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329393a-25f1-416e-8dfd-e8e5a5eb0fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:46.957774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329393a-25f1-416e-8dfd-e8e5a5eb0fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:46.959217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329393a-25f1-416e-8dfd-e8e5a5eb0fbc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:46.972602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 606/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:46.978535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddfb31-45f3-4ad6-b3dc-dcb586eafa1c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:47.099823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddfb31-45f3-4ad6-b3dc-dcb586eafa1c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:47.101497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:47.141014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf1096-6f11-4a75-a0d4-7a63554ab7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:47.143228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf1096-6f11-4a75-a0d4-7a63554ab7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:47.143228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf1096-6f11-4a75-a0d4-7a63554ab7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:47.143228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf1096-6f11-4a75-a0d4-7a63554ab7d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:47.151605 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf1096-6f11-4a75-a0d4-7a63554ab7d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:47.153304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf1096-6f11-4a75-a0d4-7a63554ab7d7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-e7cf1096-6f11-4a75-a0d4-7a63554ab7d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:31:47.169776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:47.170895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:47.171977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:47.171977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:47.171977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:31:47.171977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:31:47.171977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:31:47.171977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:31:47.171977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:31:47.171977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:31:47.171977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:31:47.171977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:31:47.177512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 606/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:31:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:31:47.177662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329393a-25f1-416e-8dfd-e8e5a5eb0fbc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:47.292724 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329393a-25f1-416e-8dfd-e8e5a5eb0fbc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:47.332457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f1dfb-3128-4ae9-a329-d152df26a05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:47.333170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f1dfb-3128-4ae9-a329-d152df26a05a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:47.333447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f1dfb-3128-4ae9-a329-d152df26a05a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:47.333723 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f1dfb-3128-4ae9-a329-d152df26a05a None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:47.334618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f1dfb-3128-4ae9-a329-d152df26a05a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:47.334936 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f1dfb-3128-4ae9-a329-d152df26a05a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:47.336509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f1dfb-3128-4ae9-a329-d152df26a05a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:47.359780 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 607/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Jul 6 20:31:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:47.363965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf1096-6f11-4a75-a0d4-7a63554ab7d7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:47.498511 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf1096-6f11-4a75-a0d4-7a63554ab7d7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:47.543318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae71c3-b521-4990-8e1e-e6299e4600fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:47.543983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae71c3-b521-4990-8e1e-e6299e4600fa None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:47.544296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae71c3-b521-4990-8e1e-e6299e4600fa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:47.544549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae71c3-b521-4990-8e1e-e6299e4600fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:47.576880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:47.627094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae71c3-b521-4990-8e1e-e6299e4600fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:47.628792 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae71c3-b521-4990-8e1e-e6299e4600fa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:47.752006 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 607/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:31:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 20:31:47.757530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f1dfb-3128-4ae9-a329-d152df26a05a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:47.778807 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:47.873300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f1dfb-3128-4ae9-a329-d152df26a05a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:47.911240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf1aa8-463e-43ea-a0b0-6102c24956af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:47.913437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf1aa8-463e-43ea-a0b0-6102c24956af None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:47.913766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf1aa8-463e-43ea-a0b0-6102c24956af None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:47.914043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf1aa8-463e-43ea-a0b0-6102c24956af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:47.926789 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf1aa8-463e-43ea-a0b0-6102c24956af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:47.928260 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf1aa8-463e-43ea-a0b0-6102c24956af None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2fdf1aa8-463e-43ea-a0b0-6102c24956af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:31:47.947816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:47.949003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:47.949902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:31:47.949902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:31:47.949902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:47.949902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:31:47.955205 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 608/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:31:47.956712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae71c3-b521-4990-8e1e-e6299e4600fa None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.034163 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:48.080327 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae71c3-b521-4990-8e1e-e6299e4600fa None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.119829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac9b20-c5d7-4ffe-a544-00701ae497bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.120530 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac9b20-c5d7-4ffe-a544-00701ae497bd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.120903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac9b20-c5d7-4ffe-a544-00701ae497bd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.121174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac9b20-c5d7-4ffe-a544-00701ae497bd None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.121900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac9b20-c5d7-4ffe-a544-00701ae497bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:48.122241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac9b20-c5d7-4ffe-a544-00701ae497bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.123692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac9b20-c5d7-4ffe-a544-00701ae497bd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.136682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 608/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:48.142422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf1aa8-463e-43ea-a0b0-6102c24956af None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.216590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:48.249031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf1aa8-463e-43ea-a0b0-6102c24956af None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.297591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce1f9c-9236-4b02-896f-e201a37717a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.299414 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce1f9c-9236-4b02-896f-e201a37717a0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.299799 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce1f9c-9236-4b02-896f-e201a37717a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.300814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce1f9c-9236-4b02-896f-e201a37717a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.309878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce1f9c-9236-4b02-896f-e201a37717a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.312287 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce1f9c-9236-4b02-896f-e201a37717a0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-47ce1f9c-9236-4b02-896f-e201a37717a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:31:48.332453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:48.333618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:48.336315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:31:48.336315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:31:48.336315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:31:48.336315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:31:48.336315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:31:48.336315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:31:48.336315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:31:48.336315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:31:48.336315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 609/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:31:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:31:48.339621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac9b20-c5d7-4ffe-a544-00701ae497bd None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.455569 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac9b20-c5d7-4ffe-a544-00701ae497bd None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.482361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:48.495886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5d2f7-1bb6-4f2a-8170-4bf708806efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.496702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d2f7-1bb6-4f2a-8170-4bf708806efd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.497008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d2f7-1bb6-4f2a-8170-4bf708806efd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.497358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d2f7-1bb6-4f2a-8170-4bf708806efd None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.498205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d2f7-1bb6-4f2a-8170-4bf708806efd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:48.498523 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d2f7-1bb6-4f2a-8170-4bf708806efd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.500149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d2f7-1bb6-4f2a-8170-4bf708806efd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.514096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 609/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:31:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:48.520132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce1f9c-9236-4b02-896f-e201a37717a0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:48.639624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce1f9c-9236-4b02-896f-e201a37717a0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:48.672118 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:48.680341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668812e6-109a-40e4-9941-cbdd0212a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:48.681346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668812e6-109a-40e4-9941-cbdd0212a679 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:48.681634 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668812e6-109a-40e4-9941-cbdd0212a679 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:48.682006 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668812e6-109a-40e4-9941-cbdd0212a679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:48.682862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668812e6-109a-40e4-9941-cbdd0212a679 None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=b98059ebef5d470db684fb78d19a8839) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:48.683318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668812e6-109a-40e4-9941-cbdd0212a679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:48.684877 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668812e6-109a-40e4-9941-cbdd0212a679 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:48.693117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 610/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:31:48 2022] GET /identity/v3/role_assignments?user.id=b98059ebef5d470db684fb78d19a8839&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:50.752289 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b608bb-e5b4-47b1-9065-70549ce93eb4 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:50.752830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b608bb-e5b4-47b1-9065-70549ce93eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:50.752997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b608bb-e5b4-47b1-9065-70549ce93eb4 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:50.754432 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 610/1220] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:31:50.759987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f56171-2ab2-4e55-abb2-0cd241ff7466 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:50.760456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f56171-2ab2-4e55-abb2-0cd241ff7466 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:50.760564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f56171-2ab2-4e55-abb2-0cd241ff7466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:50.778197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f9f56171-2ab2-4e55-abb2-0cd241ff7466 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:50.779421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f9f56171-2ab2-4e55-abb2-0cd241ff7466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:50.854987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 611/1221] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:31:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:31:50.878386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b608bb-e5b4-47b1-9065-70549ce93eb4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:50.998442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b608bb-e5b4-47b1-9065-70549ce93eb4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:51.035084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf11677-ef32-4a7c-83e7-2e9781c4c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:51.036025 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf11677-ef32-4a7c-83e7-2e9781c4c035 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:51.036308 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf11677-ef32-4a7c-83e7-2e9781c4c035 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:51.036660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf11677-ef32-4a7c-83e7-2e9781c4c035 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:51.048056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf11677-ef32-4a7c-83e7-2e9781c4c035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-acf11677-ef32-4a7c-83e7-2e9781c4c035 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:31:51.055746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:51.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:51.057995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:51.057995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:51.057995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:51.057995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:51.057995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:31:51.057995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:31:51.057995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:31:51.057995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:31:51.057995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:31:51.057995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:31:51.057995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:31:51.057995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:31:51.057995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 611/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:31:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:31:51.065180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f56171-2ab2-4e55-abb2-0cd241ff7466 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:51.175273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f56171-2ab2-4e55-abb2-0cd241ff7466 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:51.201478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:51.212625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03368c-2a3c-473b-a416-ddd879673915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:51.213297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03368c-2a3c-473b-a416-ddd879673915 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:51.213584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03368c-2a3c-473b-a416-ddd879673915 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:51.213859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03368c-2a3c-473b-a416-ddd879673915 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:51.214605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03368c-2a3c-473b-a416-ddd879673915 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:51.214917 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03368c-2a3c-473b-a416-ddd879673915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:51.216321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03368c-2a3c-473b-a416-ddd879673915 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:51.224424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 612/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:31:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:51.230345 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf11677-ef32-4a7c-83e7-2e9781c4c035 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:51.276046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:51.348500 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf11677-ef32-4a7c-83e7-2e9781c4c035 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:51.388582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad919f54-6243-4f69-9ce0-23f3a833689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:51.389374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad919f54-6243-4f69-9ce0-23f3a833689f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:51.389756 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad919f54-6243-4f69-9ce0-23f3a833689f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:51.390115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad919f54-6243-4f69-9ce0-23f3a833689f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:51.402366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad919f54-6243-4f69-9ce0-23f3a833689f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:51.403879 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad919f54-6243-4f69-9ce0-23f3a833689f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-ad919f54-6243-4f69-9ce0-23f3a833689f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:31:51.421926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:51.423624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:51.424940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:31:51.424940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:31:51.424940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:51.424940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:31:51.424940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 612/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:31:51.429738 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03368c-2a3c-473b-a416-ddd879673915 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:51.540060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03368c-2a3c-473b-a416-ddd879673915 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:51.577477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7060df2-e386-4728-aa89-7d6d712e38c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:51.578143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060df2-e386-4728-aa89-7d6d712e38c4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:51.578434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060df2-e386-4728-aa89-7d6d712e38c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:51.578714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060df2-e386-4728-aa89-7d6d712e38c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:51.579569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7060df2-e386-4728-aa89-7d6d712e38c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:51.580064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7060df2-e386-4728-aa89-7d6d712e38c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:51.581440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7060df2-e386-4728-aa89-7d6d712e38c4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:51.596338 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 613/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:51.602171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad919f54-6243-4f69-9ce0-23f3a833689f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:51.705540 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:51.714076 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad919f54-6243-4f69-9ce0-23f3a833689f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:51.749448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff3a21-40a9-4429-a6d4-63eee57add55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:51.750245 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff3a21-40a9-4429-a6d4-63eee57add55 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:51.750527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff3a21-40a9-4429-a6d4-63eee57add55 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:51.750826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff3a21-40a9-4429-a6d4-63eee57add55 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:51.758450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff3a21-40a9-4429-a6d4-63eee57add55 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:51.759909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff3a21-40a9-4429-a6d4-63eee57add55 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-2fff3a21-40a9-4429-a6d4-63eee57add55 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:31:51.774718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:51.775886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:51.777156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:51.777156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:51.777156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:31:51.777156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:31:51.777156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:31:51.777156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:31:51.777156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:31:51.777156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:31:51.777156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:31:51.777156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:31:51.777156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 613/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:31:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:31:51.782886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7060df2-e386-4728-aa89-7d6d712e38c4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:51.833592 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:51.888762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7060df2-e386-4728-aa89-7d6d712e38c4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:51.932878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d83a2-0ed2-45a1-96aa-932c008576f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:51.933552 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d83a2-0ed2-45a1-96aa-932c008576f0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:51.933837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d83a2-0ed2-45a1-96aa-932c008576f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:51.934107 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d83a2-0ed2-45a1-96aa-932c008576f0 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:51.934967 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d83a2-0ed2-45a1-96aa-932c008576f0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:51.935269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d83a2-0ed2-45a1-96aa-932c008576f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:51.936703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d83a2-0ed2-45a1-96aa-932c008576f0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:51.955740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 614/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Jul 6 20:31:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:51.961362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff3a21-40a9-4429-a6d4-63eee57add55 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:52.072576 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff3a21-40a9-4429-a6d4-63eee57add55 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:52.108983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1134d12-a028-4d59-bf86-2ba45cf31d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:52.109907 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1134d12-a028-4d59-bf86-2ba45cf31d86 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:52.110253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1134d12-a028-4d59-bf86-2ba45cf31d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:52.111278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1134d12-a028-4d59-bf86-2ba45cf31d86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:52.127555 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1134d12-a028-4d59-bf86-2ba45cf31d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:52.129130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1134d12-a028-4d59-bf86-2ba45cf31d86 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-e1134d12-a028-4d59-bf86-2ba45cf31d86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:31:52.151542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:52.152917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:52.153968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:31:52.153968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:31:52.153968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:52.153968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:31:52.153968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 614/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:31:52.159602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d83a2-0ed2-45a1-96aa-932c008576f0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:52.277903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d83a2-0ed2-45a1-96aa-932c008576f0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:52.280645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:52.324437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e0d60-035e-4041-b8a9-edf8a7a745d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:52.325165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e0d60-035e-4041-b8a9-edf8a7a745d5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:52.325476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e0d60-035e-4041-b8a9-edf8a7a745d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:52.325768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e0d60-035e-4041-b8a9-edf8a7a745d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:52.326545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e0d60-035e-4041-b8a9-edf8a7a745d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:52.326890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e0d60-035e-4041-b8a9-edf8a7a745d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:52.328409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e0d60-035e-4041-b8a9-edf8a7a745d5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:52.341147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 615/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:52.347563 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1134d12-a028-4d59-bf86-2ba45cf31d86 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:52.358183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:52.476354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1134d12-a028-4d59-bf86-2ba45cf31d86 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:52.515967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e02106-64cd-4766-855b-77f40b561b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:52.517614 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02106-64cd-4766-855b-77f40b561b16 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:52.517878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02106-64cd-4766-855b-77f40b561b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:52.518153 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02106-64cd-4766-855b-77f40b561b16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:52.526096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e02106-64cd-4766-855b-77f40b561b16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:52.527844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e02106-64cd-4766-855b-77f40b561b16 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-d1e02106-64cd-4766-855b-77f40b561b16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:31:52.544609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:52.545784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:52.547023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:31:52.547023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:31:52.547023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:31:52.547023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:31:52.547023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:31:52.547023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:31:52.547023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:31:52.547023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:31:52.547023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 615/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:31:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:31:52.552761 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e0d60-035e-4041-b8a9-edf8a7a745d5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:52.691654 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e0d60-035e-4041-b8a9-edf8a7a745d5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:52.741060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d4ff7-e431-4af2-aa81-193218392564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:52.741755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d4ff7-e431-4af2-aa81-193218392564 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:52.742047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d4ff7-e431-4af2-aa81-193218392564 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:52.742331 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d4ff7-e431-4af2-aa81-193218392564 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:52.743130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d4ff7-e431-4af2-aa81-193218392564 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:52.743584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d4ff7-e431-4af2-aa81-193218392564 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:52.745138 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d4ff7-e431-4af2-aa81-193218392564 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:52.757547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 616/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:31:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:52.763926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e02106-64cd-4766-855b-77f40b561b16 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:52.841518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:52.883115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e02106-64cd-4766-855b-77f40b561b16 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:52.926097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6de1c-f5b0-4d28-a19f-fce9874e2446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:52.927002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6de1c-f5b0-4d28-a19f-fce9874e2446 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:52.927417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6de1c-f5b0-4d28-a19f-fce9874e2446 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:52.927697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6de1c-f5b0-4d28-a19f-fce9874e2446 None admin] PATH_INFO: `/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/b98059ebef5d470db684fb78d19a8839/roles/55dba566c5b54bc488719c0c5bb0ce15` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:52.945664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6de1c-f5b0-4d28-a19f-fce9874e2446 None admin] RBAC: Authorizing `identity:create_grant(project_id=8eda6c9cf4b1439eb280b0db35b3bce2, user_id=b98059ebef5d470db684fb78d19a8839, role_id=55dba566c5b54bc488719c0c5bb0ce15)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:52.947367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6de1c-f5b0-4d28-a19f-fce9874e2446 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:52.961470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 616/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:31:52 2022] PUT /identity/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/b98059ebef5d470db684fb78d19a8839/roles/55dba566c5b54bc488719c0c5bb0ce15 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:31:55.249182 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a45e-3eda-4c6f-88d8-26be16cb58c5 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:55.249717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a45e-3eda-4c6f-88d8-26be16cb58c5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:55.249717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a45e-3eda-4c6f-88d8-26be16cb58c5 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:55.251797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 617/1233] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:31:55.257017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fea9d-6c3a-4385-a2a9-0ac1204c70b3 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:55.257421 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fea9d-6c3a-4385-a2a9-0ac1204c70b3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:55.257573 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fea9d-6c3a-4385-a2a9-0ac1204c70b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:55.275767 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4c8fea9d-6c3a-4385-a2a9-0ac1204c70b3 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:31:55.277234 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4c8fea9d-6c3a-4385-a2a9-0ac1204c70b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:31:55.356367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 617/1234] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:31:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:31:55.380663 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a45e-3eda-4c6f-88d8-26be16cb58c5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:55.406858 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:55.494487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a45e-3eda-4c6f-88d8-26be16cb58c5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:55.533759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414fb7b-6aeb-40e4-b1f2-7d0c8a595c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:55.534467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414fb7b-6aeb-40e4-b1f2-7d0c8a595c6a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:55.534747 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414fb7b-6aeb-40e4-b1f2-7d0c8a595c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:55.535019 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414fb7b-6aeb-40e4-b1f2-7d0c8a595c6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:55.546183 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414fb7b-6aeb-40e4-b1f2-7d0c8a595c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1414fb7b-6aeb-40e4-b1f2-7d0c8a595c6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:31:55.554810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:55.555865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:55.556749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:55.556749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:55.556749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:55.556749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:55.556749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:31:55.556749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:31:55.556749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:31:55.556749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:31:55.556749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:31:55.556749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:31:55.556749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 20:31:55.556749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:31:55.556749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 618/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jul 6 20:31:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:31:55.562119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fea9d-6c3a-4385-a2a9-0ac1204c70b3 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:55.616682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:55.677863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fea9d-6c3a-4385-a2a9-0ac1204c70b3 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:55.714275 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd6e8c-508d-49ab-9b57-3f25feaa3bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:55.714872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd6e8c-508d-49ab-9b57-3f25feaa3bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:55.715163 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd6e8c-508d-49ab-9b57-3f25feaa3bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:55.715464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd6e8c-508d-49ab-9b57-3f25feaa3bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:55.716205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd6e8c-508d-49ab-9b57-3f25feaa3bb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:55.716517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd6e8c-508d-49ab-9b57-3f25feaa3bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:55.717876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd6e8c-508d-49ab-9b57-3f25feaa3bb5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:55.726769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 618/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jul 6 20:31:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:55.732491 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414fb7b-6aeb-40e4-b1f2-7d0c8a595c6a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:55.831489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:55.851543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414fb7b-6aeb-40e4-b1f2-7d0c8a595c6a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:55.893051 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88842523-036a-4114-9a97-6d6166e796be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:55.893851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842523-036a-4114-9a97-6d6166e796be None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:55.894135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842523-036a-4114-9a97-6d6166e796be None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:55.894414 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842523-036a-4114-9a97-6d6166e796be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:55.905721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88842523-036a-4114-9a97-6d6166e796be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:55.907771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88842523-036a-4114-9a97-6d6166e796be None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-88842523-036a-4114-9a97-6d6166e796be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:31:55.927966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:55.929100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:55.930141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:31:55.930141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:31:55.930141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:55.930141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:31:55.930141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 619/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:31:55.936376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd6e8c-508d-49ab-9b57-3f25feaa3bb5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:56.048848 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd6e8c-508d-49ab-9b57-3f25feaa3bb5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:56.058073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:56.087194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf954e-b7f6-4968-a9e9-3eb2f21e854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:56.087799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf954e-b7f6-4968-a9e9-3eb2f21e854c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:56.088089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf954e-b7f6-4968-a9e9-3eb2f21e854c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:56.088374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf954e-b7f6-4968-a9e9-3eb2f21e854c None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:56.089091 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf954e-b7f6-4968-a9e9-3eb2f21e854c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:56.089402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf954e-b7f6-4968-a9e9-3eb2f21e854c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:56.090801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf954e-b7f6-4968-a9e9-3eb2f21e854c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:56.104748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 619/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:56.111637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88842523-036a-4114-9a97-6d6166e796be None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:56.227856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88842523-036a-4114-9a97-6d6166e796be None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:56.264486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15b538-17bf-4992-9b27-798dd0f0db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:56.265273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15b538-17bf-4992-9b27-798dd0f0db00 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:56.265553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15b538-17bf-4992-9b27-798dd0f0db00 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:56.265899 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15b538-17bf-4992-9b27-798dd0f0db00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:56.268801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:56.274909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15b538-17bf-4992-9b27-798dd0f0db00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:56.276616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15b538-17bf-4992-9b27-798dd0f0db00 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ce15b538-17bf-4992-9b27-798dd0f0db00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:31:56.293376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:56.294737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:56.295730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:56.295730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:56.295730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:31:56.295730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:31:56.295730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:31:56.295730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:31:56.295730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:31:56.295730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:31:56.295730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:31:56.295730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:31:56.295730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 620/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:31:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:31:56.301327 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf954e-b7f6-4968-a9e9-3eb2f21e854c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:56.424349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf954e-b7f6-4968-a9e9-3eb2f21e854c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:56.461830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e159f-64f0-41d4-8b69-4c62b5c6e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:56.462512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e159f-64f0-41d4-8b69-4c62b5c6e868 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:56.462796 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e159f-64f0-41d4-8b69-4c62b5c6e868 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:56.463081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e159f-64f0-41d4-8b69-4c62b5c6e868 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:56.463950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e159f-64f0-41d4-8b69-4c62b5c6e868 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:56.464260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e159f-64f0-41d4-8b69-4c62b5c6e868 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:56.465698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e159f-64f0-41d4-8b69-4c62b5c6e868 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:56.484137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 620/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Jul 6 20:31:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:56.490715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15b538-17bf-4992-9b27-798dd0f0db00 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:56.607284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15b538-17bf-4992-9b27-798dd0f0db00 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:56.646939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabe861-006b-4bb6-b46d-d79db14a3fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:56.647624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabe861-006b-4bb6-b46d-d79db14a3fbf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:56.647908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabe861-006b-4bb6-b46d-d79db14a3fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:56.648181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabe861-006b-4bb6-b46d-d79db14a3fbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:56.719881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:56.726661 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabe861-006b-4bb6-b46d-d79db14a3fbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:56.728181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabe861-006b-4bb6-b46d-d79db14a3fbf None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:56.841349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 621/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:31:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:31:56.847427 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e159f-64f0-41d4-8b69-4c62b5c6e868 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:56.875501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:56.952642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e159f-64f0-41d4-8b69-4c62b5c6e868 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:56.992013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ebdf3-3c50-4a5e-b593-49baea87afc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:56.992739 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ebdf3-3c50-4a5e-b593-49baea87afc1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:56.993024 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ebdf3-3c50-4a5e-b593-49baea87afc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:56.993311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ebdf3-3c50-4a5e-b593-49baea87afc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:57.005467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ebdf3-3c50-4a5e-b593-49baea87afc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:57.007117 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ebdf3-3c50-4a5e-b593-49baea87afc1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-828ebdf3-3c50-4a5e-b593-49baea87afc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:31:57.029682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:57.030964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:57.032052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:31:57.032052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:31:57.032052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:31:57.032052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:31:57.032052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 621/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:31:57.037965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabe861-006b-4bb6-b46d-d79db14a3fbf None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:57.146893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:57.155957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabe861-006b-4bb6-b46d-d79db14a3fbf None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:57.195890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf7464-3cac-4651-bf64-77559d7c5612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:57.196542 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf7464-3cac-4651-bf64-77559d7c5612 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:57.196844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf7464-3cac-4651-bf64-77559d7c5612 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:57.197097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf7464-3cac-4651-bf64-77559d7c5612 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:57.198183 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf7464-3cac-4651-bf64-77559d7c5612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:57.198482 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf7464-3cac-4651-bf64-77559d7c5612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:57.199997 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf7464-3cac-4651-bf64-77559d7c5612 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:57.217658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 622/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:57.219007 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ebdf3-3c50-4a5e-b593-49baea87afc1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:57.310281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:31:57.336329 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ebdf3-3c50-4a5e-b593-49baea87afc1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:57.377026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953ed71-06e9-4547-ad82-754d8a0e01a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:57.377963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953ed71-06e9-4547-ad82-754d8a0e01a3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:57.378281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953ed71-06e9-4547-ad82-754d8a0e01a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:57.378558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953ed71-06e9-4547-ad82-754d8a0e01a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:57.386148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953ed71-06e9-4547-ad82-754d8a0e01a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:57.387711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953ed71-06e9-4547-ad82-754d8a0e01a3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-7953ed71-06e9-4547-ad82-754d8a0e01a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:31:57.405122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:31:57.406224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:31:57.407997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:31:57.407997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:31:57.407997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:31:57.407997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:31:57.407997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:31:57.407997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:31:57.407997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:31:57.407997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:31:57.407997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 622/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:31:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:31:57.413055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf7464-3cac-4651-bf64-77559d7c5612 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:57.517594 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf7464-3cac-4651-bf64-77559d7c5612 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:57.553886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad668d-f763-4f3a-b19b-84ef18c9f613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:57.554545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad668d-f763-4f3a-b19b-84ef18c9f613 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:57.554830 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad668d-f763-4f3a-b19b-84ef18c9f613 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:57.555111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad668d-f763-4f3a-b19b-84ef18c9f613 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:57.555928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad668d-f763-4f3a-b19b-84ef18c9f613 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:57.556237 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad668d-f763-4f3a-b19b-84ef18c9f613 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:57.557677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad668d-f763-4f3a-b19b-84ef18c9f613 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:57.569952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 623/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:31:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:31:57.577504 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953ed71-06e9-4547-ad82-754d8a0e01a3 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:31:57.689310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953ed71-06e9-4547-ad82-754d8a0e01a3 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:31:57.726817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807aaefd-ce27-40e1-89bc-a99e6bac5ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:31:57.727978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aaefd-ce27-40e1-89bc-a99e6bac5ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:31:57.728233 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aaefd-ce27-40e1-89bc-a99e6bac5ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:31:57.728533 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aaefd-ce27-40e1-89bc-a99e6bac5ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:31:57.729411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807aaefd-ce27-40e1-89bc-a99e6bac5ca0 None admin] RBAC: Adding query filter params (role.id=55dba566c5b54bc488719c0c5bb0ce15, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=b98059ebef5d470db684fb78d19a8839) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:31:57.729727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807aaefd-ce27-40e1-89bc-a99e6bac5ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:31:57.731186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807aaefd-ce27-40e1-89bc-a99e6bac5ca0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:31:57.737974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 623/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:31:57 2022] GET /identity/v3/role_assignments?user.id=b98059ebef5d470db684fb78d19a8839&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=55dba566c5b54bc488719c0c5bb0ce15 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:00.283503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c6925-dbd0-41af-a340-ad177786528a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.284072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c6925-dbd0-41af-a340-ad177786528a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.284072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c6925-dbd0-41af-a340-ad177786528a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.285845 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 624/1247] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:32:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:32:00.291714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f10af-5907-4d97-8b2a-70d0e86904fb None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.292170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f10af-5907-4d97-8b2a-70d0e86904fb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.292262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f10af-5907-4d97-8b2a-70d0e86904fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.298417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:00.327206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a06f10af-5907-4d97-8b2a-70d0e86904fb None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:00.327206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a06f10af-5907-4d97-8b2a-70d0e86904fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:00.408656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 624/1248] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:32:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:32:00.438509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c6925-dbd0-41af-a340-ad177786528a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:00.458779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:00.553996 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c6925-dbd0-41af-a340-ad177786528a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:00.589229 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa0897-9a9e-4184-b290-cb631be48984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:00.592276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa0897-9a9e-4184-b290-cb631be48984 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.592276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa0897-9a9e-4184-b290-cb631be48984 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.592276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa0897-9a9e-4184-b290-cb631be48984 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.601824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa0897-9a9e-4184-b290-cb631be48984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-15fa0897-9a9e-4184-b290-cb631be48984 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:32:00.613295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:00.614376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:00.615299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:00.615299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:00.615299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:00.615299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:00.615299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:32:00.615299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:32:00.615299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:32:00.615299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:32:00.615299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:32:00.615299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:32:00.615299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:32:00.615299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:32:00.615299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 625/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:32:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:32:00.616999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f10af-5907-4d97-8b2a-70d0e86904fb None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:00.732254 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f10af-5907-4d97-8b2a-70d0e86904fb None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:00.764033 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:00.772544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e7a00-c0b7-4998-a458-991a698f9674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:00.773311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e7a00-c0b7-4998-a458-991a698f9674 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.773624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e7a00-c0b7-4998-a458-991a698f9674 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.773975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e7a00-c0b7-4998-a458-991a698f9674 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.774780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e7a00-c0b7-4998-a458-991a698f9674 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:00.776342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e7a00-c0b7-4998-a458-991a698f9674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:00.776901 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e7a00-c0b7-4998-a458-991a698f9674 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:00.786913 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 625/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:32:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:32:00.792900 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa0897-9a9e-4184-b290-cb631be48984 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:00.879987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:00.907714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa0897-9a9e-4184-b290-cb631be48984 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:00.945531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa4b26-976e-48a6-911b-f87518bdb39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:00.946329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa4b26-976e-48a6-911b-f87518bdb39d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:00.946646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa4b26-976e-48a6-911b-f87518bdb39d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:00.946923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa4b26-976e-48a6-911b-f87518bdb39d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:00.958346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa4b26-976e-48a6-911b-f87518bdb39d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:00.959939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa4b26-976e-48a6-911b-f87518bdb39d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9faa4b26-976e-48a6-911b-f87518bdb39d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:32:00.978948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:00.980023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:00.981282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:32:00.981282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:32:00.981282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:32:00.981282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:32:00.981282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 626/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:00.986593 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e7a00-c0b7-4998-a458-991a698f9674 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.107506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e7a00-c0b7-4998-a458-991a698f9674 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.145100 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acc87a-028b-4fe5-b3bd-6679e0d92cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.145683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acc87a-028b-4fe5-b3bd-6679e0d92cdc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.145991 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acc87a-028b-4fe5-b3bd-6679e0d92cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.146388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acc87a-028b-4fe5-b3bd-6679e0d92cdc None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.147016 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acc87a-028b-4fe5-b3bd-6679e0d92cdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:01.147373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acc87a-028b-4fe5-b3bd-6679e0d92cdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.148927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acc87a-028b-4fe5-b3bd-6679e0d92cdc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.162492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 626/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:01.168221 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa4b26-976e-48a6-911b-f87518bdb39d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.287413 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa4b26-976e-48a6-911b-f87518bdb39d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.319577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:01.328560 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0f43c-d4cb-4d59-9554-fdb9b3e09296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.329654 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0f43c-d4cb-4d59-9554-fdb9b3e09296 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.330100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0f43c-d4cb-4d59-9554-fdb9b3e09296 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.330384 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0f43c-d4cb-4d59-9554-fdb9b3e09296 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.340903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0f43c-d4cb-4d59-9554-fdb9b3e09296 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.342463 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0f43c-d4cb-4d59-9554-fdb9b3e09296 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-87d0f43c-d4cb-4d59-9554-fdb9b3e09296 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:32:01.365875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:01.367440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:01.368677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:01.368677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:01.368677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:32:01.368677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:32:01.368677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:32:01.368677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:32:01.368677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:32:01.368677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:32:01.368677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:32:01.368677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:32:01.368677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 627/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:32:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:01.373588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acc87a-028b-4fe5-b3bd-6679e0d92cdc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.441324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:01.492365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acc87a-028b-4fe5-b3bd-6679e0d92cdc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.534000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd67231-46ab-4659-b40d-0ae4bade95c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.534676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd67231-46ab-4659-b40d-0ae4bade95c0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.534960 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd67231-46ab-4659-b40d-0ae4bade95c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.535269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd67231-46ab-4659-b40d-0ae4bade95c0 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.536104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd67231-46ab-4659-b40d-0ae4bade95c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:01.536416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd67231-46ab-4659-b40d-0ae4bade95c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.537905 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd67231-46ab-4659-b40d-0ae4bade95c0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.557573 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 627/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Jul 6 20:32:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:32:01.563959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0f43c-d4cb-4d59-9554-fdb9b3e09296 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:01.684767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0f43c-d4cb-4d59-9554-fdb9b3e09296 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:01.722068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89ecf0-65c9-4571-8267-2729fa2a6ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:01.723100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89ecf0-65c9-4571-8267-2729fa2a6ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:01.723654 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89ecf0-65c9-4571-8267-2729fa2a6ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:01.724164 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89ecf0-65c9-4571-8267-2729fa2a6ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:01.807689 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:01.824260 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89ecf0-65c9-4571-8267-2729fa2a6ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:01.825747 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89ecf0-65c9-4571-8267-2729fa2a6ab5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:01.940941 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 628/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:32:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:32:01.947296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd67231-46ab-4659-b40d-0ae4bade95c0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:02.073496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd67231-46ab-4659-b40d-0ae4bade95c0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.091681 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:02.117264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac762-22db-46fc-9743-672ba5aae802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.118060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac762-22db-46fc-9743-672ba5aae802 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.118342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac762-22db-46fc-9743-672ba5aae802 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.118624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac762-22db-46fc-9743-672ba5aae802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.129746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fac762-22db-46fc-9743-672ba5aae802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.131213 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fac762-22db-46fc-9743-672ba5aae802 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-d1fac762-22db-46fc-9743-672ba5aae802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:32:02.150671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:02.151964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:02.152866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:32:02.152866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:32:02.152866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:32:02.152866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:02.152866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 628/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:02.157296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89ecf0-65c9-4571-8267-2729fa2a6ab5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:02.257323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:02.273328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89ecf0-65c9-4571-8267-2729fa2a6ab5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.312522 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e52925-7778-4f5f-8cf7-457e7baeb6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.313817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e52925-7778-4f5f-8cf7-457e7baeb6ea None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.314656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e52925-7778-4f5f-8cf7-457e7baeb6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.314952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e52925-7778-4f5f-8cf7-457e7baeb6ea None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.315726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e52925-7778-4f5f-8cf7-457e7baeb6ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:02.316043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e52925-7778-4f5f-8cf7-457e7baeb6ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.317623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e52925-7778-4f5f-8cf7-457e7baeb6ea None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.331529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 629/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:32:02.337206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac762-22db-46fc-9743-672ba5aae802 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:02.455714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac762-22db-46fc-9743-672ba5aae802 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.492866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48553426-49b4-4332-b504-a73c8fd14a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.493747 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48553426-49b4-4332-b504-a73c8fd14a05 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.494073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48553426-49b4-4332-b504-a73c8fd14a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.494347 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48553426-49b4-4332-b504-a73c8fd14a05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.502116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48553426-49b4-4332-b504-a73c8fd14a05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.503657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48553426-49b4-4332-b504-a73c8fd14a05 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-48553426-49b4-4332-b504-a73c8fd14a05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:32:02.519140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:02.520587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:02.521763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:32:02.521763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:32:02.521763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:32:02.521763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:32:02.521763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:32:02.521763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:32:02.521763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:32:02.521763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:02.521763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 629/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:32:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:02.527819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e52925-7778-4f5f-8cf7-457e7baeb6ea None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:02.638273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e52925-7778-4f5f-8cf7-457e7baeb6ea None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.674823 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384ffb9-9e6d-41cb-82df-1e7fb0a62446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.675624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384ffb9-9e6d-41cb-82df-1e7fb0a62446 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.675917 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384ffb9-9e6d-41cb-82df-1e7fb0a62446 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.676236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384ffb9-9e6d-41cb-82df-1e7fb0a62446 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.677098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384ffb9-9e6d-41cb-82df-1e7fb0a62446 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:02.677419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384ffb9-9e6d-41cb-82df-1e7fb0a62446 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.678983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384ffb9-9e6d-41cb-82df-1e7fb0a62446 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.693194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 630/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:32:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:02.700456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48553426-49b4-4332-b504-a73c8fd14a05 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:02.730574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:02.822457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48553426-49b4-4332-b504-a73c8fd14a05 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:02.859742 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe716ee0-c900-4d0c-87df-dbb7faeba649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:02.861070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716ee0-c900-4d0c-87df-dbb7faeba649 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:02.861552 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716ee0-c900-4d0c-87df-dbb7faeba649 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:02.861864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716ee0-c900-4d0c-87df-dbb7faeba649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:02.863095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe716ee0-c900-4d0c-87df-dbb7faeba649 None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=b98059ebef5d470db684fb78d19a8839) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:02.863613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe716ee0-c900-4d0c-87df-dbb7faeba649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:02.865355 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe716ee0-c900-4d0c-87df-dbb7faeba649 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:02.872963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 630/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:32:02 2022] GET /identity/v3/role_assignments?user.id=b98059ebef5d470db684fb78d19a8839&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:04.948609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d92d2-3951-4113-9554-baefea24ee17 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:04.949101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d92d2-3951-4113-9554-baefea24ee17 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:04.949101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d92d2-3951-4113-9554-baefea24ee17 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:04.950456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 631/1261] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:32:04.956157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ddaba-2629-48eb-b8f7-a7062f65e44c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:04.956559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ddaba-2629-48eb-b8f7-a7062f65e44c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:04.956720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ddaba-2629-48eb-b8f7-a7062f65e44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:04.973705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2f5ddaba-2629-48eb-b8f7-a7062f65e44c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:04.974881 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2f5ddaba-2629-48eb-b8f7-a7062f65e44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:05.040083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 631/1262] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:32:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:32:05.062428 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d92d2-3951-4113-9554-baefea24ee17 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:05.073662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:05.160680 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d92d2-3951-4113-9554-baefea24ee17 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:05.193616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34b25-dba2-41e6-b1e0-632a660d0df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:05.194397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34b25-dba2-41e6-b1e0-632a660d0df0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:05.194664 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34b25-dba2-41e6-b1e0-632a660d0df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:05.194933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34b25-dba2-41e6-b1e0-632a660d0df0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:05.204819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a34b25-dba2-41e6-b1e0-632a660d0df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-07a34b25-dba2-41e6-b1e0-632a660d0df0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:32:05.212230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:05.213313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:05.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:05.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:05.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:05.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:05.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:32:05.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:32:05.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:32:05.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:32:05.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:32:05.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:32:05.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:32:05.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:32:05.214377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 632/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:05.220008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ddaba-2629-48eb-b8f7-a7062f65e44c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:05.238092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:05.323860 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ddaba-2629-48eb-b8f7-a7062f65e44c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:05.367581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3a2ee-889c-4458-8a4f-a979ad56ba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:05.368262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3a2ee-889c-4458-8a4f-a979ad56ba45 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:05.368578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3a2ee-889c-4458-8a4f-a979ad56ba45 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:05.368835 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3a2ee-889c-4458-8a4f-a979ad56ba45 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:05.369580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3a2ee-889c-4458-8a4f-a979ad56ba45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:05.369890 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3a2ee-889c-4458-8a4f-a979ad56ba45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:05.371287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3a2ee-889c-4458-8a4f-a979ad56ba45 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:05.379585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 632/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:32:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:05.385239 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34b25-dba2-41e6-b1e0-632a660d0df0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:05.449722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:05.482850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34b25-dba2-41e6-b1e0-632a660d0df0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:05.514533 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92860de9-921e-45fc-9cbe-0cc9009327a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:05.515343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92860de9-921e-45fc-9cbe-0cc9009327a7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:05.515627 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92860de9-921e-45fc-9cbe-0cc9009327a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:05.515898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92860de9-921e-45fc-9cbe-0cc9009327a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:05.526923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92860de9-921e-45fc-9cbe-0cc9009327a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:05.528392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92860de9-921e-45fc-9cbe-0cc9009327a7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-92860de9-921e-45fc-9cbe-0cc9009327a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:32:05.545617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:05.546681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:05.547681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:32:05.547681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:32:05.547681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:32:05.547681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:32:05.547681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 633/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:05.552522 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3a2ee-889c-4458-8a4f-a979ad56ba45 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:05.632238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:05.651887 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3a2ee-889c-4458-8a4f-a979ad56ba45 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:05.684429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d43123-c854-44a0-9720-085a453bb9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:05.685076 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d43123-c854-44a0-9720-085a453bb9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:05.685361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d43123-c854-44a0-9720-085a453bb9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:05.685637 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d43123-c854-44a0-9720-085a453bb9d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:05.686340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d43123-c854-44a0-9720-085a453bb9d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:05.686644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d43123-c854-44a0-9720-085a453bb9d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:05.688104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d43123-c854-44a0-9720-085a453bb9d7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:05.699357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 633/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:05.705313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92860de9-921e-45fc-9cbe-0cc9009327a7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:05.802482 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92860de9-921e-45fc-9cbe-0cc9009327a7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:05.820891 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:05.834605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b8450-0597-47a2-903e-dfca7acc2980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:05.835438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b8450-0597-47a2-903e-dfca7acc2980 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:05.835716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b8450-0597-47a2-903e-dfca7acc2980 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:05.835986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b8450-0597-47a2-903e-dfca7acc2980 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:05.843161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b8450-0597-47a2-903e-dfca7acc2980 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:05.844610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b8450-0597-47a2-903e-dfca7acc2980 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-437b8450-0597-47a2-903e-dfca7acc2980 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:32:05.858986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:05.860119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:05.861243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:05.861243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:05.861243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:32:05.861243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:32:05.861243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:32:05.861243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:32:05.861243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:32:05.861243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:32:05.861243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:32:05.861243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:32:05.861243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 634/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:32:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 20:32:05.866828 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d43123-c854-44a0-9720-085a453bb9d7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:05.962144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d43123-c854-44a0-9720-085a453bb9d7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:05.995056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e686f-251b-4ae8-b086-692586ef1c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:05.995730 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e686f-251b-4ae8-b086-692586ef1c3b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:05.996012 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e686f-251b-4ae8-b086-692586ef1c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:05.996286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e686f-251b-4ae8-b086-692586ef1c3b None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:05.997098 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e686f-251b-4ae8-b086-692586ef1c3b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:05.997404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e686f-251b-4ae8-b086-692586ef1c3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:05.998809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e686f-251b-4ae8-b086-692586ef1c3b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:06.007866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:06.017615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 634/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Jul 6 20:32:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:06.023240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b8450-0597-47a2-903e-dfca7acc2980 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:06.119707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b8450-0597-47a2-903e-dfca7acc2980 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:06.152124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b484c-2dbb-4bf8-ab92-b2076ea057a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:06.152905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b484c-2dbb-4bf8-ab92-b2076ea057a9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:06.153195 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b484c-2dbb-4bf8-ab92-b2076ea057a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:06.153474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b484c-2dbb-4bf8-ab92-b2076ea057a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:06.163696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b484c-2dbb-4bf8-ab92-b2076ea057a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:06.165147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b484c-2dbb-4bf8-ab92-b2076ea057a9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-563b484c-2dbb-4bf8-ab92-b2076ea057a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:32:06.182010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:06.183158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:06.184121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:32:06.184121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:32:06.184121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:32:06.184121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:32:06.184121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 635/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:06.188756 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e686f-251b-4ae8-b086-692586ef1c3b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:06.288409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e686f-251b-4ae8-b086-692586ef1c3b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:06.329975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f9bf7-2de9-467f-bffd-732747f77570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:06.331366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f9bf7-2de9-467f-bffd-732747f77570 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:06.331649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f9bf7-2de9-467f-bffd-732747f77570 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:06.331925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f9bf7-2de9-467f-bffd-732747f77570 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:06.332637 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f9bf7-2de9-467f-bffd-732747f77570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:06.332943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f9bf7-2de9-467f-bffd-732747f77570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:06.334298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f9bf7-2de9-467f-bffd-732747f77570 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:06.345279 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 635/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:06.351677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b484c-2dbb-4bf8-ab92-b2076ea057a9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:06.382125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:06.447467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b484c-2dbb-4bf8-ab92-b2076ea057a9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:06.480568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f68d5-1349-4294-a699-09162688597a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:06.481341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f68d5-1349-4294-a699-09162688597a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:06.481622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f68d5-1349-4294-a699-09162688597a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:06.481894 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f68d5-1349-4294-a699-09162688597a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:06.488281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f68d5-1349-4294-a699-09162688597a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:06.489710 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f68d5-1349-4294-a699-09162688597a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ff3f68d5-1349-4294-a699-09162688597a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:32:06.504690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:06.505735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:06.506825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:32:06.506825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:32:06.506825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:32:06.506825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:32:06.506825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:32:06.506825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:32:06.506825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:32:06.506825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:32:06.506825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 636/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:32:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:06.511557 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f9bf7-2de9-467f-bffd-732747f77570 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:06.569267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:06.609731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f9bf7-2de9-467f-bffd-732747f77570 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:06.641840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab408c03-366a-4a7c-813e-b2cbcc42a6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:06.642425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab408c03-366a-4a7c-813e-b2cbcc42a6ad None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:06.642911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab408c03-366a-4a7c-813e-b2cbcc42a6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:06.643216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab408c03-366a-4a7c-813e-b2cbcc42a6ad None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:06.643993 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab408c03-366a-4a7c-813e-b2cbcc42a6ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:06.644301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab408c03-366a-4a7c-813e-b2cbcc42a6ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:06.645876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab408c03-366a-4a7c-813e-b2cbcc42a6ad None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:06.657720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 636/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:32:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:32:06.664186 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f68d5-1349-4294-a699-09162688597a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:06.751834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:06.761276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f68d5-1349-4294-a699-09162688597a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:06.794481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06d9f5-dd6e-4742-adb4-bb6e4caa995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:06.795396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06d9f5-dd6e-4742-adb4-bb6e4caa995a None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:06.795683 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06d9f5-dd6e-4742-adb4-bb6e4caa995a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:06.795963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06d9f5-dd6e-4742-adb4-bb6e4caa995a None admin] PATH_INFO: `/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/b98059ebef5d470db684fb78d19a8839/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:06.797881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06d9f5-dd6e-4742-adb4-bb6e4caa995a None admin] RBAC: Authorizing `identity:create_grant(project_id=8eda6c9cf4b1439eb280b0db35b3bce2, user_id=b98059ebef5d470db684fb78d19a8839, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:06.799903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06d9f5-dd6e-4742-adb4-bb6e4caa995a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:06.812485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 637/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jul 6 20:32:06 2022] PUT /identity/v3/projects/8eda6c9cf4b1439eb280b0db35b3bce2/users/b98059ebef5d470db684fb78d19a8839/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:32:08.805755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae2e28-f60e-4d77-9be9-498ad5dfeba6 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:08.806385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae2e28-f60e-4d77-9be9-498ad5dfeba6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:08.806385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae2e28-f60e-4d77-9be9-498ad5dfeba6 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:08.807705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 637/1274] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:32:08.812827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddc115-fd8e-43e0-81dd-425b13f99394 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:08.813255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddc115-fd8e-43e0-81dd-425b13f99394 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:08.813368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddc115-fd8e-43e0-81dd-425b13f99394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:08.830699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9cddc115-fd8e-43e0-81dd-425b13f99394 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:08.831970 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9cddc115-fd8e-43e0-81dd-425b13f99394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:08.895714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 638/1275] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:32:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:32:08.919067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae2e28-f60e-4d77-9be9-498ad5dfeba6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:09.018645 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae2e28-f60e-4d77-9be9-498ad5dfeba6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:09.036206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:09.052979 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a538caa-0124-4298-8955-d5e2afa58e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:09.053757 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a538caa-0124-4298-8955-d5e2afa58e0b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:09.054037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a538caa-0124-4298-8955-d5e2afa58e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:09.054309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a538caa-0124-4298-8955-d5e2afa58e0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:09.064075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a538caa-0124-4298-8955-d5e2afa58e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-8a538caa-0124-4298-8955-d5e2afa58e0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 20:32:09.071766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:09.072984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:09.074284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:09.074284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:09.074284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:09.074284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:09.074284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 20:32:09.074284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 20:32:09.074284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 20:32:09.074284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 20:32:09.074284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 20:32:09.074284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 20:32:09.074284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 20:32:09.074284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:09.074284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 638/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jul 6 20:32:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:09.078840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddc115-fd8e-43e0-81dd-425b13f99394 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:09.159079 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:09.177584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddc115-fd8e-43e0-81dd-425b13f99394 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:09.210970 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20914ee7-51d2-43fc-aefe-ef23bbcbdc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:09.211655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20914ee7-51d2-43fc-aefe-ef23bbcbdc76 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:09.211942 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20914ee7-51d2-43fc-aefe-ef23bbcbdc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:09.212219 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20914ee7-51d2-43fc-aefe-ef23bbcbdc76 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:09.212954 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20914ee7-51d2-43fc-aefe-ef23bbcbdc76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:09.213261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20914ee7-51d2-43fc-aefe-ef23bbcbdc76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:09.214622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20914ee7-51d2-43fc-aefe-ef23bbcbdc76 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:09.222388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 639/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jul 6 20:32:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:09.228191 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a538caa-0124-4298-8955-d5e2afa58e0b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:09.333174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a538caa-0124-4298-8955-d5e2afa58e0b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:09.365750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260a2e4-a02d-4808-be27-4285630e39c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:09.366531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260a2e4-a02d-4808-be27-4285630e39c2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:09.366812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260a2e4-a02d-4808-be27-4285630e39c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:09.367087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260a2e4-a02d-4808-be27-4285630e39c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:09.377902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260a2e4-a02d-4808-be27-4285630e39c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:09.379363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260a2e4-a02d-4808-be27-4285630e39c2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-7260a2e4-a02d-4808-be27-4285630e39c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:32:09.396316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:09.397365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:09.398601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:32:09.398601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:32:09.398601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:32:09.398601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:09.398601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 639/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:09.403455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20914ee7-51d2-43fc-aefe-ef23bbcbdc76 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:09.498987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20914ee7-51d2-43fc-aefe-ef23bbcbdc76 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:09.531823 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c749-1926-447b-b24f-577c6338baca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:09.532475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c749-1926-447b-b24f-577c6338baca None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:09.532762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c749-1926-447b-b24f-577c6338baca None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:09.533087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c749-1926-447b-b24f-577c6338baca None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:09.533857 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437c749-1926-447b-b24f-577c6338baca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:09.534198 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437c749-1926-447b-b24f-577c6338baca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:09.535613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437c749-1926-447b-b24f-577c6338baca None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:09.546854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 640/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:09.552568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260a2e4-a02d-4808-be27-4285630e39c2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:09.583339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:09.663687 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260a2e4-a02d-4808-be27-4285630e39c2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:09.696397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b35650-51bf-4c89-ac25-117b14690dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:09.697184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b35650-51bf-4c89-ac25-117b14690dba None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:09.697464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b35650-51bf-4c89-ac25-117b14690dba None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:09.697738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b35650-51bf-4c89-ac25-117b14690dba None admin] PATH_INFO: `/v3/users/placement` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:09.704919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b35650-51bf-4c89-ac25-117b14690dba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:09.706349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b35650-51bf-4c89-ac25-117b14690dba None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-a7b35650-51bf-4c89-ac25-117b14690dba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 20:32:09.720001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:09.721698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:09.722924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:09.722924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:09.722924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 20:32:09.722924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 20:32:09.722924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 20:32:09.722924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 20:32:09.722924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 20:32:09.722924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 20:32:09.722924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 20:32:09.722924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:09.722924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 640/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:32:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:09.727530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c749-1926-447b-b24f-577c6338baca None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:09.731252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:09.823737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c749-1926-447b-b24f-577c6338baca None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:09.856395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403ea6a-bf51-45be-9829-7cbdf8c6ad4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:09.857054 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403ea6a-bf51-45be-9829-7cbdf8c6ad4c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:09.857336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403ea6a-bf51-45be-9829-7cbdf8c6ad4c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:09.857610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403ea6a-bf51-45be-9829-7cbdf8c6ad4c None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:09.858434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403ea6a-bf51-45be-9829-7cbdf8c6ad4c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:09.858744 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403ea6a-bf51-45be-9829-7cbdf8c6ad4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:09.860190 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403ea6a-bf51-45be-9829-7cbdf8c6ad4c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:09.877301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 641/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Jul 6 20:32:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:09.882945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b35650-51bf-4c89-ac25-117b14690dba None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:09.971552 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:09.981475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b35650-51bf-4c89-ac25-117b14690dba None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:10.013458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f69b68-315a-41bf-ba24-24402f3ad6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:10.014095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69b68-315a-41bf-ba24-24402f3ad6cb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:10.014380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69b68-315a-41bf-ba24-24402f3ad6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:10.014657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69b68-315a-41bf-ba24-24402f3ad6cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:10.079329 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f69b68-315a-41bf-ba24-24402f3ad6cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:10.081200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f69b68-315a-41bf-ba24-24402f3ad6cb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:10.167310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:10.178347 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 641/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jul 6 20:32:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 20:32:10.184134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403ea6a-bf51-45be-9829-7cbdf8c6ad4c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:10.243737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:10.280397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403ea6a-bf51-45be-9829-7cbdf8c6ad4c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:10.315752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8853991-c17b-4438-aa2e-31939ce209a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:10.316618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853991-c17b-4438-aa2e-31939ce209a5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:10.316881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853991-c17b-4438-aa2e-31939ce209a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:10.317160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853991-c17b-4438-aa2e-31939ce209a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:10.327331 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8853991-c17b-4438-aa2e-31939ce209a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:10.328771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8853991-c17b-4438-aa2e-31939ce209a5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b8853991-c17b-4438-aa2e-31939ce209a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 20:32:10.346296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:10.347369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:10.348647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 20:32:10.348647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 20:32:10.348647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 20:32:10.348647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:32:10.348647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 642/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:10.353056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f69b68-315a-41bf-ba24-24402f3ad6cb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:10.447790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f69b68-315a-41bf-ba24-24402f3ad6cb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:10.480121 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c139c-5365-42cf-aca4-90b65b927d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:10.480764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c139c-5365-42cf-aca4-90b65b927d75 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:10.481046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c139c-5365-42cf-aca4-90b65b927d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:10.481319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c139c-5365-42cf-aca4-90b65b927d75 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:10.482021 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c139c-5365-42cf-aca4-90b65b927d75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:10.482326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c139c-5365-42cf-aca4-90b65b927d75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:10.483754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c139c-5365-42cf-aca4-90b65b927d75 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:10.494752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 642/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jul 6 20:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:10.500327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8853991-c17b-4438-aa2e-31939ce209a5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:10.596391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8853991-c17b-4438-aa2e-31939ce209a5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:10.610003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:10.629507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16370825-292e-47b3-924a-6027a4df9101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:10.630290 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16370825-292e-47b3-924a-6027a4df9101 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:10.630574 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16370825-292e-47b3-924a-6027a4df9101 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:10.630850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16370825-292e-47b3-924a-6027a4df9101 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:10.637282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16370825-292e-47b3-924a-6027a4df9101 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:10.638723 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16370825-292e-47b3-924a-6027a4df9101 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-16370825-292e-47b3-924a-6027a4df9101 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 20:32:10.653025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:10.654073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:10.655248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 20:32:10.655248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 20:32:10.655248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 20:32:10.655248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 20:32:10.655248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 20:32:10.655248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 20:32:10.655248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 20:32:10.655248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 06 20:32:10.655248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 643/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jul 6 20:32:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:10.660586 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c139c-5365-42cf-aca4-90b65b927d75 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:10.709324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:10.757596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c139c-5365-42cf-aca4-90b65b927d75 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:10.790648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7320312-2cd1-4ed9-9eb5-ea350a6f8156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:10.791321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7320312-2cd1-4ed9-9eb5-ea350a6f8156 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:10.791604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7320312-2cd1-4ed9-9eb5-ea350a6f8156 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:10.791880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7320312-2cd1-4ed9-9eb5-ea350a6f8156 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:10.792643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7320312-2cd1-4ed9-9eb5-ea350a6f8156 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:10.792949 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7320312-2cd1-4ed9-9eb5-ea350a6f8156 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:10.794344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7320312-2cd1-4ed9-9eb5-ea350a6f8156 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:10.806037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 643/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jul 6 20:32:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:10.811953 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16370825-292e-47b3-924a-6027a4df9101 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:10.909639 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16370825-292e-47b3-924a-6027a4df9101 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:10.942707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34802ba6-53c1-4200-ac75-7cf994888278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:10.943382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34802ba6-53c1-4200-ac75-7cf994888278 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:10.943670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34802ba6-53c1-4200-ac75-7cf994888278 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:10.943948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34802ba6-53c1-4200-ac75-7cf994888278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:10.945678 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34802ba6-53c1-4200-ac75-7cf994888278 None admin] RBAC: Adding query filter params (role.id=9bd5687ac7cc4304abdd5ba1d004f7cf, scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2, user.id=b98059ebef5d470db684fb78d19a8839) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:10.945678 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34802ba6-53c1-4200-ac75-7cf994888278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:10.946519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34802ba6-53c1-4200-ac75-7cf994888278 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:10.952575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 644/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jul 6 20:32:10 2022] GET /identity/v3/role_assignments?user.id=b98059ebef5d470db684fb78d19a8839&scope.project.id=8eda6c9cf4b1439eb280b0db35b3bce2&role.id=9bd5687ac7cc4304abdd5ba1d004f7cf => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:12.972976 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb1306-ed99-4326-96aa-0bdaae414c33 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:12.973497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb1306-ed99-4326-96aa-0bdaae414c33 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:12.973497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb1306-ed99-4326-96aa-0bdaae414c33 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:12.974821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 644/1288] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:32:12.979987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f9ba8-9cf7-4937-bbe7-f438f1b263fc None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:12.980380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f9ba8-9cf7-4937-bbe7-f438f1b263fc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:12.980541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f9ba8-9cf7-4937-bbe7-f438f1b263fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:12.997565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8c5f9ba8-9cf7-4937-bbe7-f438f1b263fc None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:12.998756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8c5f9ba8-9cf7-4937-bbe7-f438f1b263fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:13.027935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:13.064197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 645/1289] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:32:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:32:13.086346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb1306-ed99-4326-96aa-0bdaae414c33 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:13.184273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb1306-ed99-4326-96aa-0bdaae414c33 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:13.194803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:13.217900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96646a7b-d236-4367-bab5-4d96ef3d1313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:13.218692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646a7b-d236-4367-bab5-4d96ef3d1313 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:13.218972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646a7b-d236-4367-bab5-4d96ef3d1313 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:13.219274 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646a7b-d236-4367-bab5-4d96ef3d1313 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:13.219914 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96646a7b-d236-4367-bab5-4d96ef3d1313 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:13.221873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96646a7b-d236-4367-bab5-4d96ef3d1313 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-96646a7b-d236-4367-bab5-4d96ef3d1313 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:13.233309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:13.234321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:13.235235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 645/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jul 6 20:32:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:13.241189 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f9ba8-9cf7-4937-bbe7-f438f1b263fc None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:13.360702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f9ba8-9cf7-4937-bbe7-f438f1b263fc None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:13.402965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2031c88-7273-4003-bdc8-cbfbed6af743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:13.403657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2031c88-7273-4003-bdc8-cbfbed6af743 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:13.403946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2031c88-7273-4003-bdc8-cbfbed6af743 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:13.404224 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2031c88-7273-4003-bdc8-cbfbed6af743 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:13.404928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2031c88-7273-4003-bdc8-cbfbed6af743 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:13.405238 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2031c88-7273-4003-bdc8-cbfbed6af743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:13.406618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2031c88-7273-4003-bdc8-cbfbed6af743 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:13.411907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 646/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Wed Jul 6 20:32:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:13.417634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96646a7b-d236-4367-bab5-4d96ef3d1313 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:13.517239 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96646a7b-d236-4367-bab5-4d96ef3d1313 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:13.550285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29334690-6a1a-4114-be01-05c53b779853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:13.550929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334690-6a1a-4114-be01-05c53b779853 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:13.551231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334690-6a1a-4114-be01-05c53b779853 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:13.551510 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334690-6a1a-4114-be01-05c53b779853 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:13.552197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29334690-6a1a-4114-be01-05c53b779853 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:13.552501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29334690-6a1a-4114-be01-05c53b779853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:13.553859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29334690-6a1a-4114-be01-05c53b779853 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:13.558166 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 646/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Wed Jul 6 20:32:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:15.577139 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b0136-db37-4b02-95af-997431969d45 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:15.577666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b0136-db37-4b02-95af-997431969d45 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:15.577666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b0136-db37-4b02-95af-997431969d45 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:15.579057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 647/1293] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:32:15.584740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6984e-1788-436d-a028-c94c68b1c943 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:15.585141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6984e-1788-436d-a028-c94c68b1c943 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:15.585302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6984e-1788-436d-a028-c94c68b1c943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:15.602139 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-51e6984e-1788-436d-a028-c94c68b1c943 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:15.603369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-51e6984e-1788-436d-a028-c94c68b1c943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:15.632298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:15.669668 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 647/1294] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:32:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:32:15.692413 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b0136-db37-4b02-95af-997431969d45 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:15.722679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:15.792534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b0136-db37-4b02-95af-997431969d45 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:15.825082 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7af618-8c43-4d2b-bd0f-42112fae2485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:15.825724 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7af618-8c43-4d2b-bd0f-42112fae2485 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:15.826004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7af618-8c43-4d2b-bd0f-42112fae2485 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:15.826278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7af618-8c43-4d2b-bd0f-42112fae2485 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:15.826988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7af618-8c43-4d2b-bd0f-42112fae2485 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:15.828432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7af618-8c43-4d2b-bd0f-42112fae2485 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:15.840850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 648/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jul 6 20:32:15 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:17.885589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e07a4-83a4-49bc-aed2-56d2b525ebc7 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.886109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e07a4-83a4-49bc-aed2-56d2b525ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.886109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e07a4-83a4-49bc-aed2-56d2b525ebc7 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.887473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 648/1296] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:32:17.893207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402eb1ac-7c56-4037-b14a-61e258a55a89 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:17.893582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402eb1ac-7c56-4037-b14a-61e258a55a89 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:17.893762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402eb1ac-7c56-4037-b14a-61e258a55a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:17.910210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-402eb1ac-7c56-4037-b14a-61e258a55a89 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:17.911425 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-402eb1ac-7c56-4037-b14a-61e258a55a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:17.981177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 649/1297] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:32:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 20:32:18.004949 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e07a4-83a4-49bc-aed2-56d2b525ebc7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:18.106692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e07a4-83a4-49bc-aed2-56d2b525ebc7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:18.138960 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f4fa1-afb0-4c12-8e3e-c0558cf3b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:18.139715 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f4fa1-afb0-4c12-8e3e-c0558cf3b75a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:18.140006 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f4fa1-afb0-4c12-8e3e-c0558cf3b75a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:18.140283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f4fa1-afb0-4c12-8e3e-c0558cf3b75a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:18.140922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f4fa1-afb0-4c12-8e3e-c0558cf3b75a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:18.142954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f4fa1-afb0-4c12-8e3e-c0558cf3b75a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-525f4fa1-afb0-4c12-8e3e-c0558cf3b75a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:18.154695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:18.155866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:18.156755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 649/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jul 6 20:32:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:18.162199 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402eb1ac-7c56-4037-b14a-61e258a55a89 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:18.180450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:18.258520 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402eb1ac-7c56-4037-b14a-61e258a55a89 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:18.292470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16070e9e-ae43-4e51-b53c-e83d1103dfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:18.293122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16070e9e-ae43-4e51-b53c-e83d1103dfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:18.293405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16070e9e-ae43-4e51-b53c-e83d1103dfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:18.293678 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16070e9e-ae43-4e51-b53c-e83d1103dfe6 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:18.294374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16070e9e-ae43-4e51-b53c-e83d1103dfe6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:18.294681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16070e9e-ae43-4e51-b53c-e83d1103dfe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:18.296194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16070e9e-ae43-4e51-b53c-e83d1103dfe6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:18.302695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 650/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Wed Jul 6 20:32:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:18.308639 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f4fa1-afb0-4c12-8e3e-c0558cf3b75a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:18.353669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:18.428815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f4fa1-afb0-4c12-8e3e-c0558cf3b75a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:18.460335 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f9066-2a64-4502-bee6-2fa14f6c378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:18.460977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f9066-2a64-4502-bee6-2fa14f6c378a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:18.461259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f9066-2a64-4502-bee6-2fa14f6c378a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:18.461534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f9066-2a64-4502-bee6-2fa14f6c378a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:18.462308 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f9066-2a64-4502-bee6-2fa14f6c378a None admin] RBAC: Adding query filter params (interface=public, service_id=4824503dee9342c9b156965f3a62c556, region_id=RegionOne) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:18.462615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f9066-2a64-4502-bee6-2fa14f6c378a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:18.463995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f9066-2a64-4502-bee6-2fa14f6c378a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:18.468840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 650/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jul 6 20:32:18 2022] GET /identity/v3/endpoints?service_id=4824503dee9342c9b156965f3a62c556&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:18.475177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16070e9e-ae43-4e51-b53c-e83d1103dfe6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:18.556988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:18.575615 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16070e9e-ae43-4e51-b53c-e83d1103dfe6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:18.609222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6284b-8327-4f1e-beaf-966fd9f1e281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:18.609879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6284b-8327-4f1e-beaf-966fd9f1e281 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:18.610164 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6284b-8327-4f1e-beaf-966fd9f1e281 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:18.610437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6284b-8327-4f1e-beaf-966fd9f1e281 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:18.611908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6284b-8327-4f1e-beaf-966fd9f1e281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:18.613269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6284b-8327-4f1e-beaf-966fd9f1e281 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:18.619962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 651/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jul 6 20:32:18 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:32:20.620927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d32fe4-def2-421b-976e-19158f385ae0 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.621444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d32fe4-def2-421b-976e-19158f385ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.621539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d32fe4-def2-421b-976e-19158f385ae0 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.622844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 651/1302] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:32:20.628558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0aa53-7f22-48fd-bb67-f6280510ebe2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.628943 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0aa53-7f22-48fd-bb67-f6280510ebe2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.629121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0aa53-7f22-48fd-bb67-f6280510ebe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.645932 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e0f0aa53-7f22-48fd-bb67-f6280510ebe2 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:32:20.647105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e0f0aa53-7f22-48fd-bb67-f6280510ebe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:32:20.711521 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 652/1303] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:32:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 20:32:20.733734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d32fe4-def2-421b-976e-19158f385ae0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:20.826660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:20.834410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d32fe4-def2-421b-976e-19158f385ae0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:20.867686 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5808ae2-06bf-4e92-a49c-19cea8619062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:20.868439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5808ae2-06bf-4e92-a49c-19cea8619062 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:20.868723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5808ae2-06bf-4e92-a49c-19cea8619062 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:20.869002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5808ae2-06bf-4e92-a49c-19cea8619062 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:20.869649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5808ae2-06bf-4e92-a49c-19cea8619062 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:20.871002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5808ae2-06bf-4e92-a49c-19cea8619062 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-e5808ae2-06bf-4e92-a49c-19cea8619062 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 20:32:20.883055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 20:32:20.884231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Jul 06 20:32:20.885401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 652/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jul 6 20:32:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 20:32:20.890130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0aa53-7f22-48fd-bb67-f6280510ebe2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:20.964135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:20.987003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0aa53-7f22-48fd-bb67-f6280510ebe2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.019957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cb366-b859-4cf2-8935-c5ae9a0e04f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.020605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cb366-b859-4cf2-8935-c5ae9a0e04f6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.020893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cb366-b859-4cf2-8935-c5ae9a0e04f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.021168 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cb366-b859-4cf2-8935-c5ae9a0e04f6 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.021864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cb366-b859-4cf2-8935-c5ae9a0e04f6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:32:21.022172 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cb366-b859-4cf2-8935-c5ae9a0e04f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.023572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cb366-b859-4cf2-8935-c5ae9a0e04f6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.028853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 653/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Wed Jul 6 20:32:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:32:21.034567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5808ae2-06bf-4e92-a49c-19cea8619062 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:32:21.131046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5808ae2-06bf-4e92-a49c-19cea8619062 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:32:21.164171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450139-89c2-44ce-8357-98789b97de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:32:21.164806 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450139-89c2-44ce-8357-98789b97de85 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:32:21.165087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450139-89c2-44ce-8357-98789b97de85 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:32:21.165364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450139-89c2-44ce-8357-98789b97de85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:32:21.166093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d450139-89c2-44ce-8357-98789b97de85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:32:21.167469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d450139-89c2-44ce-8357-98789b97de85 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:32:21.184818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 653/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jul 6 20:32:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:32:31.025658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=30 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:32:31.180928 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:24.697667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07825f-d35a-46f9-adc1-eb89e71a3168 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:24.698270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07825f-d35a-46f9-adc1-eb89e71a3168 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:24.698270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07825f-d35a-46f9-adc1-eb89e71a3168 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:24.703518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 654/1307] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:33:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:24.705116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc356f35-8972-4a26-982b-fd50fb832e24 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:24.706043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc356f35-8972-4a26-982b-fd50fb832e24 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:24.706526 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc356f35-8972-4a26-982b-fd50fb832e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:24.796634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-bc356f35-8972-4a26-982b-fd50fb832e24 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:24.798017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-bc356f35-8972-4a26-982b-fd50fb832e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:24.991874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 654/1308] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:25.054738 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151ae8f-619b-4bad-8648-fa5ac999963a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:25.055674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151ae8f-619b-4bad-8648-fa5ac999963a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:25.056562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151ae8f-619b-4bad-8648-fa5ac999963a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:25.061529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 655/1309] 10.222.0.33 () {54 vars in 964 bytes} [Wed Jul 6 20:33:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:25.067971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d6814-3887-4b3e-8ebb-ef4040530809 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:25.068426 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d6814-3887-4b3e-8ebb-ef4040530809 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:25.068805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d6814-3887-4b3e-8ebb-ef4040530809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:25.184799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b54d6814-3887-4b3e-8ebb-ef4040530809 None None] MFA Rules not processed for user `d7bb4a244df24a19b4c3ad3d1ad2bc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:25.187329 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b54d6814-3887-4b3e-8ebb-ef4040530809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:25.213057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:25.282779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 655/1310] 10.222.0.33 () {58 vars in 1061 bytes} [Wed Jul 6 20:33:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:25.291795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151ae8f-619b-4bad-8648-fa5ac999963a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:25.293920 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4151ae8f-619b-4bad-8648-fa5ac999963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:25.410100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151ae8f-619b-4bad-8648-fa5ac999963a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:25.486868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c5aa4-1a4e-466d-98e4-47325da861a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:25.487968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c5aa4-1a4e-466d-98e4-47325da861a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:25.488475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c5aa4-1a4e-466d-98e4-47325da861a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:25.488982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c5aa4-1a4e-466d-98e4-47325da861a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:25.490889 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-118c5aa4-1a4e-466d-98e4-47325da861a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:25.549856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:25.611264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c5aa4-1a4e-466d-98e4-47325da861a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:25.613063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c5aa4-1a4e-466d-98e4-47325da861a6 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:25.651665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 656/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:28.081797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f5b09-abf9-4c16-8149-98fea841fb4f None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:28.082376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f5b09-abf9-4c16-8149-98fea841fb4f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:28.082376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f5b09-abf9-4c16-8149-98fea841fb4f None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:28.083930 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 656/1312] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:28.088919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea394-3a4d-40a3-98c6-a4b267b27f25 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:28.089350 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea394-3a4d-40a3-98c6-a4b267b27f25 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:28.089493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea394-3a4d-40a3-98c6-a4b267b27f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:28.160033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c44ea394-3a4d-40a3-98c6-a4b267b27f25 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:28.161224 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c44ea394-3a4d-40a3-98c6-a4b267b27f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:28.257135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 657/1313] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:28.295433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f5b09-abf9-4c16-8149-98fea841fb4f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:28.297031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-843f5b09-abf9-4c16-8149-98fea841fb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:28.410477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f5b09-abf9-4c16-8149-98fea841fb4f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:28.486372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:28.489892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128c153-1b8b-4036-a1f6-78ed8cf1e1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:28.490867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128c153-1b8b-4036-a1f6-78ed8cf1e1ad service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:28.491192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128c153-1b8b-4036-a1f6-78ed8cf1e1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:28.491728 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128c153-1b8b-4036-a1f6-78ed8cf1e1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:28.493455 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6128c153-1b8b-4036-a1f6-78ed8cf1e1ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:28.606299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128c153-1b8b-4036-a1f6-78ed8cf1e1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:28.608332 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128c153-1b8b-4036-a1f6-78ed8cf1e1ad service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:28.627994 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 657/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:30.980311 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c19c5d-262d-43dd-8db8-cd7a10390db1 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:30.980818 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c19c5d-262d-43dd-8db8-cd7a10390db1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:30.980818 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c19c5d-262d-43dd-8db8-cd7a10390db1 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:30.982173 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 658/1315] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:30.987355 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a86fee-5427-4918-9909-a31d14bdaa92 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:30.987732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a86fee-5427-4918-9909-a31d14bdaa92 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:30.987913 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a86fee-5427-4918-9909-a31d14bdaa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:31.051252 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-99a86fee-5427-4918-9909-a31d14bdaa92 None None] MFA Rules not processed for user `354ba81d4750484ba041dc7f2f2438f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:31.052459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-99a86fee-5427-4918-9909-a31d14bdaa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:31.102972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:31.149049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 658/1316] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:33:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:31.201330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7b06a-8288-4642-a169-df86170acee3 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:31.201761 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7b06a-8288-4642-a169-df86170acee3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:31.202049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7b06a-8288-4642-a169-df86170acee3 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:31.203480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 659/1317] 10.222.0.33 () {54 vars in 964 bytes} [Wed Jul 6 20:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:31.209031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74806a21-5428-4969-8c9c-d54486afb447 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:31.209322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74806a21-5428-4969-8c9c-d54486afb447 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:31.209599 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74806a21-5428-4969-8c9c-d54486afb447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:31.282314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-74806a21-5428-4969-8c9c-d54486afb447 None None] MFA Rules not processed for user `d7bb4a244df24a19b4c3ad3d1ad2bc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:31.283489 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-74806a21-5428-4969-8c9c-d54486afb447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:31.361961 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 659/1318] 10.222.0.33 () {58 vars in 1061 bytes} [Wed Jul 6 20:33:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:31.371082 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7b06a-8288-4642-a169-df86170acee3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:31.373386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4ed7b06a-8288-4642-a169-df86170acee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:31.382898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:31.477276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7b06a-8288-4642-a169-df86170acee3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:31.548496 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa5c33-6161-4aa4-b778-84d00554e82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:31.549141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa5c33-6161-4aa4-b778-84d00554e82f service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:31.549455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa5c33-6161-4aa4-b778-84d00554e82f service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:31.549729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa5c33-6161-4aa4-b778-84d00554e82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:31.551397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0faa5c33-6161-4aa4-b778-84d00554e82f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:31.612464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:31.658882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa5c33-6161-4aa4-b778-84d00554e82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:31.660357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa5c33-6161-4aa4-b778-84d00554e82f service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:31.677929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 660/1319] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:34.704426 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8217e2-2eb3-4799-8094-059754bfea61 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:34.704977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8217e2-2eb3-4799-8094-059754bfea61 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:34.705078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8217e2-2eb3-4799-8094-059754bfea61 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:34.706390 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 660/1320] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:34.711685 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66968d-d337-4999-a3d8-44b0038d02af None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:34.712092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66968d-d337-4999-a3d8-44b0038d02af None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:34.712281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66968d-d337-4999-a3d8-44b0038d02af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:34.775702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0d66968d-d337-4999-a3d8-44b0038d02af None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:34.776887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0d66968d-d337-4999-a3d8-44b0038d02af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:34.869492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 661/1321] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:33:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:34.909370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8217e2-2eb3-4799-8094-059754bfea61 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:34.910879 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7c8217e2-2eb3-4799-8094-059754bfea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:34.964684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:35.018480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8217e2-2eb3-4799-8094-059754bfea61 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:35.089219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64194f-ab43-4729-85f3-351d99933bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:35.089853 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64194f-ab43-4729-85f3-351d99933bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:35.090132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64194f-ab43-4729-85f3-351d99933bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:35.090405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64194f-ab43-4729-85f3-351d99933bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:35.092603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ae64194f-ab43-4729-85f3-351d99933bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:35.186311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:35.199319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64194f-ab43-4729-85f3-351d99933bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:35.201475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64194f-ab43-4729-85f3-351d99933bc2 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:35.219302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 661/1322] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:37.946299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d12a18-b2b4-4c44-80d5-3863f9c741c4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:37.946800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d12a18-b2b4-4c44-80d5-3863f9c741c4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:37.946800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d12a18-b2b4-4c44-80d5-3863f9c741c4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:37.948308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 662/1323] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:37.954095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b18b3-bdb5-4c9e-b426-3d5cd18d9fdd None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:37.954549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b18b3-bdb5-4c9e-b426-3d5cd18d9fdd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:37.954680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b18b3-bdb5-4c9e-b426-3d5cd18d9fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:38.020716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-219b18b3-bdb5-4c9e-b426-3d5cd18d9fdd None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:38.021933 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-219b18b3-bdb5-4c9e-b426-3d5cd18d9fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:38.130203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 662/1324] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:38.168025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d12a18-b2b4-4c44-80d5-3863f9c741c4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:38.170249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-28d12a18-b2b4-4c44-80d5-3863f9c741c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:38.190287 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:38.283963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d12a18-b2b4-4c44-80d5-3863f9c741c4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:38.359980 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf477d-4ced-4a3c-8d42-c926cd5577b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:38.360622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf477d-4ced-4a3c-8d42-c926cd5577b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:38.360903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf477d-4ced-4a3c-8d42-c926cd5577b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:38.361170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf477d-4ced-4a3c-8d42-c926cd5577b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:38.362786 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d7cf477d-4ced-4a3c-8d42-c926cd5577b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:38.435211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:38.473279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf477d-4ced-4a3c-8d42-c926cd5577b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:38.474729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf477d-4ced-4a3c-8d42-c926cd5577b0 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:38.493236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 663/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:40.590397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edf509-8605-4ed1-b713-07b233abd017 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:40.591914 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edf509-8605-4ed1-b713-07b233abd017 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:40.592210 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edf509-8605-4ed1-b713-07b233abd017 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:40.593877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 663/1326] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:40.599096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2280600-2544-4873-839f-0e767105ac43 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:40.599531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2280600-2544-4873-839f-0e767105ac43 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:40.599698 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2280600-2544-4873-839f-0e767105ac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:40.667402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e2280600-2544-4873-839f-0e767105ac43 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:40.668666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e2280600-2544-4873-839f-0e767105ac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:40.767398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 664/1327] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:40.804160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edf509-8605-4ed1-b713-07b233abd017 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:40.805682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-39edf509-8605-4ed1-b713-07b233abd017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:40.866878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:40.912547 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edf509-8605-4ed1-b713-07b233abd017 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:40.987825 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0365f-43da-45aa-94a3-50406284eacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:40.988482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0365f-43da-45aa-94a3-50406284eacc service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:40.988763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0365f-43da-45aa-94a3-50406284eacc service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:40.989039 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0365f-43da-45aa-94a3-50406284eacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:40.990704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9dd0365f-43da-45aa-94a3-50406284eacc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:41.103333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:41.105666 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0365f-43da-45aa-94a3-50406284eacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:41.108748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0365f-43da-45aa-94a3-50406284eacc service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:41.126732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 664/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:43.252817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1024aec-85e6-41c0-8231-3c01cecf341e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:43.253382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1024aec-85e6-41c0-8231-3c01cecf341e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:43.253382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1024aec-85e6-41c0-8231-3c01cecf341e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:43.254770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 665/1329] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:43.260097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c10cc7-0d55-4996-8535-b5b101d3bafc None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:43.260552 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c10cc7-0d55-4996-8535-b5b101d3bafc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:43.260656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c10cc7-0d55-4996-8535-b5b101d3bafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:43.330301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-77c10cc7-0d55-4996-8535-b5b101d3bafc None None] MFA Rules not processed for user `354ba81d4750484ba041dc7f2f2438f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:43.331506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-77c10cc7-0d55-4996-8535-b5b101d3bafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:43.437198 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 665/1330] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:33:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:43.474119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1024aec-85e6-41c0-8231-3c01cecf341e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:43.475715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c1024aec-85e6-41c0-8231-3c01cecf341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:43.506819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:43.583137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1024aec-85e6-41c0-8231-3c01cecf341e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:43.663873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060a449-d9ec-4298-88de-896da9c71e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:43.664609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060a449-d9ec-4298-88de-896da9c71e05 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:43.664954 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060a449-d9ec-4298-88de-896da9c71e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:43.665315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060a449-d9ec-4298-88de-896da9c71e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:43.667049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2060a449-d9ec-4298-88de-896da9c71e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:43.745222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:43.778010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060a449-d9ec-4298-88de-896da9c71e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:43.780177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060a449-d9ec-4298-88de-896da9c71e05 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:43.814170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 666/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:46.102094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bc957-b153-47a7-9d3e-753edaa4d262 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:46.102636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bc957-b153-47a7-9d3e-753edaa4d262 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:46.102636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bc957-b153-47a7-9d3e-753edaa4d262 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:46.104059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 666/1332] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:46.109354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971b87e-0991-42b4-80eb-60ef7ee8be75 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:46.109758 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971b87e-0991-42b4-80eb-60ef7ee8be75 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:46.109908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971b87e-0991-42b4-80eb-60ef7ee8be75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:46.172859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a971b87e-0991-42b4-80eb-60ef7ee8be75 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:46.174053 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a971b87e-0991-42b4-80eb-60ef7ee8be75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:46.269517 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 667/1333] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:46.306453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bc957-b153-47a7-9d3e-753edaa4d262 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:46.308022 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3b6bc957-b153-47a7-9d3e-753edaa4d262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:46.379761 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:46.414785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bc957-b153-47a7-9d3e-753edaa4d262 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:46.489912 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263663d-b591-449a-ba29-8b82b4b8c7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:46.490556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263663d-b591-449a-ba29-8b82b4b8c7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:46.490843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263663d-b591-449a-ba29-8b82b4b8c7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:46.491121 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263663d-b591-449a-ba29-8b82b4b8c7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:46.492787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3263663d-b591-449a-ba29-8b82b4b8c7c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:46.603053 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263663d-b591-449a-ba29-8b82b4b8c7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:46.604530 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263663d-b591-449a-ba29-8b82b4b8c7c8 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:46.614951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:46.623819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 667/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:48.683332 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c12e0-ab15-4752-a9c4-1daed1e3f261 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:48.684303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c12e0-ab15-4752-a9c4-1daed1e3f261 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:48.684303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c12e0-ab15-4752-a9c4-1daed1e3f261 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:48.685502 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 668/1335] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:48.690818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275adcc7-22c3-42e2-ae13-08e33a068d29 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:48.691257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275adcc7-22c3-42e2-ae13-08e33a068d29 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:48.691397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275adcc7-22c3-42e2-ae13-08e33a068d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:48.755863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-275adcc7-22c3-42e2-ae13-08e33a068d29 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:48.757059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-275adcc7-22c3-42e2-ae13-08e33a068d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:48.852918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 668/1336] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:33:48.893002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c12e0-ab15-4752-a9c4-1daed1e3f261 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:48.894525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-df7c12e0-ab15-4752-a9c4-1daed1e3f261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:48.935403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:48.998640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c12e0-ab15-4752-a9c4-1daed1e3f261 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:49.070141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b205e5-5e01-4bd2-ba16-9b7eb56e26cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:49.070782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b205e5-5e01-4bd2-ba16-9b7eb56e26cc service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:49.071069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b205e5-5e01-4bd2-ba16-9b7eb56e26cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:49.071382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b205e5-5e01-4bd2-ba16-9b7eb56e26cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:49.073024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-64b205e5-5e01-4bd2-ba16-9b7eb56e26cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:49.154835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:49.181244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b205e5-5e01-4bd2-ba16-9b7eb56e26cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:49.182675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b205e5-5e01-4bd2-ba16-9b7eb56e26cc service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:49.200357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 669/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:51.724173 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b92bc-2686-4d65-b204-326003d1f317 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:51.724700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b92bc-2686-4d65-b204-326003d1f317 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:51.724700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b92bc-2686-4d65-b204-326003d1f317 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:51.726093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 669/1338] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:51.732033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f86fff-c1fc-4319-a10c-5125097eaba2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:51.732454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f86fff-c1fc-4319-a10c-5125097eaba2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:51.732590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f86fff-c1fc-4319-a10c-5125097eaba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:51.797107 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-09f86fff-c1fc-4319-a10c-5125097eaba2 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:51.798315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-09f86fff-c1fc-4319-a10c-5125097eaba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:51.893754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 670/1339] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:33:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:51.930702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b92bc-2686-4d65-b204-326003d1f317 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:51.932254 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fb6b92bc-2686-4d65-b204-326003d1f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:52.008711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:52.036578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b92bc-2686-4d65-b204-326003d1f317 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:52.109334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9277e-ae37-4119-b6ce-3deab1470afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:52.109973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9277e-ae37-4119-b6ce-3deab1470afc service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:52.110256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9277e-ae37-4119-b6ce-3deab1470afc service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:52.110531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9277e-ae37-4119-b6ce-3deab1470afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:52.112183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4ee9277e-ae37-4119-b6ce-3deab1470afc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:52.219209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9277e-ae37-4119-b6ce-3deab1470afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:52.220603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9277e-ae37-4119-b6ce-3deab1470afc service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:52.239535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 670/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:56.331296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc92dad-7954-471e-a556-876d96ce70df None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:56.331793 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc92dad-7954-471e-a556-876d96ce70df None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:56.331793 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc92dad-7954-471e-a556-876d96ce70df None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:56.333169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 671/1341] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:56.338421 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4450f-b1dd-4cdb-b99f-75a7891222ec None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:56.338863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4450f-b1dd-4cdb-b99f-75a7891222ec None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:56.338960 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4450f-b1dd-4cdb-b99f-75a7891222ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:56.345412 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:56.412509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-89c4450f-b1dd-4cdb-b99f-75a7891222ec None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:56.413728 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-89c4450f-b1dd-4cdb-b99f-75a7891222ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:56.522656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 671/1342] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:56.561946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc92dad-7954-471e-a556-876d96ce70df None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:56.564130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7cc92dad-7954-471e-a556-876d96ce70df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:56.621480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:33:56.668415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc92dad-7954-471e-a556-876d96ce70df None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:56.672115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dc7de-d3b4-4317-9a0c-d8bcd3bc0103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:56.672908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dc7de-d3b4-4317-9a0c-d8bcd3bc0103 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:56.673201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dc7de-d3b4-4317-9a0c-d8bcd3bc0103 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:56.673477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dc7de-d3b4-4317-9a0c-d8bcd3bc0103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:56.682401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dc7de-d3b4-4317-9a0c-d8bcd3bc0103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:56.684478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dc7de-d3b4-4317-9a0c-d8bcd3bc0103 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:56.693918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 672/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:33:59.348832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b1f9e-88d5-48c1-9806-7cbe05a83c5a None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:59.349430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b1f9e-88d5-48c1-9806-7cbe05a83c5a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:59.349430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b1f9e-88d5-48c1-9806-7cbe05a83c5a None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:59.350776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 672/1344] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:33:59.356634 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511e8a7-c0bc-4688-8029-47a9ec810fd5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:59.357068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511e8a7-c0bc-4688-8029-47a9ec810fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:59.357181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511e8a7-c0bc-4688-8029-47a9ec810fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:59.385278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4511e8a7-c0bc-4688-8029-47a9ec810fd5 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:33:59.386516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4511e8a7-c0bc-4688-8029-47a9ec810fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:33:59.466284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 673/1345] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:33:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:33:59.504825 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b1f9e-88d5-48c1-9806-7cbe05a83c5a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:33:59.516420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b1f9e-88d5-48c1-9806-7cbe05a83c5a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:33:59.520034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7910e0-7ee0-4357-b918-6a68b59f2cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:33:59.520681 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7910e0-7ee0-4357-b918-6a68b59f2cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:33:59.520970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7910e0-7ee0-4357-b918-6a68b59f2cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:33:59.521248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7910e0-7ee0-4357-b918-6a68b59f2cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:33:59.531478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7910e0-7ee0-4357-b918-6a68b59f2cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:33:59.532938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7910e0-7ee0-4357-b918-6a68b59f2cc5 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:33:59.543956 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 673/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:33:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:03.517172 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894bd31-6701-42e3-9d0c-a6d2acacc57e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:03.517736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894bd31-6701-42e3-9d0c-a6d2acacc57e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:03.517736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894bd31-6701-42e3-9d0c-a6d2acacc57e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:03.519109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 674/1347] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:03.524717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5932-db2e-4103-93f1-d769481a7685 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:03.525158 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5932-db2e-4103-93f1-d769481a7685 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:03.525252 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5932-db2e-4103-93f1-d769481a7685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:03.544102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-20ed5932-db2e-4103-93f1-d769481a7685 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:03.545318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-20ed5932-db2e-4103-93f1-d769481a7685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:03.553989 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 674/1348] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:03.591394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894bd31-6701-42e3-9d0c-a6d2acacc57e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:03.593390 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9894bd31-6701-42e3-9d0c-a6d2acacc57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:03.606456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894bd31-6701-42e3-9d0c-a6d2acacc57e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:03.609977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8929f01-f186-4264-a21c-59365e2d482a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:03.610623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929f01-f186-4264-a21c-59365e2d482a service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:03.610906 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929f01-f186-4264-a21c-59365e2d482a service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:03.611208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929f01-f186-4264-a21c-59365e2d482a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:03.621105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8929f01-f186-4264-a21c-59365e2d482a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:03.622536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8929f01-f186-4264-a21c-59365e2d482a service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:03.632199 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 675/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:08.732851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0a35d-50e2-4672-8624-fb82bb1279cd None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:08.733368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0a35d-50e2-4672-8624-fb82bb1279cd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:08.733451 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0a35d-50e2-4672-8624-fb82bb1279cd None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:08.734936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 675/1350] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:08.744507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ac46-475d-4829-bea4-0227d809dcce None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:08.745535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ac46-475d-4829-bea4-0227d809dcce None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:08.745741 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ac46-475d-4829-bea4-0227d809dcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:08.827158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e709ac46-475d-4829-bea4-0227d809dcce None None] MFA Rules not processed for user `b98059ebef5d470db684fb78d19a8839`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:08.828495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e709ac46-475d-4829-bea4-0227d809dcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:08.857509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:34:08.925576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 676/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:34:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:12.955354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebac0a-e255-4ef1-b821-42776f748796 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:12.955908 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebac0a-e255-4ef1-b821-42776f748796 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:12.956018 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebac0a-e255-4ef1-b821-42776f748796 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:12.957768 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 676/1352] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:12.963437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31270385-79e5-46fb-87cd-26b8e41eeca8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:12.964306 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31270385-79e5-46fb-87cd-26b8e41eeca8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:12.964823 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31270385-79e5-46fb-87cd-26b8e41eeca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:12.985625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-31270385-79e5-46fb-87cd-26b8e41eeca8 None None] MFA Rules not processed for user `b98059ebef5d470db684fb78d19a8839`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:12.987114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-31270385-79e5-46fb-87cd-26b8e41eeca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:12.997953 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 677/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:34:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:13.543633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=72 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:34:14.632811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a5ee-3f7c-4fa7-bbd9-cb8570b3904a None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:14.633436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a5ee-3f7c-4fa7-bbd9-cb8570b3904a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:14.633436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a5ee-3f7c-4fa7-bbd9-cb8570b3904a None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:14.634729 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 677/1354] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:14.639798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83823b3-ba97-4c83-a8ad-e00102ed9496 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:14.640252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83823b3-ba97-4c83-a8ad-e00102ed9496 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:14.640365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83823b3-ba97-4c83-a8ad-e00102ed9496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:14.661843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b83823b3-ba97-4c83-a8ad-e00102ed9496 None None] MFA Rules not processed for user `b98059ebef5d470db684fb78d19a8839`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:14.663076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b83823b3-ba97-4c83-a8ad-e00102ed9496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:14.672445 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 678/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:34:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:18.332408 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf33d18-ea81-4b72-a510-66161ae23a4c None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:18.332408 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf33d18-ea81-4b72-a510-66161ae23a4c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:18.332408 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf33d18-ea81-4b72-a510-66161ae23a4c None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:18.336531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 678/1356] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:18.339605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e2baa-84a2-411c-9351-ba6e3410c0ff None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:18.340403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e2baa-84a2-411c-9351-ba6e3410c0ff None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:18.340834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e2baa-84a2-411c-9351-ba6e3410c0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:18.360585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fb2e2baa-84a2-411c-9351-ba6e3410c0ff None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:18.362008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fb2e2baa-84a2-411c-9351-ba6e3410c0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:18.374060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 679/1357] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:18.436777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76581003-ab0e-4290-a2b5-a7428ab8fb95 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:18.437088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76581003-ab0e-4290-a2b5-a7428ab8fb95 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:18.437346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76581003-ab0e-4290-a2b5-a7428ab8fb95 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:18.439016 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 679/1358] 10.222.0.33 () {54 vars in 961 bytes} [Wed Jul 6 20:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:18.447616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa2d28-e3a2-4f3e-83db-ddbf96b2b9b8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:18.447939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa2d28-e3a2-4f3e-83db-ddbf96b2b9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:18.448171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa2d28-e3a2-4f3e-83db-ddbf96b2b9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:18.505229 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-99aa2d28-e3a2-4f3e-83db-ddbf96b2b9b8 None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:18.506357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-99aa2d28-e3a2-4f3e-83db-ddbf96b2b9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:18.609296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 680/1359] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Jul 6 20:34:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:18.618029 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76581003-ab0e-4290-a2b5-a7428ab8fb95 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:18.635653 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76581003-ab0e-4290-a2b5-a7428ab8fb95 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:18.641289 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c7e61-dc35-4767-9e2a-711bbc16c50b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:18.642013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c7e61-dc35-4767-9e2a-711bbc16c50b service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:18.642371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c7e61-dc35-4767-9e2a-711bbc16c50b service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:18.642722 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c7e61-dc35-4767-9e2a-711bbc16c50b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:18.653632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c7e61-dc35-4767-9e2a-711bbc16c50b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:18.655363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c7e61-dc35-4767-9e2a-711bbc16c50b service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:18.666144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 680/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:20.905674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc084b-f319-4e39-acfd-8341fcda79ea None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:20.906152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc084b-f319-4e39-acfd-8341fcda79ea None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:20.906274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc084b-f319-4e39-acfd-8341fcda79ea None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:20.907633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 681/1361] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:20.912744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd92d6-fdb5-455d-9959-07f461ac3264 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:20.913141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd92d6-fdb5-455d-9959-07f461ac3264 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:20.913308 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd92d6-fdb5-455d-9959-07f461ac3264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:20.931208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-68cd92d6-fdb5-455d-9959-07f461ac3264 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:20.932941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-68cd92d6-fdb5-455d-9959-07f461ac3264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:20.940990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 681/1362] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:20.987349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc084b-f319-4e39-acfd-8341fcda79ea None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:21.003979 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc084b-f319-4e39-acfd-8341fcda79ea None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:21.010056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992c8f7-2f35-4a61-8973-871aad1bbab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:21.010962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992c8f7-2f35-4a61-8973-871aad1bbab2 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:21.011336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992c8f7-2f35-4a61-8973-871aad1bbab2 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:21.011620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992c8f7-2f35-4a61-8973-871aad1bbab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:21.021419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992c8f7-2f35-4a61-8973-871aad1bbab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:21.023385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992c8f7-2f35-4a61-8973-871aad1bbab2 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:21.033928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 682/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:23.413784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ffc3d-212f-4d82-a297-108e643be0aa None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:23.414316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ffc3d-212f-4d82-a297-108e643be0aa None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:23.414316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ffc3d-212f-4d82-a297-108e643be0aa None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:23.416217 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 682/1364] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:23.421619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173f7ba-481a-4d63-a6c9-0d18381080da None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:23.422032 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173f7ba-481a-4d63-a6c9-0d18381080da None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:23.422173 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173f7ba-481a-4d63-a6c9-0d18381080da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:23.442226 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6173f7ba-481a-4d63-a6c9-0d18381080da None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:23.443480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6173f7ba-481a-4d63-a6c9-0d18381080da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:23.452792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 683/1365] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:23.499687 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5a5c3-1746-4530-b0ce-dcd78f019211 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:23.499982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5a5c3-1746-4530-b0ce-dcd78f019211 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:23.500237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5a5c3-1746-4530-b0ce-dcd78f019211 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:23.501640 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 683/1366] 10.222.0.33 () {54 vars in 961 bytes} [Wed Jul 6 20:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:23.512699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c45d9-c8af-4114-b37f-ac5fd0a90611 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:23.513394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c45d9-c8af-4114-b37f-ac5fd0a90611 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:23.513881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c45d9-c8af-4114-b37f-ac5fd0a90611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:23.544315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2d5c45d9-c8af-4114-b37f-ac5fd0a90611 None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:23.546300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2d5c45d9-c8af-4114-b37f-ac5fd0a90611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:23.564438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 684/1367] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Jul 6 20:34:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:23.572206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5a5c3-1746-4530-b0ce-dcd78f019211 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:23.587156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5a5c3-1746-4530-b0ce-dcd78f019211 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:23.596389 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fa0c6-7565-41b1-b7cc-893110803055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:23.597040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa0c6-7565-41b1-b7cc-893110803055 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:23.597324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa0c6-7565-41b1-b7cc-893110803055 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:23.597596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa0c6-7565-41b1-b7cc-893110803055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:23.607103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fa0c6-7565-41b1-b7cc-893110803055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:23.608705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fa0c6-7565-41b1-b7cc-893110803055 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:23.618036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 684/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:25.743890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c495f-fbf3-4930-8871-3e0c0cd65f03 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:25.744718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c495f-fbf3-4930-8871-3e0c0cd65f03 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:25.745033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c495f-fbf3-4930-8871-3e0c0cd65f03 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:25.746435 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 685/1369] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:25.751807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c475b5-74bc-4bec-a2b9-e07bd2eca9da None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:25.752199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c475b5-74bc-4bec-a2b9-e07bd2eca9da None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:25.752371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c475b5-74bc-4bec-a2b9-e07bd2eca9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:25.771534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-08c475b5-74bc-4bec-a2b9-e07bd2eca9da None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:25.773200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-08c475b5-74bc-4bec-a2b9-e07bd2eca9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:25.783206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 685/1370] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:25.828282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c495f-fbf3-4930-8871-3e0c0cd65f03 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:25.844138 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c495f-fbf3-4930-8871-3e0c0cd65f03 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:25.849537 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab812b-8fe0-4187-9d17-303ed3140922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:25.850184 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab812b-8fe0-4187-9d17-303ed3140922 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:25.850471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab812b-8fe0-4187-9d17-303ed3140922 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:25.850891 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab812b-8fe0-4187-9d17-303ed3140922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:25.860620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab812b-8fe0-4187-9d17-303ed3140922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:25.862568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab812b-8fe0-4187-9d17-303ed3140922 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:25.875204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 686/1371] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:26.599493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383103e-617a-4142-be0c-65cbef6e94bd None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:26.600028 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383103e-617a-4142-be0c-65cbef6e94bd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:26.600459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383103e-617a-4142-be0c-65cbef6e94bd None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:26.602022 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 686/1372] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:26.607616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e0ed-d972-49e2-a527-672e96477c35 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:26.608091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e0ed-d972-49e2-a527-672e96477c35 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:26.608521 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e0ed-d972-49e2-a527-672e96477c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:26.627492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f8e9e0ed-d972-49e2-a527-672e96477c35 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:26.628975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f8e9e0ed-d972-49e2-a527-672e96477c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:26.651193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 687/1373] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:26.950351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f974e09-f240-4534-ad77-941305ee092f None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:26.950830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f974e09-f240-4534-ad77-941305ee092f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:26.950956 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f974e09-f240-4534-ad77-941305ee092f None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:26.952487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 687/1374] 10.222.0.33 () {54 vars in 963 bytes} [Wed Jul 6 20:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:26.957344 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d7ad3-7b3d-4f0c-88a7-5da5c9fb1935 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:26.958207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d7ad3-7b3d-4f0c-88a7-5da5c9fb1935 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:26.958970 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d7ad3-7b3d-4f0c-88a7-5da5c9fb1935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:26.966447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:34:27.013608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-dc6d7ad3-7b3d-4f0c-88a7-5da5c9fb1935 None None] MFA Rules not processed for user `4693da03c42e4328b74869abd0ae4b80`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:27.014824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dc6d7ad3-7b3d-4f0c-88a7-5da5c9fb1935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:27.085499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 688/1375] 10.222.0.33 () {58 vars in 1060 bytes} [Wed Jul 6 20:34:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:27.086506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f974e09-f240-4534-ad77-941305ee092f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:27.104857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f974e09-f240-4534-ad77-941305ee092f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:27.112178 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734b079-0419-48fd-bbb4-bbf762c199e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:27.114354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734b079-0419-48fd-bbb4-bbf762c199e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:27.115150 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734b079-0419-48fd-bbb4-bbf762c199e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:27.115753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734b079-0419-48fd-bbb4-bbf762c199e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:27.140001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734b079-0419-48fd-bbb4-bbf762c199e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:27.142570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734b079-0419-48fd-bbb4-bbf762c199e9 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:27.157787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 688/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:28.016814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d680ad6-8882-4f01-8e14-b7d429559e1e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:28.017359 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d680ad6-8882-4f01-8e14-b7d429559e1e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:28.017359 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d680ad6-8882-4f01-8e14-b7d429559e1e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:28.018613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 689/1377] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:28.024073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58a52b-95c3-4caa-9ca2-d760903080c8 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:28.024689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58a52b-95c3-4caa-9ca2-d760903080c8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:28.024848 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58a52b-95c3-4caa-9ca2-d760903080c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:28.044534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1e58a52b-95c3-4caa-9ca2-d760903080c8 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:28.045829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1e58a52b-95c3-4caa-9ca2-d760903080c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:28.054551 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 689/1378] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:28.099611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d680ad6-8882-4f01-8e14-b7d429559e1e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:28.114596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d680ad6-8882-4f01-8e14-b7d429559e1e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:28.120680 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfba5f-6a1e-46d3-bb03-9afef68487fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:28.121378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfba5f-6a1e-46d3-bb03-9afef68487fe service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:28.121664 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfba5f-6a1e-46d3-bb03-9afef68487fe service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:28.121938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfba5f-6a1e-46d3-bb03-9afef68487fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:28.129962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfba5f-6a1e-46d3-bb03-9afef68487fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:28.131568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfba5f-6a1e-46d3-bb03-9afef68487fe service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:28.142052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 690/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:30.214747 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3e6c0-ddcf-4878-8189-3535f0bd2843 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:30.215312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3e6c0-ddcf-4878-8189-3535f0bd2843 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:30.215312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3e6c0-ddcf-4878-8189-3535f0bd2843 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:30.217003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 690/1380] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:30.223302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4db41-0292-43c2-b1a6-ac12e765494d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:30.223790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4db41-0292-43c2-b1a6-ac12e765494d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:30.224114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4db41-0292-43c2-b1a6-ac12e765494d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:30.243809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-69d4db41-0292-43c2-b1a6-ac12e765494d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:30.245068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-69d4db41-0292-43c2-b1a6-ac12e765494d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:30.253176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 691/1381] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:30.297799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3e6c0-ddcf-4878-8189-3535f0bd2843 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:30.312717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3e6c0-ddcf-4878-8189-3535f0bd2843 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:30.320368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea589b28-38a9-4bd2-9ab8-88f3b7578df6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:30.321132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea589b28-38a9-4bd2-9ab8-88f3b7578df6 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:30.321648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea589b28-38a9-4bd2-9ab8-88f3b7578df6 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:30.321648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea589b28-38a9-4bd2-9ab8-88f3b7578df6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:30.331012 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea589b28-38a9-4bd2-9ab8-88f3b7578df6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:30.332652 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea589b28-38a9-4bd2-9ab8-88f3b7578df6 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:30.342647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 691/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:32.427131 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c1459-0653-4094-ab2c-6c7c3290f1b3 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:32.427651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c1459-0653-4094-ab2c-6c7c3290f1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:32.427734 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c1459-0653-4094-ab2c-6c7c3290f1b3 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:32.429102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 692/1383] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:32.434417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f96687-02b2-4222-8996-130c2519df95 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:32.434795 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f96687-02b2-4222-8996-130c2519df95 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:32.434995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f96687-02b2-4222-8996-130c2519df95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:32.454631 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-86f96687-02b2-4222-8996-130c2519df95 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:32.455867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-86f96687-02b2-4222-8996-130c2519df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:32.464590 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 692/1384] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:32.505092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c1459-0653-4094-ab2c-6c7c3290f1b3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:32.520629 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c1459-0653-4094-ab2c-6c7c3290f1b3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:32.526994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598bc02-6a5b-4bae-b051-b3b450b0eff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:32.527677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598bc02-6a5b-4bae-b051-b3b450b0eff2 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:32.527962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598bc02-6a5b-4bae-b051-b3b450b0eff2 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:32.528243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598bc02-6a5b-4bae-b051-b3b450b0eff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:32.536861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598bc02-6a5b-4bae-b051-b3b450b0eff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:32.538446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598bc02-6a5b-4bae-b051-b3b450b0eff2 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:32.548590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 693/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:34.764540 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3f3e7-7ebc-41a7-a859-9a3ef77fdfa5 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:34.765039 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3f3e7-7ebc-41a7-a859-9a3ef77fdfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:34.765039 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3f3e7-7ebc-41a7-a859-9a3ef77fdfa5 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:34.766403 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 693/1386] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:34.771541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816193a-c943-4bac-ac16-6413e88dedd7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:34.772286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816193a-c943-4bac-ac16-6413e88dedd7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:34.772437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816193a-c943-4bac-ac16-6413e88dedd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:34.791912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1816193a-c943-4bac-ac16-6413e88dedd7 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:34.793208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1816193a-c943-4bac-ac16-6413e88dedd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:34.801215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 694/1387] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:34.845506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3f3e7-7ebc-41a7-a859-9a3ef77fdfa5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:34.860957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3f3e7-7ebc-41a7-a859-9a3ef77fdfa5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:34.867496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bcf66-6e92-4650-83fa-0307024062a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:34.868296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bcf66-6e92-4650-83fa-0307024062a0 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:34.868565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bcf66-6e92-4650-83fa-0307024062a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:34.868905 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bcf66-6e92-4650-83fa-0307024062a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:34.879336 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bcf66-6e92-4650-83fa-0307024062a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:34.881258 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bcf66-6e92-4650-83fa-0307024062a0 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:34.893190 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 694/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:37.472576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ef6e-c928-4ef9-aad9-29187aed47f4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:37.473240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ef6e-c928-4ef9-aad9-29187aed47f4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:37.473240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ef6e-c928-4ef9-aad9-29187aed47f4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:37.474897 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 695/1389] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:37.481565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c13e9c-9ae0-4812-9378-c73123012165 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:37.482014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c13e9c-9ae0-4812-9378-c73123012165 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:37.482133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c13e9c-9ae0-4812-9378-c73123012165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:37.503093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-00c13e9c-9ae0-4812-9378-c73123012165 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:37.504377 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-00c13e9c-9ae0-4812-9378-c73123012165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:37.515677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 695/1390] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:34:37.563047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6ef6e-c928-4ef9-aad9-29187aed47f4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:37.580569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6ef6e-c928-4ef9-aad9-29187aed47f4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:37.588309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f187351-008a-4acb-8070-937c12c4952d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:37.589208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187351-008a-4acb-8070-937c12c4952d service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:37.589564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187351-008a-4acb-8070-937c12c4952d service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:37.590485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187351-008a-4acb-8070-937c12c4952d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:37.601576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f187351-008a-4acb-8070-937c12c4952d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:37.604791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f187351-008a-4acb-8070-937c12c4952d service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:37.617147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 696/1391] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:40.253138 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccead59-bcb7-42c0-a8f1-8859721228b5 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:40.253685 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccead59-bcb7-42c0-a8f1-8859721228b5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:40.253808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccead59-bcb7-42c0-a8f1-8859721228b5 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:40.255732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 696/1392] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:40.262222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b6c5-a283-4247-b647-bff9633201f6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:40.262669 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b6c5-a283-4247-b647-bff9633201f6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:40.262940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b6c5-a283-4247-b647-bff9633201f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:40.284610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f790b6c5-a283-4247-b647-bff9633201f6 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:40.286080 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f790b6c5-a283-4247-b647-bff9633201f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:40.296552 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 697/1393] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:40.350378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccead59-bcb7-42c0-a8f1-8859721228b5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:40.366038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccead59-bcb7-42c0-a8f1-8859721228b5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:40.372276 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd04f9-5f67-47f6-9a8c-77c10922d857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:40.372933 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd04f9-5f67-47f6-9a8c-77c10922d857 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:40.373216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd04f9-5f67-47f6-9a8c-77c10922d857 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:40.373498 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd04f9-5f67-47f6-9a8c-77c10922d857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:40.382564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd04f9-5f67-47f6-9a8c-77c10922d857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:40.385182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd04f9-5f67-47f6-9a8c-77c10922d857 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:40.395128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 697/1394] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:42.403707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d731ab7-372e-407f-9d3c-c765fab52adc None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:42.404368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d731ab7-372e-407f-9d3c-c765fab52adc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:42.404368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d731ab7-372e-407f-9d3c-c765fab52adc None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:42.405617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 698/1395] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:42.410964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5b3a6-163b-4306-a096-0670596eadc9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:42.411519 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5b3a6-163b-4306-a096-0670596eadc9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:42.411676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5b3a6-163b-4306-a096-0670596eadc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:42.429925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f7d5b3a6-163b-4306-a096-0670596eadc9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:42.431112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f7d5b3a6-163b-4306-a096-0670596eadc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:42.438873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 698/1396] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:42.447729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e31ba-b10d-4181-9feb-4d64d2363a97 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:42.448137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e31ba-b10d-4181-9feb-4d64d2363a97 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:42.448426 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e31ba-b10d-4181-9feb-4d64d2363a97 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:42.449788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 699/1397] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:42.454907 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3887f1-32bb-4055-9cde-ed7ea6b5eb79 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:42.455222 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3887f1-32bb-4055-9cde-ed7ea6b5eb79 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:42.455508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3887f1-32bb-4055-9cde-ed7ea6b5eb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:42.473395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5e3887f1-32bb-4055-9cde-ed7ea6b5eb79 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:42.474575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5e3887f1-32bb-4055-9cde-ed7ea6b5eb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:42.484873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 699/1398] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:42.494813 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65056bd4-31d7-4c4c-a8de-8e14be4897e4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:42.495107 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65056bd4-31d7-4c4c-a8de-8e14be4897e4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:42.495434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65056bd4-31d7-4c4c-a8de-8e14be4897e4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:42.496803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 700/1399] 10.222.0.33 () {54 vars in 962 bytes} [Wed Jul 6 20:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:34:42.501668 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065f90e-6df1-44f5-9431-21a3669b4e36 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:42.501957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065f90e-6df1-44f5-9431-21a3669b4e36 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:42.502286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065f90e-6df1-44f5-9431-21a3669b4e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:42.530092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65056bd4-31d7-4c4c-a8de-8e14be4897e4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:42.544426 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65056bd4-31d7-4c4c-a8de-8e14be4897e4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:42.549676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8be1d-efc3-4193-bc49-a2f1030ec733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:42.550311 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8be1d-efc3-4193-bc49-a2f1030ec733 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:42.550591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8be1d-efc3-4193-bc49-a2f1030ec733 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:42.550723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2065f90e-6df1-44f5-9431-21a3669b4e36 None None] MFA Rules not processed for user `f892e618b01a46aaaab4f79aa0c3daa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:42.550850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8be1d-efc3-4193-bc49-a2f1030ec733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:42.551948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2065f90e-6df1-44f5-9431-21a3669b4e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:42.559940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8be1d-efc3-4193-bc49-a2f1030ec733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:42.561503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8be1d-efc3-4193-bc49-a2f1030ec733 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:42.571910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 701/1400] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:34:42.619122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 700/1401] 10.222.0.33 () {58 vars in 1059 bytes} [Wed Jul 6 20:34:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:42.626874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8be1d-efc3-4193-bc49-a2f1030ec733 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:42.636619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8be1d-efc3-4193-bc49-a2f1030ec733 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:42.640227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e985833-05b7-42dc-bf19-3060391919c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f892e618b01a46aaaab4f79aa0c3daa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:42.640881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e985833-05b7-42dc-bf19-3060391919c2 service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:42.641167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e985833-05b7-42dc-bf19-3060391919c2 service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:42.641584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e985833-05b7-42dc-bf19-3060391919c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:42.653106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e985833-05b7-42dc-bf19-3060391919c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:42.654676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e985833-05b7-42dc-bf19-3060391919c2 service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:42.669607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 702/1402] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:43.402570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaef608-7769-422a-bd16-152f0aad01b4 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:43.402893 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaef608-7769-422a-bd16-152f0aad01b4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:43.403195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaef608-7769-422a-bd16-152f0aad01b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:43.421536 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:34:43.452032 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-deaef608-7769-422a-bd16-152f0aad01b4 None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:43.453229 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-deaef608-7769-422a-bd16-152f0aad01b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:43.516825 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 701/1403] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:34:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:43.558307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4129a0-e9de-4cdc-9ea8-6c76be40e6b6 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:43.558796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4129a0-e9de-4cdc-9ea8-6c76be40e6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:43.559033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4129a0-e9de-4cdc-9ea8-6c76be40e6b6 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:43.560524 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 703/1404] 10.222.0.33 () {54 vars in 942 bytes} [Wed Jul 6 20:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:43.566635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc3056-c94c-4e20-9019-a12624f0cf13 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:43.566929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc3056-c94c-4e20-9019-a12624f0cf13 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:43.567226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc3056-c94c-4e20-9019-a12624f0cf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:43.620153 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-26fc3056-c94c-4e20-9019-a12624f0cf13 None None] MFA Rules not processed for user `88dff378ccb4497fb305563614ea4caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:43.621349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-26fc3056-c94c-4e20-9019-a12624f0cf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:43.693388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 702/1405] 10.222.0.33 () {58 vars in 1039 bytes} [Wed Jul 6 20:34:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:43.702751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4129a0-e9de-4cdc-9ea8-6c76be40e6b6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:43.718358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4129a0-e9de-4cdc-9ea8-6c76be40e6b6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:43.723540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34ec0a-bb53-4719-9e69-070726236298 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:43.724197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34ec0a-bb53-4719-9e69-070726236298 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:43.724477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34ec0a-bb53-4719-9e69-070726236298 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:43.724749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34ec0a-bb53-4719-9e69-070726236298 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:43.734494 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34ec0a-bb53-4719-9e69-070726236298 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:43.736099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34ec0a-bb53-4719-9e69-070726236298 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:43.745059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 704/1406] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:34:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:34:44.659148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f46f1e-e291-47bc-8046-1b0c1a10da75 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:44.659723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f46f1e-e291-47bc-8046-1b0c1a10da75 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:44.659723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f46f1e-e291-47bc-8046-1b0c1a10da75 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:44.661267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 703/1407] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:34:44.667042 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176e160-5784-4ef8-82e5-0193cabb7dc8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:44.667533 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176e160-5784-4ef8-82e5-0193cabb7dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:44.667647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176e160-5784-4ef8-82e5-0193cabb7dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:44.708415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9176e160-5784-4ef8-82e5-0193cabb7dc8 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:34:44.709675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9176e160-5784-4ef8-82e5-0193cabb7dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:34:44.723219 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 705/1408] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:34:44.767480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f46f1e-e291-47bc-8046-1b0c1a10da75 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:34:44.783244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f46f1e-e291-47bc-8046-1b0c1a10da75 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:34:44.788990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66357d-07d4-4b76-ad71-f494f98f7560 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:34:44.790146 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66357d-07d4-4b76-ad71-f494f98f7560 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:34:44.790426 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66357d-07d4-4b76-ad71-f494f98f7560 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:34:44.790701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66357d-07d4-4b76-ad71-f494f98f7560 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:34:44.799745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66357d-07d4-4b76-ad71-f494f98f7560 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:34:44.801363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66357d-07d4-4b76-ad71-f494f98f7560 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:34:44.814948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 704/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:34:54.703067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=84 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:34:54.807495 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=85 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:35:06.022509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e5102-2043-43ec-aeaa-e4c600dcca25 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:06.023093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e5102-2043-43ec-aeaa-e4c600dcca25 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:06.023093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e5102-2043-43ec-aeaa-e4c600dcca25 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:06.024223 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 706/1410] 10.222.0.33 () {54 vars in 918 bytes} [Wed Jul 6 20:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:06.029275 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763328-254c-430b-9a1a-ec32ad02efba None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:06.029739 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763328-254c-430b-9a1a-ec32ad02efba None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:06.029855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763328-254c-430b-9a1a-ec32ad02efba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:06.047916 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a6763328-254c-430b-9a1a-ec32ad02efba None None] MFA Rules not processed for user `b98059ebef5d470db684fb78d19a8839`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:06.049140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a6763328-254c-430b-9a1a-ec32ad02efba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:06.057509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 705/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Jul 6 20:35:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:06.072340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111a016-67d7-4edd-848e-ba8f99113317 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:06.072626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111a016-67d7-4edd-848e-ba8f99113317 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:06.072904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111a016-67d7-4edd-848e-ba8f99113317 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:06.074246 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 707/1412] 10.222.0.33 () {54 vars in 918 bytes} [Wed Jul 6 20:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:06.078827 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b46f2-7c09-4a84-acdd-8cec2a715869 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:06.079112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b46f2-7c09-4a84-acdd-8cec2a715869 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:06.079417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b46f2-7c09-4a84-acdd-8cec2a715869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:06.097136 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f37b46f2-7c09-4a84-acdd-8cec2a715869 None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:06.098338 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f37b46f2-7c09-4a84-acdd-8cec2a715869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:06.107382 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 706/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Jul 6 20:35:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:08.603539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6dfc8-a9a7-49df-a099-2fdbba4d4481 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:08.604097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6dfc8-a9a7-49df-a099-2fdbba4d4481 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:08.604097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6dfc8-a9a7-49df-a099-2fdbba4d4481 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:08.605486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:08.610840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c71d1-2368-4888-973e-053dd41e691e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:08.611372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c71d1-2368-4888-973e-053dd41e691e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:08.611485 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c71d1-2368-4888-973e-053dd41e691e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:08.629559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-aa7c71d1-2368-4888-973e-053dd41e691e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:08.631371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-aa7c71d1-2368-4888-973e-053dd41e691e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:08.639201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:08.686615 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6dfc8-a9a7-49df-a099-2fdbba4d4481 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:08.702505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6dfc8-a9a7-49df-a099-2fdbba4d4481 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:08.707674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a338cc1-50b7-463a-a8fd-08e8e0120eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:08.708303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a338cc1-50b7-463a-a8fd-08e8e0120eb3 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:08.708585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a338cc1-50b7-463a-a8fd-08e8e0120eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:08.709394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a338cc1-50b7-463a-a8fd-08e8e0120eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:08.717236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a338cc1-50b7-463a-a8fd-08e8e0120eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:08.718793 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a338cc1-50b7-463a-a8fd-08e8e0120eb3 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:08.728610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 709/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:09.621081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af1e3a-c213-4014-bb95-a747abda1eff None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:09.621561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af1e3a-c213-4014-bb95-a747abda1eff None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:09.621674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af1e3a-c213-4014-bb95-a747abda1eff None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:09.623003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:09.627821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f4078-84ed-4151-a47e-67283b3b8ab6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:09.628215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f4078-84ed-4151-a47e-67283b3b8ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:09.628384 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f4078-84ed-4151-a47e-67283b3b8ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:09.646071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f83f4078-84ed-4151-a47e-67283b3b8ab6 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:09.647819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f83f4078-84ed-4151-a47e-67283b3b8ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:09.655456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:09.804148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af1e3a-c213-4014-bb95-a747abda1eff None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:09.819232 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af1e3a-c213-4014-bb95-a747abda1eff None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:09.824658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5e819-158f-4255-966a-77ac42188fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:09.825296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e819-158f-4255-966a-77ac42188fc9 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:09.825575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e819-158f-4255-966a-77ac42188fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:09.825847 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e819-158f-4255-966a-77ac42188fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:09.834525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5e819-158f-4255-966a-77ac42188fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:09.836117 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5e819-158f-4255-966a-77ac42188fc9 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:09.845386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 709/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:10.723707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785600d-b942-4268-b5b4-1d9cc13c84df None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:10.724288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785600d-b942-4268-b5b4-1d9cc13c84df None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:10.724288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785600d-b942-4268-b5b4-1d9cc13c84df None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:10.725877 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:10.730861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c0d7-693b-493f-a1b9-9da1b0241282 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:10.731304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c0d7-693b-493f-a1b9-9da1b0241282 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:10.731519 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c0d7-693b-493f-a1b9-9da1b0241282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:10.749011 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1d50c0d7-693b-493f-a1b9-9da1b0241282 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:10.750202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1d50c0d7-693b-493f-a1b9-9da1b0241282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:10.758602 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:10.910588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785600d-b942-4268-b5b4-1d9cc13c84df None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:10.925235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785600d-b942-4268-b5b4-1d9cc13c84df None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:10.930551 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155dd8a-5b53-496b-9cb6-6e26f8053ad5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:10.931198 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155dd8a-5b53-496b-9cb6-6e26f8053ad5 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:10.931499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155dd8a-5b53-496b-9cb6-6e26f8053ad5 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:10.931774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155dd8a-5b53-496b-9cb6-6e26f8053ad5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:10.939633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155dd8a-5b53-496b-9cb6-6e26f8053ad5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:10.941194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155dd8a-5b53-496b-9cb6-6e26f8053ad5 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:10.950462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 712/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:11.837274 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8123f3-0be4-456a-a85d-59f7e089f398 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:11.837805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8123f3-0be4-456a-a85d-59f7e089f398 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:11.837923 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8123f3-0be4-456a-a85d-59f7e089f398 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:11.839344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:11.844319 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c2376-1f65-4ed4-9ae9-16ab6485fd4d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:11.844701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c2376-1f65-4ed4-9ae9-16ab6485fd4d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:11.844868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c2376-1f65-4ed4-9ae9-16ab6485fd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:11.863218 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e17c2376-1f65-4ed4-9ae9-16ab6485fd4d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:11.864416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e17c2376-1f65-4ed4-9ae9-16ab6485fd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:11.873664 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:12.024701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8123f3-0be4-456a-a85d-59f7e089f398 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:12.039286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8123f3-0be4-456a-a85d-59f7e089f398 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:12.044574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f5363-d564-49e0-aa5b-424f1a847dad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:12.045206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f5363-d564-49e0-aa5b-424f1a847dad service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:12.045511 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f5363-d564-49e0-aa5b-424f1a847dad service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:12.045787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f5363-d564-49e0-aa5b-424f1a847dad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:12.053883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f5363-d564-49e0-aa5b-424f1a847dad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:12.055470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f5363-d564-49e0-aa5b-424f1a847dad service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:12.064615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 712/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:12.926365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5817-93e7-47a8-b3b9-f65205bab74e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:12.926926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5817-93e7-47a8-b3b9-f65205bab74e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:12.927023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5817-93e7-47a8-b3b9-f65205bab74e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:12.928363 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:12.933160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad9a60-a5c1-416a-82c5-1df46a1b2e93 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:12.933598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad9a60-a5c1-416a-82c5-1df46a1b2e93 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:12.933696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad9a60-a5c1-416a-82c5-1df46a1b2e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:12.952093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-12ad9a60-a5c1-416a-82c5-1df46a1b2e93 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:12.953312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-12ad9a60-a5c1-416a-82c5-1df46a1b2e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:12.961821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:13.112202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def5817-93e7-47a8-b3b9-f65205bab74e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:13.127345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def5817-93e7-47a8-b3b9-f65205bab74e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:13.133283 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfea4a-d13f-411a-b07a-91a29930c65a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:13.133914 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfea4a-d13f-411a-b07a-91a29930c65a service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:13.134199 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfea4a-d13f-411a-b07a-91a29930c65a service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:13.134473 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfea4a-d13f-411a-b07a-91a29930c65a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:13.142481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfea4a-d13f-411a-b07a-91a29930c65a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:13.144094 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfea4a-d13f-411a-b07a-91a29930c65a service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:13.153656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 715/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:13.954663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d39a42-7c53-4beb-8622-85d962292bdf None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:13.955216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d39a42-7c53-4beb-8622-85d962292bdf None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:13.955216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d39a42-7c53-4beb-8622-85d962292bdf None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:13.956534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:13.962792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05b365-1762-4f4a-966d-8318467255ff None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:13.963259 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05b365-1762-4f4a-966d-8318467255ff None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:13.963385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05b365-1762-4f4a-966d-8318467255ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:13.982202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-be05b365-1762-4f4a-966d-8318467255ff None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:13.983438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-be05b365-1762-4f4a-966d-8318467255ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:13.991921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:14.142483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d39a42-7c53-4beb-8622-85d962292bdf None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:14.157474 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d39a42-7c53-4beb-8622-85d962292bdf None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:14.163477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64550b-26ba-4557-92aa-6346ff52bc97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:14.164104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64550b-26ba-4557-92aa-6346ff52bc97 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:14.164387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64550b-26ba-4557-92aa-6346ff52bc97 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:14.164663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64550b-26ba-4557-92aa-6346ff52bc97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:14.172653 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64550b-26ba-4557-92aa-6346ff52bc97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:14.174211 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64550b-26ba-4557-92aa-6346ff52bc97 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:14.184495 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 715/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:14.990814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c02a1-04b6-4d38-894e-1248af9232c8 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:14.991374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c02a1-04b6-4d38-894e-1248af9232c8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:14.991374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c02a1-04b6-4d38-894e-1248af9232c8 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:14.992703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:14.997560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e59a70-9cfc-4587-8aa4-9d4e6f781aff None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:14.997998 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e59a70-9cfc-4587-8aa4-9d4e6f781aff None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:14.998138 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e59a70-9cfc-4587-8aa4-9d4e6f781aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:15.016493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c7e59a70-9cfc-4587-8aa4-9d4e6f781aff None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:15.017711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c7e59a70-9cfc-4587-8aa4-9d4e6f781aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:15.026914 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:15.176306 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c02a1-04b6-4d38-894e-1248af9232c8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:15.191348 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c02a1-04b6-4d38-894e-1248af9232c8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:15.197024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dd119-2aaf-4d80-810c-f2814d97b3b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:15.197658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dd119-2aaf-4d80-810c-f2814d97b3b2 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:15.197944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dd119-2aaf-4d80-810c-f2814d97b3b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:15.198220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dd119-2aaf-4d80-810c-f2814d97b3b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:15.206300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dd119-2aaf-4d80-810c-f2814d97b3b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:15.207915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dd119-2aaf-4d80-810c-f2814d97b3b2 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:15.217300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 718/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:16.026377 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7a544-fc73-4743-bdcb-80f7a5ba7794 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:16.027000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7a544-fc73-4743-bdcb-80f7a5ba7794 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:16.027000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7a544-fc73-4743-bdcb-80f7a5ba7794 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:16.028263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:16.033209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23b631-788f-4869-8d9d-2045298b54ad None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:16.033743 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23b631-788f-4869-8d9d-2045298b54ad None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:16.033743 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23b631-788f-4869-8d9d-2045298b54ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:16.052620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bb23b631-788f-4869-8d9d-2045298b54ad None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:16.053890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bb23b631-788f-4869-8d9d-2045298b54ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:16.061584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:16.209071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7a544-fc73-4743-bdcb-80f7a5ba7794 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:16.223420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7a544-fc73-4743-bdcb-80f7a5ba7794 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:16.229385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89380a-0970-4119-9db0-28ba2a8a6a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:16.230015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89380a-0970-4119-9db0-28ba2a8a6a0f service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:16.230299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89380a-0970-4119-9db0-28ba2a8a6a0f service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:16.230577 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89380a-0970-4119-9db0-28ba2a8a6a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:16.238615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89380a-0970-4119-9db0-28ba2a8a6a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:16.240333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89380a-0970-4119-9db0-28ba2a8a6a0f service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:16.249596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 718/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:17.051817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026e229-18f0-4511-850a-af88732a3b81 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:17.052920 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026e229-18f0-4511-850a-af88732a3b81 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:17.053206 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026e229-18f0-4511-850a-af88732a3b81 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:17.054587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:35:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:17.059586 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28c097-f4a3-4f5f-b741-8d89f07b9809 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:17.060014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28c097-f4a3-4f5f-b741-8d89f07b9809 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:17.060125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28c097-f4a3-4f5f-b741-8d89f07b9809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:17.078584 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4b28c097-f4a3-4f5f-b741-8d89f07b9809 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:17.079811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4b28c097-f4a3-4f5f-b741-8d89f07b9809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:17.088226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:17.243355 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026e229-18f0-4511-850a-af88732a3b81 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:17.257810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026e229-18f0-4511-850a-af88732a3b81 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:17.263056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33694011-4b0f-4d2f-8f3f-c5a6c9608bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:17.263720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33694011-4b0f-4d2f-8f3f-c5a6c9608bbe service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:17.264000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33694011-4b0f-4d2f-8f3f-c5a6c9608bbe service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:17.264273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33694011-4b0f-4d2f-8f3f-c5a6c9608bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:17.273144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33694011-4b0f-4d2f-8f3f-c5a6c9608bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:17.274720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33694011-4b0f-4d2f-8f3f-c5a6c9608bbe service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:17.283907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 721/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:19.225763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b600de-31ed-46f8-a375-7bc5f05b827c None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:19.226322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b600de-31ed-46f8-a375-7bc5f05b827c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:19.226322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b600de-31ed-46f8-a375-7bc5f05b827c None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:19.227729 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:19.233059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00905100-231c-4c02-b6ee-e87aa18a89eb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:19.233503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00905100-231c-4c02-b6ee-e87aa18a89eb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:19.233602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00905100-231c-4c02-b6ee-e87aa18a89eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:19.250768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-00905100-231c-4c02-b6ee-e87aa18a89eb None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:19.251982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-00905100-231c-4c02-b6ee-e87aa18a89eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:19.259774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:19.298569 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b600de-31ed-46f8-a375-7bc5f05b827c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:19.309374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b600de-31ed-46f8-a375-7bc5f05b827c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:19.312873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd48c3-f019-4c7b-a9c5-7992371ffb0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:19.313501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd48c3-f019-4c7b-a9c5-7992371ffb0b service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:19.313783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd48c3-f019-4c7b-a9c5-7992371ffb0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:19.314060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd48c3-f019-4c7b-a9c5-7992371ffb0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:19.324267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd48c3-f019-4c7b-a9c5-7992371ffb0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:19.325882 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd48c3-f019-4c7b-a9c5-7992371ffb0b service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:19.335887 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 721/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:21.660664 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715247a3-28ba-47ac-a983-10e00aeec404 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:21.661308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715247a3-28ba-47ac-a983-10e00aeec404 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:21.661308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715247a3-28ba-47ac-a983-10e00aeec404 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:21.662735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:21.668238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1248c3-1a87-45e9-bc82-2fb04309c166 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:21.668711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1248c3-1a87-45e9-bc82-2fb04309c166 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:21.668902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1248c3-1a87-45e9-bc82-2fb04309c166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:21.687130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4e1248c3-1a87-45e9-bc82-2fb04309c166 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:21.688387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4e1248c3-1a87-45e9-bc82-2fb04309c166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:21.697129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:21.735958 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715247a3-28ba-47ac-a983-10e00aeec404 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:21.746801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715247a3-28ba-47ac-a983-10e00aeec404 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:21.750279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0284ee-9af1-4a7d-976f-5cea2e556644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:21.750909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0284ee-9af1-4a7d-976f-5cea2e556644 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:21.751220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0284ee-9af1-4a7d-976f-5cea2e556644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:21.751499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0284ee-9af1-4a7d-976f-5cea2e556644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:21.760978 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0284ee-9af1-4a7d-976f-5cea2e556644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:21.762386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0284ee-9af1-4a7d-976f-5cea2e556644 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:21.772162 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 724/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:24.104665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004508ec-af18-491d-88d5-61526f9230ef None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:24.105244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004508ec-af18-491d-88d5-61526f9230ef None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:24.105244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004508ec-af18-491d-88d5-61526f9230ef None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:24.106584 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:24.111683 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827bafe-1093-4d1a-a737-c96d3f5bf33c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:24.112101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827bafe-1093-4d1a-a737-c96d3f5bf33c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:24.112234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827bafe-1093-4d1a-a737-c96d3f5bf33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:24.130298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d827bafe-1093-4d1a-a737-c96d3f5bf33c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:24.131526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d827bafe-1093-4d1a-a737-c96d3f5bf33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:24.139240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:24.178431 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004508ec-af18-491d-88d5-61526f9230ef None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:24.189441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004508ec-af18-491d-88d5-61526f9230ef None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:24.193253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66c222-9dfd-414d-961f-5cc12b6ea343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:24.193890 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c222-9dfd-414d-961f-5cc12b6ea343 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:24.194177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c222-9dfd-414d-961f-5cc12b6ea343 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:24.194459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c222-9dfd-414d-961f-5cc12b6ea343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:24.203345 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66c222-9dfd-414d-961f-5cc12b6ea343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:24.204773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66c222-9dfd-414d-961f-5cc12b6ea343 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:24.214439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 724/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:26.392593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac33ce-3b3a-4ecf-94e2-f7479526bf83 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:26.393277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac33ce-3b3a-4ecf-94e2-f7479526bf83 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:26.393277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac33ce-3b3a-4ecf-94e2-f7479526bf83 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:26.394798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:26.400607 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde59562-fe6a-4bd8-bb4d-314d5fae9619 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:26.401079 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde59562-fe6a-4bd8-bb4d-314d5fae9619 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:26.401187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde59562-fe6a-4bd8-bb4d-314d5fae9619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:26.418542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cde59562-fe6a-4bd8-bb4d-314d5fae9619 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:26.419775 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cde59562-fe6a-4bd8-bb4d-314d5fae9619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:26.427578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:26.466223 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac33ce-3b3a-4ecf-94e2-f7479526bf83 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:26.476789 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac33ce-3b3a-4ecf-94e2-f7479526bf83 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:26.480251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129be1cf-8ec0-4885-bf4a-27ad1285b1b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:26.480883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129be1cf-8ec0-4885-bf4a-27ad1285b1b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:26.481170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129be1cf-8ec0-4885-bf4a-27ad1285b1b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:26.481446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129be1cf-8ec0-4885-bf4a-27ad1285b1b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:26.490538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129be1cf-8ec0-4885-bf4a-27ad1285b1b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:26.491988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129be1cf-8ec0-4885-bf4a-27ad1285b1b2 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:26.501400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 727/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:35:28.678118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300a086-c542-460d-9e55-b80ec351d16e None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:28.678647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300a086-c542-460d-9e55-b80ec351d16e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:28.678766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300a086-c542-460d-9e55-b80ec351d16e None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:28.680481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:28.685811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb3c45-15f7-43c8-b9f5-6d095fd7c72b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:28.686223 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb3c45-15f7-43c8-b9f5-6d095fd7c72b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:28.686368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb3c45-15f7-43c8-b9f5-6d095fd7c72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:28.704049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-35cb3c45-15f7-43c8-b9f5-6d095fd7c72b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:28.705241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-35cb3c45-15f7-43c8-b9f5-6d095fd7c72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:28.713320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:28.751851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300a086-c542-460d-9e55-b80ec351d16e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:28.762648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300a086-c542-460d-9e55-b80ec351d16e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:28.766093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b8dbc-4ca9-4339-a266-b0c8d51d95d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:28.766726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b8dbc-4ca9-4339-a266-b0c8d51d95d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:28.767013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b8dbc-4ca9-4339-a266-b0c8d51d95d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:28.767391 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b8dbc-4ca9-4339-a266-b0c8d51d95d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:28.776408 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b8dbc-4ca9-4339-a266-b0c8d51d95d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:28.777837 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b8dbc-4ca9-4339-a266-b0c8d51d95d2 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:28.787613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 727/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:30.859779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566ab34-e366-4e31-9c42-6850e8107619 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:30.860215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566ab34-e366-4e31-9c42-6850e8107619 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:30.860308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566ab34-e366-4e31-9c42-6850e8107619 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:30.861643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:30.867605 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb37b6-1686-444a-8448-61b211de3a79 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:30.868058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb37b6-1686-444a-8448-61b211de3a79 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:30.868155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb37b6-1686-444a-8448-61b211de3a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:30.885874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f5cb37b6-1686-444a-8448-61b211de3a79 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:30.887066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f5cb37b6-1686-444a-8448-61b211de3a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:30.895113 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:30.933534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566ab34-e366-4e31-9c42-6850e8107619 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:30.944165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566ab34-e366-4e31-9c42-6850e8107619 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:30.947652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2075418-a9fe-4305-b6e9-01276232b68c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:30.948283 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2075418-a9fe-4305-b6e9-01276232b68c service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:30.948568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2075418-a9fe-4305-b6e9-01276232b68c service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:30.948846 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2075418-a9fe-4305-b6e9-01276232b68c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:30.957585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2075418-a9fe-4305-b6e9-01276232b68c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:30.959000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2075418-a9fe-4305-b6e9-01276232b68c service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:30.968543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 730/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:33.064671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6281e-d69b-417c-b112-66e4f3be165e None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:33.065211 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6281e-d69b-417c-b112-66e4f3be165e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:33.065211 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6281e-d69b-417c-b112-66e4f3be165e None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:33.067228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:33.072562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545c7bd-cb61-4fb3-8d13-4465cdc7be40 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:33.072994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545c7bd-cb61-4fb3-8d13-4465cdc7be40 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:33.073125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545c7bd-cb61-4fb3-8d13-4465cdc7be40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:33.091112 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7545c7bd-cb61-4fb3-8d13-4465cdc7be40 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:33.092335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7545c7bd-cb61-4fb3-8d13-4465cdc7be40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:33.100271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:33.138147 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6281e-d69b-417c-b112-66e4f3be165e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:33.149650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6281e-d69b-417c-b112-66e4f3be165e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:33.153138 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280afc9-0537-4ef2-90b5-df60cca245f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:33.153772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280afc9-0537-4ef2-90b5-df60cca245f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:33.154060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280afc9-0537-4ef2-90b5-df60cca245f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:33.154342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280afc9-0537-4ef2-90b5-df60cca245f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:33.163268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280afc9-0537-4ef2-90b5-df60cca245f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:33.164690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280afc9-0537-4ef2-90b5-df60cca245f1 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:33.174009 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 730/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:35.247121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c3543-d634-4c50-857d-aaff72d97f04 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:35.247689 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c3543-d634-4c50-857d-aaff72d97f04 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:35.247689 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c3543-d634-4c50-857d-aaff72d97f04 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:35.249083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:35.254834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882346f-b6d6-4026-9031-939a9fe86303 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:35.255266 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882346f-b6d6-4026-9031-939a9fe86303 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:35.255418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882346f-b6d6-4026-9031-939a9fe86303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:35.261424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=79 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:35:35.275207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a882346f-b6d6-4026-9031-939a9fe86303 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:35.276388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a882346f-b6d6-4026-9031-939a9fe86303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:35.284087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:35:35.322301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c3543-d634-4c50-857d-aaff72d97f04 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:35.329509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=73 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:35:35.339106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c3543-d634-4c50-857d-aaff72d97f04 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:35.342700 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f07f74-2fd6-4791-9f66-9df03a082f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:35.343474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07f74-2fd6-4791-9f66-9df03a082f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:35.343759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07f74-2fd6-4791-9f66-9df03a082f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:35.344035 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07f74-2fd6-4791-9f66-9df03a082f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:35.354242 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f07f74-2fd6-4791-9f66-9df03a082f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:35.355721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f07f74-2fd6-4791-9f66-9df03a082f28 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:35.366153 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 733/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:35:37.522067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee682a1-0da3-48eb-a52b-f3453d95226c None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:37.522607 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee682a1-0da3-48eb-a52b-f3453d95226c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:37.522607 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee682a1-0da3-48eb-a52b-f3453d95226c None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:37.524029 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:37.529409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dcab0-ccbf-4408-80d0-d1733d598a8e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:37.529833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dcab0-ccbf-4408-80d0-d1733d598a8e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:37.529961 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dcab0-ccbf-4408-80d0-d1733d598a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:37.547653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-468dcab0-ccbf-4408-80d0-d1733d598a8e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:37.548838 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-468dcab0-ccbf-4408-80d0-d1733d598a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:37.557271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:35:37.592634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee682a1-0da3-48eb-a52b-f3453d95226c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:37.604306 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee682a1-0da3-48eb-a52b-f3453d95226c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:37.607738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411b291-24e2-41ed-bdd2-2a9e24bc15da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:37.608371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b291-24e2-41ed-bdd2-2a9e24bc15da service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:37.608653 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b291-24e2-41ed-bdd2-2a9e24bc15da service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:37.608930 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b291-24e2-41ed-bdd2-2a9e24bc15da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:37.618596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411b291-24e2-41ed-bdd2-2a9e24bc15da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:37.620069 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411b291-24e2-41ed-bdd2-2a9e24bc15da service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:37.629553 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 733/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:39.688863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bf859-5657-4a07-86c2-0b5267e03757 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:39.689384 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bf859-5657-4a07-86c2-0b5267e03757 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:39.689493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bf859-5657-4a07-86c2-0b5267e03757 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:39.690811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:39.696211 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940b34a-d645-496a-aa9e-a7c03f31101e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:39.696626 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940b34a-d645-496a-aa9e-a7c03f31101e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:39.696772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940b34a-d645-496a-aa9e-a7c03f31101e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:39.715119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5940b34a-d645-496a-aa9e-a7c03f31101e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:39.716412 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5940b34a-d645-496a-aa9e-a7c03f31101e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:39.724925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:39.760825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bf859-5657-4a07-86c2-0b5267e03757 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:39.772216 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bf859-5657-4a07-86c2-0b5267e03757 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:39.775657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32133e3c-762d-4d5e-865a-7944f2c6aee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:39.776284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32133e3c-762d-4d5e-865a-7944f2c6aee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:39.776564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32133e3c-762d-4d5e-865a-7944f2c6aee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:39.776835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32133e3c-762d-4d5e-865a-7944f2c6aee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:39.785831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32133e3c-762d-4d5e-865a-7944f2c6aee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:39.787293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32133e3c-762d-4d5e-865a-7944f2c6aee2 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:39.796712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 736/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:35:49.710050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=11 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:35:49.792641 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=14 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:35:59.493081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf064c33-7e40-415b-bc9a-8b71a873dbcf None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:59.493640 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf064c33-7e40-415b-bc9a-8b71a873dbcf None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:59.493640 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf064c33-7e40-415b-bc9a-8b71a873dbcf None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:59.495061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 735/1471] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:59.500156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e527f-2a32-4184-9a06-ee9725baf3d3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:59.500557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e527f-2a32-4184-9a06-ee9725baf3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:59.500714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e527f-2a32-4184-9a06-ee9725baf3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:59.519842 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9c0e527f-2a32-4184-9a06-ee9725baf3d3 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:59.521024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9c0e527f-2a32-4184-9a06-ee9725baf3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:59.528709 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 737/1472] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:59.612126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b6c20-b8f4-4cfc-80ed-8eccf57270ff None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:59.612419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b6c20-b8f4-4cfc-80ed-8eccf57270ff None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:59.612702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b6c20-b8f4-4cfc-80ed-8eccf57270ff None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:59.614073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 736/1473] 10.222.0.33 () {54 vars in 962 bytes} [Wed Jul 6 20:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:35:59.619042 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054266a7-079c-4299-9225-7b32377b2fee None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:59.619416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054266a7-079c-4299-9225-7b32377b2fee None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:59.619648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054266a7-079c-4299-9225-7b32377b2fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:59.638094 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-054266a7-079c-4299-9225-7b32377b2fee None None] MFA Rules not processed for user `f892e618b01a46aaaab4f79aa0c3daa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:35:59.639327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-054266a7-079c-4299-9225-7b32377b2fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:35:59.646158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 738/1474] 10.222.0.33 () {58 vars in 1059 bytes} [Wed Jul 6 20:35:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:35:59.653431 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b6c20-b8f4-4cfc-80ed-8eccf57270ff None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:35:59.664885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b6c20-b8f4-4cfc-80ed-8eccf57270ff None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:35:59.668474 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60404c2e-98de-4c62-8991-c4c7975fbea1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f892e618b01a46aaaab4f79aa0c3daa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:35:59.669142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60404c2e-98de-4c62-8991-c4c7975fbea1 service glance] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:35:59.669431 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60404c2e-98de-4c62-8991-c4c7975fbea1 service glance] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:35:59.669710 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60404c2e-98de-4c62-8991-c4c7975fbea1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:35:59.679870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60404c2e-98de-4c62-8991-c4c7975fbea1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:35:59.681297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60404c2e-98de-4c62-8991-c4c7975fbea1 service glance] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:35:59.691316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 737/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:01.877572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ad1fb-3400-4355-88e5-1afd7e85e5f3 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:01.878129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ad1fb-3400-4355-88e5-1afd7e85e5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:01.878129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ad1fb-3400-4355-88e5-1afd7e85e5f3 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:01.879528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 739/1476] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:36:01.884805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8374fc-d718-42cd-b187-c466ed8d6134 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:01.885233 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8374fc-d718-42cd-b187-c466ed8d6134 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:01.885383 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8374fc-d718-42cd-b187-c466ed8d6134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:01.903746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fe8374fc-d718-42cd-b187-c466ed8d6134 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:01.904968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fe8374fc-d718-42cd-b187-c466ed8d6134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:01.919694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 738/1477] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:01.942793 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ad1fb-3400-4355-88e5-1afd7e85e5f3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:01.956599 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ad1fb-3400-4355-88e5-1afd7e85e5f3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:01.960963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cbba5-0df4-4524-a184-3838ff6c9a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:01.961627 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cbba5-0df4-4524-a184-3838ff6c9a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:01.961914 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cbba5-0df4-4524-a184-3838ff6c9a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:01.962186 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cbba5-0df4-4524-a184-3838ff6c9a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:01.962903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cbba5-0df4-4524-a184-3838ff6c9a13 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:01.964712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-c16cbba5-0df4-4524-a184-3838ff6c9a13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:36:01.964712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 06 20:36:01.964712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: Jul 06 20:36:01.965859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cbba5-0df4-4524-a184-3838ff6c9a13 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:01.985069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 740/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jul 6 20:36:01 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:36:04.075131 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e4f09-8f21-4b2f-a3ae-a93222f4009d None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:04.075706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e4f09-8f21-4b2f-a3ae-a93222f4009d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:04.075706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e4f09-8f21-4b2f-a3ae-a93222f4009d None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:04.077137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 739/1479] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:36:04.082978 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961824e-bcc8-4a12-9e14-0fb4950b0d24 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:04.083427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961824e-bcc8-4a12-9e14-0fb4950b0d24 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:04.083684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961824e-bcc8-4a12-9e14-0fb4950b0d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:04.101103 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2961824e-bcc8-4a12-9e14-0fb4950b0d24 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:04.102313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2961824e-bcc8-4a12-9e14-0fb4950b0d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:04.109926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 741/1480] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:04.152861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e4f09-8f21-4b2f-a3ae-a93222f4009d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:04.167499 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e4f09-8f21-4b2f-a3ae-a93222f4009d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:04.172776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd089a6-cc41-4ec2-96b5-6e4a2743a988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:04.173932 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd089a6-cc41-4ec2-96b5-6e4a2743a988 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:04.174212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd089a6-cc41-4ec2-96b5-6e4a2743a988 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:04.174495 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd089a6-cc41-4ec2-96b5-6e4a2743a988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:04.182556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd089a6-cc41-4ec2-96b5-6e4a2743a988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:04.184172 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd089a6-cc41-4ec2-96b5-6e4a2743a988 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:04.194263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 740/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:06.402032 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bb6ba-aab1-4159-adaa-689f614decc7 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:06.402597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bb6ba-aab1-4159-adaa-689f614decc7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:06.402597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bb6ba-aab1-4159-adaa-689f614decc7 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:06.403993 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 742/1482] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:36:06.409561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edde91-44a4-4d10-a6b4-c475a38e77a3 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:06.409993 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edde91-44a4-4d10-a6b4-c475a38e77a3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:06.410102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edde91-44a4-4d10-a6b4-c475a38e77a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:06.427603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-27edde91-44a4-4d10-a6b4-c475a38e77a3 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:06.428787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-27edde91-44a4-4d10-a6b4-c475a38e77a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:06.436481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 741/1483] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:06.473038 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bb6ba-aab1-4159-adaa-689f614decc7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:06.483574 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bb6ba-aab1-4159-adaa-689f614decc7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:06.487137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58358392-2bb5-4501-8193-28918002639c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:06.487828 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58358392-2bb5-4501-8193-28918002639c service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:06.488115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58358392-2bb5-4501-8193-28918002639c service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:06.488397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58358392-2bb5-4501-8193-28918002639c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:06.497552 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58358392-2bb5-4501-8193-28918002639c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:06.499001 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58358392-2bb5-4501-8193-28918002639c service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:06.508496 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 743/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:08.604603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd28fe-250f-4067-9255-2a32c447569e None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:08.605072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd28fe-250f-4067-9255-2a32c447569e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:08.605186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd28fe-250f-4067-9255-2a32c447569e None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:08.606512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 742/1485] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:36:08.611778 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce50d7d-e4df-4453-bab7-d9d65ff71886 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:08.612240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce50d7d-e4df-4453-bab7-d9d65ff71886 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:08.612431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce50d7d-e4df-4453-bab7-d9d65ff71886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:08.630198 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bce50d7d-e4df-4453-bab7-d9d65ff71886 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:08.631418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bce50d7d-e4df-4453-bab7-d9d65ff71886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:08.639058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 744/1486] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:08.678376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd28fe-250f-4067-9255-2a32c447569e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:08.689035 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd28fe-250f-4067-9255-2a32c447569e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:08.692518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2d608-51e5-4ea3-9863-a254b63c415f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:08.693144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2d608-51e5-4ea3-9863-a254b63c415f service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:08.693425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2d608-51e5-4ea3-9863-a254b63c415f service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:08.693699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2d608-51e5-4ea3-9863-a254b63c415f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:08.702341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2d608-51e5-4ea3-9863-a254b63c415f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:08.704322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2d608-51e5-4ea3-9863-a254b63c415f service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:08.713479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 743/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:10.864922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7031d-be3a-4e6a-9b93-99d3e47ae078 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:10.865399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7031d-be3a-4e6a-9b93-99d3e47ae078 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:10.865500 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7031d-be3a-4e6a-9b93-99d3e47ae078 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:10.866840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 745/1488] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:36:10.872259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f27b-193e-4397-8a02-86446e4a196d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:10.872647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f27b-193e-4397-8a02-86446e4a196d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:10.872803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f27b-193e-4397-8a02-86446e4a196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:10.890549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a544f27b-193e-4397-8a02-86446e4a196d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:10.892674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a544f27b-193e-4397-8a02-86446e4a196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:10.900496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 744/1489] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:10.940379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7031d-be3a-4e6a-9b93-99d3e47ae078 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:10.950869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7031d-be3a-4e6a-9b93-99d3e47ae078 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:10.954841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa642cb4-7516-4491-80b0-ae70ced7eb15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:10.955503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa642cb4-7516-4491-80b0-ae70ced7eb15 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:10.955786 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa642cb4-7516-4491-80b0-ae70ced7eb15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:10.956061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa642cb4-7516-4491-80b0-ae70ced7eb15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:10.964857 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa642cb4-7516-4491-80b0-ae70ced7eb15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:10.966272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa642cb4-7516-4491-80b0-ae70ced7eb15 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:10.976169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 746/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:13.230852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186428b4-f28e-4c83-bddf-16b8d2d4af1d None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:13.231386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186428b4-f28e-4c83-bddf-16b8d2d4af1d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:13.231797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186428b4-f28e-4c83-bddf-16b8d2d4af1d None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:13.234203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 745/1491] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jul 6 20:36:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:36:13.240112 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b370144-ea2c-417b-b121-aa72e9c2b956 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:13.240538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b370144-ea2c-417b-b121-aa72e9c2b956 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:13.240670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b370144-ea2c-417b-b121-aa72e9c2b956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:13.258540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2b370144-ea2c-417b-b121-aa72e9c2b956 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:36:13.259759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2b370144-ea2c-417b-b121-aa72e9c2b956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:36:13.267790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 747/1492] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jul 6 20:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:36:13.305801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186428b4-f28e-4c83-bddf-16b8d2d4af1d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:36:13.317194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186428b4-f28e-4c83-bddf-16b8d2d4af1d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:36:13.320671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851c682-0772-47c6-a74b-988293289274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:36:13.321308 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851c682-0772-47c6-a74b-988293289274 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:36:13.321590 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851c682-0772-47c6-a74b-988293289274 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:36:13.321888 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851c682-0772-47c6-a74b-988293289274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:36:13.333095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851c682-0772-47c6-a74b-988293289274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:36:13.334784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851c682-0772-47c6-a74b-988293289274 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:36:13.345893 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 746/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:36:23.253544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=33 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:36:23.340826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=33 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:41.061473 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2ac34-6e92-4e72-a4a2-c82dc1c64c93 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.062068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2ac34-6e92-4e72-a4a2-c82dc1c64c93 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.062068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2ac34-6e92-4e72-a4a2-c82dc1c64c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.080167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-72e2ac34-6e92-4e72-a4a2-c82dc1c64c93 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:41.081355 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-72e2ac34-6e92-4e72-a4a2-c82dc1c64c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:41.089995 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 748/1494] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:41.097891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a9ba-d7d9-4364-9277-bfb5a1482592 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.098381 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a9ba-d7d9-4364-9277-bfb5a1482592 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.098484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a9ba-d7d9-4364-9277-bfb5a1482592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.115969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7209a9ba-d7d9-4364-9277-bfb5a1482592 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:41.117143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7209a9ba-d7d9-4364-9277-bfb5a1482592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:41.126618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 747/1495] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:41.131019 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2ac34-6e92-4e72-a4a2-c82dc1c64c93 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:41.141786 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2ac34-6e92-4e72-a4a2-c82dc1c64c93 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:41.146264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490f217-0615-4e56-afd6-bb94851849d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:41.146923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490f217-0615-4e56-afd6-bb94851849d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.147242 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490f217-0615-4e56-afd6-bb94851849d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.147521 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490f217-0615-4e56-afd6-bb94851849d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.148245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490f217-0615-4e56-afd6-bb94851849d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:37:41.148553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490f217-0615-4e56-afd6-bb94851849d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:41.150222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-0490f217-0615-4e56-afd6-bb94851849d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:37:41.150222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 06 20:37:41.150222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: Jul 06 20:37:41.151098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490f217-0615-4e56-afd6-bb94851849d3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:41.162640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 749/1496] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:37:41.171282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a9ba-d7d9-4364-9277-bfb5a1482592 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:41.181063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a9ba-d7d9-4364-9277-bfb5a1482592 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:41.185532 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208fe8b-695c-4906-ab71-580426fa7fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:41.186171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208fe8b-695c-4906-ab71-580426fa7fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.186451 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208fe8b-695c-4906-ab71-580426fa7fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.186727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208fe8b-695c-4906-ab71-580426fa7fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.187447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208fe8b-695c-4906-ab71-580426fa7fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:41.189260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-0208fe8b-695c-4906-ab71-580426fa7fe1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:37:41.189260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: warnings.warn(msg) Jul 06 20:37:41.189260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: Jul 06 20:37:41.190443 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208fe8b-695c-4906-ab71-580426fa7fe1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:41.227577 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 748/1497] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:37:41 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:37:41.231708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490f217-0615-4e56-afd6-bb94851849d3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:41.241577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490f217-0615-4e56-afd6-bb94851849d3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:41.297180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34062316-d08c-4186-95f4-9432cd6247be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:41.297853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34062316-d08c-4186-95f4-9432cd6247be admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.298140 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34062316-d08c-4186-95f4-9432cd6247be admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.298414 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34062316-d08c-4186-95f4-9432cd6247be admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.299088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34062316-d08c-4186-95f4-9432cd6247be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:41.300130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-34062316-d08c-4186-95f4-9432cd6247be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:37:41.300130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 06 20:37:41.300130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: Jul 06 20:37:41.301372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34062316-d08c-4186-95f4-9432cd6247be admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:41.320421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 750/1498] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:37:41 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:37:41.324780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208fe8b-695c-4906-ab71-580426fa7fe1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:41.334815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208fe8b-695c-4906-ab71-580426fa7fe1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:41.339948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198ce2-56ae-495e-bad1-e31d0557c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:41.340597 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198ce2-56ae-495e-bad1-e31d0557c97b admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.340881 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198ce2-56ae-495e-bad1-e31d0557c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.341154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198ce2-56ae-495e-bad1-e31d0557c97b admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.341920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198ce2-56ae-495e-bad1-e31d0557c97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:41.342906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-d9198ce2-56ae-495e-bad1-e31d0557c97b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:37:41.342906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: warnings.warn(msg) Jul 06 20:37:41.342906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: Jul 06 20:37:41.343815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198ce2-56ae-495e-bad1-e31d0557c97b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:41.357059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 749/1499] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:37:41.360939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34062316-d08c-4186-95f4-9432cd6247be admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:41.370701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34062316-d08c-4186-95f4-9432cd6247be admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:41.375222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185322c5-f242-4576-9128-d4cdb82744ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:41.375920 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185322c5-f242-4576-9128-d4cdb82744ac admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.376207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185322c5-f242-4576-9128-d4cdb82744ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.376484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185322c5-f242-4576-9128-d4cdb82744ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.377238 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185322c5-f242-4576-9128-d4cdb82744ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:41.378251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-185322c5-f242-4576-9128-d4cdb82744ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:37:41.378251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 06 20:37:41.378251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: Jul 06 20:37:41.379120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185322c5-f242-4576-9128-d4cdb82744ac admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:41.392882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 751/1500] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:37:41.396799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198ce2-56ae-495e-bad1-e31d0557c97b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:41.407723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198ce2-56ae-495e-bad1-e31d0557c97b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:41.412281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ec3e2-a2b0-4d7e-a604-814ef341dd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:41.413209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ec3e2-a2b0-4d7e-a604-814ef341dd69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.413444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ec3e2-a2b0-4d7e-a604-814ef341dd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.413721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ec3e2-a2b0-4d7e-a604-814ef341dd69 admin admin] PATH_INFO: `/v3/projects/8d1d86b653ed4997a4a0fbf330888bdf/users/1f37c365f3044734a8553593d8545c5a/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.428933 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ec3e2-a2b0-4d7e-a604-814ef341dd69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1d86b653ed4997a4a0fbf330888bdf, user_id=1f37c365f3044734a8553593d8545c5a, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:41.429961 dv-cinder-848900-2-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-e73ec3e2-a2b0-4d7e-a604-814ef341dd69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:37:41.429961 dv-cinder-848900-2-smb devstack@keystone.service[80523]: warnings.warn(msg) Jul 06 20:37:41.429961 dv-cinder-848900-2-smb devstack@keystone.service[80523]: Jul 06 20:37:41.431956 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ec3e2-a2b0-4d7e-a604-814ef341dd69 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:41.444539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 750/1501] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:37:41 2022] PUT /identity/v3/projects/8d1d86b653ed4997a4a0fbf330888bdf/users/1f37c365f3044734a8553593d8545c5a/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:41.456635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1884b-a3c8-4fa8-a1e7-e915bb4a7f39 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.456922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1884b-a3c8-4fa8-a1e7-e915bb4a7f39 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.457197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1884b-a3c8-4fa8-a1e7-e915bb4a7f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.482837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-aac1884b-a3c8-4fa8-a1e7-e915bb4a7f39 None None] MFA Rules not processed for user `1f37c365f3044734a8553593d8545c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:41.484059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aac1884b-a3c8-4fa8-a1e7-e915bb4a7f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:41.546961 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 752/1502] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:41.560685 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64a030-00a8-45bc-8924-0065d22329e4 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.560977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64a030-00a8-45bc-8924-0065d22329e4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.561257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64a030-00a8-45bc-8924-0065d22329e4 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.562625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 751/1503] 10.222.0.33 () {54 vars in 963 bytes} [Wed Jul 6 20:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:37:41.567539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5534a97-953d-421d-8f13-2599ceb432fb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.567831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5534a97-953d-421d-8f13-2599ceb432fb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.568109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5534a97-953d-421d-8f13-2599ceb432fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.585955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f5534a97-953d-421d-8f13-2599ceb432fb None None] MFA Rules not processed for user `4693da03c42e4328b74869abd0ae4b80`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:41.587269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f5534a97-953d-421d-8f13-2599ceb432fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:41.632278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:41.641139 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 753/1504] 10.222.0.33 () {58 vars in 1060 bytes} [Wed Jul 6 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:41.649043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64a030-00a8-45bc-8924-0065d22329e4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:41.659534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64a030-00a8-45bc-8924-0065d22329e4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:41.662974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16093385-93e0-432c-987a-2fe1a29826af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:41.663686 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16093385-93e0-432c-987a-2fe1a29826af service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.663922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16093385-93e0-432c-987a-2fe1a29826af service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.664199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16093385-93e0-432c-987a-2fe1a29826af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.673006 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16093385-93e0-432c-987a-2fe1a29826af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:41.674416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16093385-93e0-432c-987a-2fe1a29826af service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:41.683666 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 752/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:37:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:37:41.725084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b48df-8a9c-460b-acf8-ddb0eba99f82 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.725360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b48df-8a9c-460b-acf8-ddb0eba99f82 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.725641 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b48df-8a9c-460b-acf8-ddb0eba99f82 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.727436 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 754/1506] 10.222.0.33 () {52 vars in 829 bytes} [Wed Jul 6 20:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:37:41.731201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16093385-93e0-432c-987a-2fe1a29826af service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:41.794801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16093385-93e0-432c-987a-2fe1a29826af service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:41.799791 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:41.801053 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.801053 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.801053 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] PATH_INFO: `/v3/users/1f37c365f3044734a8553593d8545c5a` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.802324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f37c365f3044734a8553593d8545c5a)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:41.803396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:37:41.803396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: warnings.warn(msg) Jul 06 20:37:41.803396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: Jul 06 20:37:41.804757 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:41.869973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f37c365f3044734a8553593d8545c5a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:41.870649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f37c365f3044734a8553593d8545c5a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:41.889749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f37c365f3044734a8553593d8545c5a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:41.899908 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f37c365f3044734a8553593d8545c5a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:41.909964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:41.916581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f37c365f3044734a8553593d8545c5a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:41.923506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 753/1507] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:37:41 2022] DELETE /identity/v3/users/1f37c365f3044734a8553593d8545c5a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:41.927949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeddc3a-afc0-47b1-974a-8613471067e3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:41.928266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeddc3a-afc0-47b1-974a-8613471067e3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:41.928549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeddc3a-afc0-47b1-974a-8613471067e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:41.946075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-aeeddc3a-afc0-47b1-974a-8613471067e3 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:37:41.947302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aeeddc3a-afc0-47b1-974a-8613471067e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:42.009699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 755/1508] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:37:42.020412 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:42.021820 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:42.078248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de52db3-159a-41d0-a8d5-40506258e57e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:42.081779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc216719-f6cf-450b-9f1c-4e493f528b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:42.082418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc216719-f6cf-450b-9f1c-4e493f528b3e service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:42.082700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc216719-f6cf-450b-9f1c-4e493f528b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:42.082975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc216719-f6cf-450b-9f1c-4e493f528b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:42.092273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc216719-f6cf-450b-9f1c-4e493f528b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:42.093690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc216719-f6cf-450b-9f1c-4e493f528b3e service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:42.103588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 754/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:37:42.514697 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeddc3a-afc0-47b1-974a-8613471067e3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:37:42.516174 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aeeddc3a-afc0-47b1-974a-8613471067e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:37:42.528828 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeddc3a-afc0-47b1-974a-8613471067e3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:37:42.534062 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c72c6-b732-48f0-b535-ec01f266adba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:37:42.534931 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c72c6-b732-48f0-b535-ec01f266adba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:37:42.535244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c72c6-b732-48f0-b535-ec01f266adba admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:37:42.535525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c72c6-b732-48f0-b535-ec01f266adba admin admin] PATH_INFO: `/v3/projects/8d1d86b653ed4997a4a0fbf330888bdf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:37:42.536704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c72c6-b732-48f0-b535-ec01f266adba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1d86b653ed4997a4a0fbf330888bdf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:37:42.537736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-3e7c72c6-b732-48f0-b535-ec01f266adba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:37:42.537736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 06 20:37:42.537736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: Jul 06 20:37:42.538945 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c72c6-b732-48f0-b535-ec01f266adba admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:37:42.602417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3e7c72c6-b732-48f0-b535-ec01f266adba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1d86b653ed4997a4a0fbf330888bdf', 'request_id': 'req-3e7c72c6-b732-48f0-b535-ec01f266adba'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:42.615904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3e7c72c6-b732-48f0-b535-ec01f266adba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1d86b653ed4997a4a0fbf330888bdf', 'request_id': 'req-3e7c72c6-b732-48f0-b535-ec01f266adba'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:42.626393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3e7c72c6-b732-48f0-b535-ec01f266adba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1d86b653ed4997a4a0fbf330888bdf', 'request_id': 'req-3e7c72c6-b732-48f0-b535-ec01f266adba'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:42.640108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3e7c72c6-b732-48f0-b535-ec01f266adba admin admin] The token cache is being invalidate because project 8d1d86b653ed4997a4a0fbf330888bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:37:42.640396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3e7c72c6-b732-48f0-b535-ec01f266adba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:42.641143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3e7c72c6-b732-48f0-b535-ec01f266adba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:37:42.642924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 756/1510] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:37:42 2022] DELETE /identity/v3/projects/8d1d86b653ed4997a4a0fbf330888bdf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:37:52.098858 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=29 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:37:52.636628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:39:27.995055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9237098-bea5-414f-8e35-84c247c96a59 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:27.995659 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9237098-bea5-414f-8e35-84c247c96a59 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:27.995659 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9237098-bea5-414f-8e35-84c247c96a59 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:27.998231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:39:28.002820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cc37a-d39b-40fe-8155-265f6c980f54 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:28.003295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cc37a-d39b-40fe-8155-265f6c980f54 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:28.003452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cc37a-d39b-40fe-8155-265f6c980f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:28.022642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a73cc37a-d39b-40fe-8155-265f6c980f54 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:28.023903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a73cc37a-d39b-40fe-8155-265f6c980f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:28.084028 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:28.242133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9237098-bea5-414f-8e35-84c247c96a59 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:28.243823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a9237098-bea5-414f-8e35-84c247c96a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:28.317522 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9237098-bea5-414f-8e35-84c247c96a59 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:28.322944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceff166-835f-4223-bc61-07591330ee96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:28.323639 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceff166-835f-4223-bc61-07591330ee96 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:28.323930 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceff166-835f-4223-bc61-07591330ee96 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:28.324214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceff166-835f-4223-bc61-07591330ee96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:28.333112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceff166-835f-4223-bc61-07591330ee96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:28.334720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceff166-835f-4223-bc61-07591330ee96 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:28.345023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 756/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:39:29.166265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4da23-c6cb-481b-99ac-7e92e6b57c98 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:29.166819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4da23-c6cb-481b-99ac-7e92e6b57c98 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:29.166819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4da23-c6cb-481b-99ac-7e92e6b57c98 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:29.168235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:39:29.173250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1342b-e7bf-4a9b-b83e-e63ea3152ac9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:29.173654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1342b-e7bf-4a9b-b83e-e63ea3152ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:29.173803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1342b-e7bf-4a9b-b83e-e63ea3152ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:29.192148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d5c1342b-e7bf-4a9b-b83e-e63ea3152ac9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:29.193357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d5c1342b-e7bf-4a9b-b83e-e63ea3152ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:29.201127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:39:29.355292 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4da23-c6cb-481b-99ac-7e92e6b57c98 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:29.369544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4da23-c6cb-481b-99ac-7e92e6b57c98 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:29.375564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369079a6-dc32-4ab2-9903-bccba6bc5a63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:29.376180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369079a6-dc32-4ab2-9903-bccba6bc5a63 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:29.376460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369079a6-dc32-4ab2-9903-bccba6bc5a63 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:29.376731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369079a6-dc32-4ab2-9903-bccba6bc5a63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:29.384776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369079a6-dc32-4ab2-9903-bccba6bc5a63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:29.386346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369079a6-dc32-4ab2-9903-bccba6bc5a63 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:29.396493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 759/1516] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:39:29.532554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6675a68-5256-4179-ab5a-1880db121c79 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:29.532836 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6675a68-5256-4179-ab5a-1880db121c79 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:29.533139 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6675a68-5256-4179-ab5a-1880db121c79 None None] PATH_INFO: `/v3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:29.534467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 758/1517] 10.222.0.15 () {54 vars in 925 bytes} [Wed Jul 6 20:39:29 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:39:29.541485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961173-32dd-41e7-9579-b7d76bbebc7a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:29.541776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961173-32dd-41e7-9579-b7d76bbebc7a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:29.542056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961173-32dd-41e7-9579-b7d76bbebc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:29.559886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-03961173-32dd-41e7-9579-b7d76bbebc7a None None] MFA Rules not processed for user `b98059ebef5d470db684fb78d19a8839`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:29.561096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-03961173-32dd-41e7-9579-b7d76bbebc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:29.623607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 760/1518] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Jul 6 20:39:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:38.228010 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea103c3-e9fc-4fe8-9076-e28ae8f7554c None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:38.228563 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea103c3-e9fc-4fe8-9076-e28ae8f7554c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:38.228563 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea103c3-e9fc-4fe8-9076-e28ae8f7554c None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:38.229967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 759/1519] 10.222.0.33 () {54 vars in 960 bytes} [Wed Jul 6 20:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:39:38.234913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1db401-8d6d-496b-b332-c27c6e5c016a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:38.235438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1db401-8d6d-496b-b332-c27c6e5c016a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:38.235541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1db401-8d6d-496b-b332-c27c6e5c016a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:38.253449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6c1db401-8d6d-496b-b332-c27c6e5c016a None None] MFA Rules not processed for user `b98059ebef5d470db684fb78d19a8839`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:38.254625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6c1db401-8d6d-496b-b332-c27c6e5c016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:38.263036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 761/1520] 10.222.0.33 () {58 vars in 1057 bytes} [Wed Jul 6 20:39:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:38.271684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea103c3-e9fc-4fe8-9076-e28ae8f7554c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:38.285124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea103c3-e9fc-4fe8-9076-e28ae8f7554c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:38.289984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f386e3c-60b3-4474-b83e-beb2cbddfb94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98059ebef5d470db684fb78d19a8839', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:38.290613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f386e3c-60b3-4474-b83e-beb2cbddfb94 service placement] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:38.290898 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f386e3c-60b3-4474-b83e-beb2cbddfb94 service placement] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:38.291192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f386e3c-60b3-4474-b83e-beb2cbddfb94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:38.299480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f386e3c-60b3-4474-b83e-beb2cbddfb94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:38.301055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f386e3c-60b3-4474-b83e-beb2cbddfb94 service placement] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:38.310662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 760/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:39:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:39:40.643132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327d587-cc32-4361-a50e-18a358f279ab None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:40.643721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327d587-cc32-4361-a50e-18a358f279ab None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:40.643905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327d587-cc32-4361-a50e-18a358f279ab None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:40.646534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:39:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:39:40.651851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750593d-7bb5-4038-813f-a05556768c2c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:40.652314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750593d-7bb5-4038-813f-a05556768c2c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:40.652442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750593d-7bb5-4038-813f-a05556768c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:40.672736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f750593d-7bb5-4038-813f-a05556768c2c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:40.673936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f750593d-7bb5-4038-813f-a05556768c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:40.682814 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:40.862723 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327d587-cc32-4361-a50e-18a358f279ab None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:40.885203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327d587-cc32-4361-a50e-18a358f279ab None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:40.891005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13994e17-e37d-405a-9d0b-97b9d6ed53cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:40.891973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994e17-e37d-405a-9d0b-97b9d6ed53cc service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:40.892263 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994e17-e37d-405a-9d0b-97b9d6ed53cc service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:40.892568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994e17-e37d-405a-9d0b-97b9d6ed53cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:40.901596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13994e17-e37d-405a-9d0b-97b9d6ed53cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:40.903242 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13994e17-e37d-405a-9d0b-97b9d6ed53cc service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:40.914523 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 763/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:39:41.767395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d693918-851a-4896-9b83-fb7dfb646173 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:41.767924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d693918-851a-4896-9b83-fb7dfb646173 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:41.767924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d693918-851a-4896-9b83-fb7dfb646173 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:41.769486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 20:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:39:41.774357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcea78b-8a90-44b1-9e62-37b1044608e0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:41.774761 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcea78b-8a90-44b1-9e62-37b1044608e0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:41.774916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcea78b-8a90-44b1-9e62-37b1044608e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:41.793176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5dcea78b-8a90-44b1-9e62-37b1044608e0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:41.794403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5dcea78b-8a90-44b1-9e62-37b1044608e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:41.802285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 20:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:41.952993 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d693918-851a-4896-9b83-fb7dfb646173 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:41.967577 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d693918-851a-4896-9b83-fb7dfb646173 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:41.972796 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7190689-33d5-4e91-b910-a4845d7977df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:41.973422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7190689-33d5-4e91-b910-a4845d7977df service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:41.973702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7190689-33d5-4e91-b910-a4845d7977df service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:41.973974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7190689-33d5-4e91-b910-a4845d7977df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:41.981889 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7190689-33d5-4e91-b910-a4845d7977df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:41.983485 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7190689-33d5-4e91-b910-a4845d7977df service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:41.992833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 763/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:39:46.044260 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741091-82db-4f92-a393-844f1430f9c8 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:46.044797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741091-82db-4f92-a393-844f1430f9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:46.044797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741091-82db-4f92-a393-844f1430f9c8 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:46.046175 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:39:46.052084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d101e-3ef2-439b-a126-1d6c94b3fb0e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:46.052522 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d101e-3ef2-439b-a126-1d6c94b3fb0e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:46.052629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d101e-3ef2-439b-a126-1d6c94b3fb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:46.070937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8c2d101e-3ef2-439b-a126-1d6c94b3fb0e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:46.072163 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8c2d101e-3ef2-439b-a126-1d6c94b3fb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:46.080421 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:46.153313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28741091-82db-4f92-a393-844f1430f9c8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:46.155039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-28741091-82db-4f92-a393-844f1430f9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:46.214628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28741091-82db-4f92-a393-844f1430f9c8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:46.218138 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0a751-f4c9-4a27-bb83-667834d7e7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:46.218799 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a751-f4c9-4a27-bb83-667834d7e7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:46.219731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a751-f4c9-4a27-bb83-667834d7e7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:46.220182 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a751-f4c9-4a27-bb83-667834d7e7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:46.228879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0a751-f4c9-4a27-bb83-667834d7e7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:46.230297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0a751-f4c9-4a27-bb83-667834d7e7a1 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:46.235352 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:39:46.240210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 766/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:39:48.276908 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a43b0e-05fd-424d-bb27-4fee7c1ec07c None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:48.277492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a43b0e-05fd-424d-bb27-4fee7c1ec07c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:48.277492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a43b0e-05fd-424d-bb27-4fee7c1ec07c None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:48.278830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:39:48.284055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda30cc6-2c1a-401f-b0fe-5197f805c2ae None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:48.284495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda30cc6-2c1a-401f-b0fe-5197f805c2ae None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:48.284600 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda30cc6-2c1a-401f-b0fe-5197f805c2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:48.302551 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-cda30cc6-2c1a-401f-b0fe-5197f805c2ae None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:48.303829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cda30cc6-2c1a-401f-b0fe-5197f805c2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:48.311635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:48.347023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a43b0e-05fd-424d-bb27-4fee7c1ec07c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:48.357771 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a43b0e-05fd-424d-bb27-4fee7c1ec07c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:48.361889 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f3110-77e4-47bb-bceb-4ca00ddee245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:48.362521 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f3110-77e4-47bb-bceb-4ca00ddee245 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:48.362834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f3110-77e4-47bb-bceb-4ca00ddee245 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:48.363111 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f3110-77e4-47bb-bceb-4ca00ddee245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:48.372008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f3110-77e4-47bb-bceb-4ca00ddee245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:48.373425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f3110-77e4-47bb-bceb-4ca00ddee245 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:48.383552 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 766/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:39:51.898325 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44b52d-bf1c-4538-93f0-cd5be1db7593 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:51.898836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44b52d-bf1c-4538-93f0-cd5be1db7593 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:51.898836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44b52d-bf1c-4538-93f0-cd5be1db7593 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:51.900249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:39:51.905520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1590f-1b10-4207-816e-0ddf9aebdc0e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:51.905962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1590f-1b10-4207-816e-0ddf9aebdc0e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:51.906072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1590f-1b10-4207-816e-0ddf9aebdc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:51.923676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-15b1590f-1b10-4207-816e-0ddf9aebdc0e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:51.924889 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-15b1590f-1b10-4207-816e-0ddf9aebdc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:51.932601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:52.238408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44b52d-bf1c-4538-93f0-cd5be1db7593 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:52.240088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-af44b52d-bf1c-4538-93f0-cd5be1db7593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:52.296582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44b52d-bf1c-4538-93f0-cd5be1db7593 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:52.300886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80650856-19da-4c51-8257-b503ff2de0ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:52.301536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80650856-19da-4c51-8257-b503ff2de0ca service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:52.301820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80650856-19da-4c51-8257-b503ff2de0ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:52.302097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80650856-19da-4c51-8257-b503ff2de0ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:52.310780 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80650856-19da-4c51-8257-b503ff2de0ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:52.312247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80650856-19da-4c51-8257-b503ff2de0ca service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:52.322391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 769/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:39:54.366549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e495e30-64f2-44c4-a183-e2b43e18be67 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:54.367109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e495e30-64f2-44c4-a183-e2b43e18be67 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:54.367109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e495e30-64f2-44c4-a183-e2b43e18be67 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:54.368612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 20:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:39:54.373729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b70ec7-4214-43e0-8f6c-507d1973e679 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:54.374171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b70ec7-4214-43e0-8f6c-507d1973e679 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:54.374278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b70ec7-4214-43e0-8f6c-507d1973e679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:54.392525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c4b70ec7-4214-43e0-8f6c-507d1973e679 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:39:54.393712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c4b70ec7-4214-43e0-8f6c-507d1973e679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:54.401663 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 20:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:39:54.716261 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e495e30-64f2-44c4-a183-e2b43e18be67 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:39:54.717937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8e495e30-64f2-44c4-a183-e2b43e18be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:39:54.726585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=65 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:39:54.732731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e495e30-64f2-44c4-a183-e2b43e18be67 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:39:54.736898 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee289409-7fc4-49a6-afda-553bbe8b464d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:39:54.737534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee289409-7fc4-49a6-afda-553bbe8b464d service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:39:54.737822 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee289409-7fc4-49a6-afda-553bbe8b464d service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:39:54.738103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee289409-7fc4-49a6-afda-553bbe8b464d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:39:54.746997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee289409-7fc4-49a6-afda-553bbe8b464d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:39:54.748443 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee289409-7fc4-49a6-afda-553bbe8b464d service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:39:54.758919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 769/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:40:04.387285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=32 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:40:04.754795 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:26.338360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201dd3f-d973-4927-a1ee-4640274de3ba None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.339026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201dd3f-d973-4927-a1ee-4640274de3ba None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.339026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201dd3f-d973-4927-a1ee-4640274de3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.359368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2201dd3f-d973-4927-a1ee-4640274de3ba None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:26.360729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2201dd3f-d973-4927-a1ee-4640274de3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:26.374596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 771/1540] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:26.384463 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea358-be64-4e90-a8a8-ce6b9c520581 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.385046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea358-be64-4e90-a8a8-ce6b9c520581 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.385046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea358-be64-4e90-a8a8-ce6b9c520581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.412085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ee0ea358-be64-4e90-a8a8-ce6b9c520581 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:26.413328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ee0ea358-be64-4e90-a8a8-ce6b9c520581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:26.425403 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 770/1541] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:26.430284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201dd3f-d973-4927-a1ee-4640274de3ba None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:26.441824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201dd3f-d973-4927-a1ee-4640274de3ba None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:26.452027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bfc9a-c52d-4c41-99c9-23226585cba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:26.452894 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bfc9a-c52d-4c41-99c9-23226585cba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.453184 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bfc9a-c52d-4c41-99c9-23226585cba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.453469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bfc9a-c52d-4c41-99c9-23226585cba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.454209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bfc9a-c52d-4c41-99c9-23226585cba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:26.454730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bfc9a-c52d-4c41-99c9-23226585cba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:26.457076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bfc9a-c52d-4c41-99c9-23226585cba5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:26.475104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 772/1542] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:26.483441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea358-be64-4e90-a8a8-ce6b9c520581 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:26.496608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea358-be64-4e90-a8a8-ce6b9c520581 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:26.506075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bfed8-c63d-47c6-9993-dfc2499393ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:26.506758 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bfed8-c63d-47c6-9993-dfc2499393ea admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.507074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bfed8-c63d-47c6-9993-dfc2499393ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.507349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bfed8-c63d-47c6-9993-dfc2499393ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.508063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bfed8-c63d-47c6-9993-dfc2499393ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:26.510045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bfed8-c63d-47c6-9993-dfc2499393ea admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:26.558541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026b07c-30a2-4291-bd38-e96e34bcfd5f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.558901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026b07c-30a2-4291-bd38-e96e34bcfd5f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.559213 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026b07c-30a2-4291-bd38-e96e34bcfd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.574312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 771/1543] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:26 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:26.580179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bfed8-c63d-47c6-9993-dfc2499393ea admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:26.599376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3026b07c-30a2-4291-bd38-e96e34bcfd5f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:26.600692 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3026b07c-30a2-4291-bd38-e96e34bcfd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:26.758759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 773/1544] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:41:26.761368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bfed8-c63d-47c6-9993-dfc2499393ea admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:26.780422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eda7bd-693d-4085-b042-72af20f96877 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.781106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eda7bd-693d-4085-b042-72af20f96877 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.781605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eda7bd-693d-4085-b042-72af20f96877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.787192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55f885-0f66-47ed-a3b8-6c11bb2d411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:26.787378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f885-0f66-47ed-a3b8-6c11bb2d411a admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.787651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f885-0f66-47ed-a3b8-6c11bb2d411a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.787938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f885-0f66-47ed-a3b8-6c11bb2d411a admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.788674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55f885-0f66-47ed-a3b8-6c11bb2d411a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:26.789662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-0e55f885-0f66-47ed-a3b8-6c11bb2d411a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:41:26.789662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: warnings.warn(msg) Jul 06 20:41:26.789662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: Jul 06 20:41:26.790894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55f885-0f66-47ed-a3b8-6c11bb2d411a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:26.823623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a4eda7bd-693d-4085-b042-72af20f96877 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:26.825016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a4eda7bd-693d-4085-b042-72af20f96877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:26.834244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 772/1545] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:26 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:26.836224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a9369-b64e-4b3e-939c-ca1ee85dce36 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.836806 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a9369-b64e-4b3e-939c-ca1ee85dce36 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.837261 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a9369-b64e-4b3e-939c-ca1ee85dce36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.840757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 774/1546] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:26.842158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c065a91-f0c2-4de2-a357-06b4d7f7c8cd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.842550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c065a91-f0c2-4de2-a357-06b4d7f7c8cd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.842931 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c065a91-f0c2-4de2-a357-06b4d7f7c8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.881562 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b61a9369-b64e-4b3e-939c-ca1ee85dce36 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:26.883156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b61a9369-b64e-4b3e-939c-ca1ee85dce36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:26.884026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1c065a91-f0c2-4de2-a357-06b4d7f7c8cd None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:26.885383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1c065a91-f0c2-4de2-a357-06b4d7f7c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:26.893892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 773/1547] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:26.899197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a9369-b64e-4b3e-939c-ca1ee85dce36 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:26.899694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 775/1548] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:26.900984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c065a91-f0c2-4de2-a357-06b4d7f7c8cd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:26.916098 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a9369-b64e-4b3e-939c-ca1ee85dce36 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:26.919732 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c065a91-f0c2-4de2-a357-06b4d7f7c8cd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:26.921808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2df5b0-4e9f-4ba3-a299-364b1719126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:26.922723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2df5b0-4e9f-4ba3-a299-364b1719126b admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.923020 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2df5b0-4e9f-4ba3-a299-364b1719126b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.923410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2df5b0-4e9f-4ba3-a299-364b1719126b admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.924823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2df5b0-4e9f-4ba3-a299-364b1719126b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:26.926863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2df5b0-4e9f-4ba3-a299-364b1719126b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:26.927101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2fcaf-078f-4744-a35c-6119479471d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:26.928151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2fcaf-078f-4744-a35c-6119479471d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.928664 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2fcaf-078f-4744-a35c-6119479471d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.929269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2fcaf-078f-4744-a35c-6119479471d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.930269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2fcaf-078f-4744-a35c-6119479471d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:26.930818 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2fcaf-078f-4744-a35c-6119479471d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:26.932763 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2fcaf-078f-4744-a35c-6119479471d9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:26.939277 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 774/1549] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:26.942188 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c8f6-02d9-4037-b238-b2f2a1ce403c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.942617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c8f6-02d9-4037-b238-b2f2a1ce403c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.942903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c8f6-02d9-4037-b238-b2f2a1ce403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.948023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 776/1550] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:26.949715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12168bb-b8b2-4b80-bda7-62a0f2cd94d4 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.950272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12168bb-b8b2-4b80-bda7-62a0f2cd94d4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.950859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12168bb-b8b2-4b80-bda7-62a0f2cd94d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.968286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-dd70c8f6-02d9-4037-b238-b2f2a1ce403c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:26.969506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-dd70c8f6-02d9-4037-b238-b2f2a1ce403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:26.971592 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b12168bb-b8b2-4b80-bda7-62a0f2cd94d4 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:26.973293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b12168bb-b8b2-4b80-bda7-62a0f2cd94d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:26.979826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 775/1551] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:26.981429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d7c5f-cbab-43b9-ba7e-8333ce21160b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.982146 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d7c5f-cbab-43b9-ba7e-8333ce21160b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.982430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d7c5f-cbab-43b9-ba7e-8333ce21160b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:26.983467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 777/1552] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:26.985151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da3694-d8eb-44b0-ba94-c6963402f04b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:26.985680 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da3694-d8eb-44b0-ba94-c6963402f04b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:26.986251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da3694-d8eb-44b0-ba94-c6963402f04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.008188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-30da3694-d8eb-44b0-ba94-c6963402f04b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:27.009774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-30da3694-d8eb-44b0-ba94-c6963402f04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:27.016310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-297d7c5f-cbab-43b9-ba7e-8333ce21160b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:27.017621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-297d7c5f-cbab-43b9-ba7e-8333ce21160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:27.022810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 778/1553] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:27.024161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da3694-d8eb-44b0-ba94-c6963402f04b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.030806 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 776/1554] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:27.031631 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d7c5f-cbab-43b9-ba7e-8333ce21160b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.037667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da3694-d8eb-44b0-ba94-c6963402f04b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.044012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525b728-4086-4a8c-a64c-e7da49231e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.044703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525b728-4086-4a8c-a64c-e7da49231e6e admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.044983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525b728-4086-4a8c-a64c-e7da49231e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.045269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525b728-4086-4a8c-a64c-e7da49231e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.045525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d7c5f-cbab-43b9-ba7e-8333ce21160b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.045999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525b728-4086-4a8c-a64c-e7da49231e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.047779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525b728-4086-4a8c-a64c-e7da49231e6e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.050341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4f359-52a1-4c95-bb1d-15f30dbb4b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.051026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4f359-52a1-4c95-bb1d-15f30dbb4b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.051485 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4f359-52a1-4c95-bb1d-15f30dbb4b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.051765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4f359-52a1-4c95-bb1d-15f30dbb4b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.052489 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4f359-52a1-4c95-bb1d-15f30dbb4b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.054554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4f359-52a1-4c95-bb1d-15f30dbb4b9d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.062204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 779/1555] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:27.062204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039e228-c464-469a-990d-89cbf7fdb2c8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.062204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039e228-c464-469a-990d-89cbf7fdb2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.062204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039e228-c464-469a-990d-89cbf7fdb2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.083784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 777/1556] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:27.085068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75757fe3-cb55-4f49-8202-63ee6ddc4563 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.085359 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75757fe3-cb55-4f49-8202-63ee6ddc4563 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.085637 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75757fe3-cb55-4f49-8202-63ee6ddc4563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.087959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1039e228-c464-469a-990d-89cbf7fdb2c8 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:27.089323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1039e228-c464-469a-990d-89cbf7fdb2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:27.104765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-75757fe3-cb55-4f49-8202-63ee6ddc4563 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:27.105992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-75757fe3-cb55-4f49-8202-63ee6ddc4563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:27.166303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 780/1557] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:27.167218 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039e228-c464-469a-990d-89cbf7fdb2c8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.170218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 778/1558] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:27.170926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75757fe3-cb55-4f49-8202-63ee6ddc4563 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.176639 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039e228-c464-469a-990d-89cbf7fdb2c8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.181144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d90e80-d6b6-4476-b47a-368027014c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.181796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d90e80-d6b6-4476-b47a-368027014c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.182084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d90e80-d6b6-4476-b47a-368027014c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.182362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d90e80-d6b6-4476-b47a-368027014c8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.182689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75757fe3-cb55-4f49-8202-63ee6ddc4563 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.183087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d90e80-d6b6-4476-b47a-368027014c8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:27.183527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d90e80-d6b6-4476-b47a-368027014c8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.185086 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d90e80-d6b6-4476-b47a-368027014c8a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.187673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1582cb-1988-4eca-a716-99521c4da758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.188032 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1582cb-1988-4eca-a716-99521c4da758 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.188318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1582cb-1988-4eca-a716-99521c4da758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.188748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1582cb-1988-4eca-a716-99521c4da758 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.189466 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1582cb-1988-4eca-a716-99521c4da758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:27.190668 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1582cb-1988-4eca-a716-99521c4da758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.191564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-5b1582cb-1988-4eca-a716-99521c4da758 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:41:27.191564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: warnings.warn(msg) Jul 06 20:41:27.191564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: Jul 06 20:41:27.192443 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1582cb-1988-4eca-a716-99521c4da758 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.195136 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:27.197416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 781/1559] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:27.198735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493dad-4061-40c6-8f23-7d1fe8d7e4e9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.199097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493dad-4061-40c6-8f23-7d1fe8d7e4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.199494 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493dad-4061-40c6-8f23-7d1fe8d7e4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.212050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 779/1560] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:27.212050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1582cb-1988-4eca-a716-99521c4da758 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.222937 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-63493dad-4061-40c6-8f23-7d1fe8d7e4e9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:27.223095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1582cb-1988-4eca-a716-99521c4da758 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.224187 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-63493dad-4061-40c6-8f23-7d1fe8d7e4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:27.227730 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9579e-1095-4f63-8373-40b4d2ba9b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.228616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9579e-1095-4f63-8373-40b4d2ba9b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.228902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9579e-1095-4f63-8373-40b4d2ba9b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.229179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9579e-1095-4f63-8373-40b4d2ba9b37 admin admin] PATH_INFO: `/v3/projects/972f49dc40404f239e6d6d941c411354/users/5330fbd804c44634b682d0a865dd8b13/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.232052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 782/1561] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:27.233265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7912d0-ee68-4a5d-8087-5241f18a51a7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.233555 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7912d0-ee68-4a5d-8087-5241f18a51a7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.233833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7912d0-ee68-4a5d-8087-5241f18a51a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.247102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9579e-1095-4f63-8373-40b4d2ba9b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972f49dc40404f239e6d6d941c411354, user_id=5330fbd804c44634b682d0a865dd8b13, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.249916 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9579e-1095-4f63-8373-40b4d2ba9b37 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.251089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8d7912d0-ee68-4a5d-8087-5241f18a51a7 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:27.252869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8d7912d0-ee68-4a5d-8087-5241f18a51a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:27.261587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 783/1562] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:27.264037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7912d0-ee68-4a5d-8087-5241f18a51a7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.266987 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 780/1563] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:27 2022] PUT /identity/v3/projects/972f49dc40404f239e6d6d941c411354/users/5330fbd804c44634b682d0a865dd8b13/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:27.270922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:27.272313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9579e-1095-4f63-8373-40b4d2ba9b37 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.275399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7912d0-ee68-4a5d-8087-5241f18a51a7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.332522 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d8c6f-3fca-44df-84f4-b236078b4eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.333224 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d8c6f-3fca-44df-84f4-b236078b4eff admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.333525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d8c6f-3fca-44df-84f4-b236078b4eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.333790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d8c6f-3fca-44df-84f4-b236078b4eff admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.334470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d8c6f-3fca-44df-84f4-b236078b4eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.334969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9579e-1095-4f63-8373-40b4d2ba9b37 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.336449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d8c6f-3fca-44df-84f4-b236078b4eff admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.339679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1203dc-7628-43c4-80ef-c1b0514a57fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.340333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1203dc-7628-43c4-80ef-c1b0514a57fa admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.340620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1203dc-7628-43c4-80ef-c1b0514a57fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.340901 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1203dc-7628-43c4-80ef-c1b0514a57fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.341626 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1203dc-7628-43c4-80ef-c1b0514a57fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:27.341938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1203dc-7628-43c4-80ef-c1b0514a57fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.343551 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1203dc-7628-43c4-80ef-c1b0514a57fa admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.357004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 781/1564] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:27.357897 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1203dc-7628-43c4-80ef-c1b0514a57fa admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.358286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 784/1565] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:27.359156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d8c6f-3fca-44df-84f4-b236078b4eff admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.369558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d8c6f-3fca-44df-84f4-b236078b4eff admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.374257 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03b683-b006-4dd1-ad6c-784bcea87a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.374966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03b683-b006-4dd1-ad6c-784bcea87a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.375366 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03b683-b006-4dd1-ad6c-784bcea87a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.375536 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1203dc-7628-43c4-80ef-c1b0514a57fa admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.375787 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03b683-b006-4dd1-ad6c-784bcea87a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.376532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03b683-b006-4dd1-ad6c-784bcea87a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.377776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-1b03b683-b006-4dd1-ad6c-784bcea87a4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:41:27.377776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 06 20:41:27.377776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: Jul 06 20:41:27.379099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03b683-b006-4dd1-ad6c-784bcea87a4a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.380504 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16c8f4-2360-4cc1-acda-d76eac9abb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.381152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16c8f4-2360-4cc1-acda-d76eac9abb1b admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.381435 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16c8f4-2360-4cc1-acda-d76eac9abb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.381711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16c8f4-2360-4cc1-acda-d76eac9abb1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.382425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16c8f4-2360-4cc1-acda-d76eac9abb1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:27.382729 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16c8f4-2360-4cc1-acda-d76eac9abb1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.384328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16c8f4-2360-4cc1-acda-d76eac9abb1b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.397758 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 782/1566] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:27.399389 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16c8f4-2360-4cc1-acda-d76eac9abb1b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.407247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 785/1567] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:27.408643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1170f-0559-4333-b340-99e3572bee9b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.408937 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1170f-0559-4333-b340-99e3572bee9b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.409219 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1170f-0559-4333-b340-99e3572bee9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.412841 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16c8f4-2360-4cc1-acda-d76eac9abb1b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.427524 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-34e1170f-0559-4333-b340-99e3572bee9b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:27.428734 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-34e1170f-0559-4333-b340-99e3572bee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:27.468509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11548a-51db-44eb-8e1c-47127c199836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.469176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11548a-51db-44eb-8e1c-47127c199836 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.469460 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11548a-51db-44eb-8e1c-47127c199836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.469738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11548a-51db-44eb-8e1c-47127c199836 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.470420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11548a-51db-44eb-8e1c-47127c199836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.472582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11548a-51db-44eb-8e1c-47127c199836 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.488274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 786/1568] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:27.489849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589d05a-d192-4d7b-b156-a94d406baf1b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.490209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589d05a-d192-4d7b-b156-a94d406baf1b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.490553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589d05a-d192-4d7b-b156-a94d406baf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.506636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 783/1569] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:27.506636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b2ce-7b4f-4e06-bd38-4ec3ecaaedbd None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.506636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b2ce-7b4f-4e06-bd38-4ec3ecaaedbd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.506636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b2ce-7b4f-4e06-bd38-4ec3ecaaedbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.509113 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a589d05a-d192-4d7b-b156-a94d406baf1b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:27.510377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a589d05a-d192-4d7b-b156-a94d406baf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:27.522490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3e41b2ce-7b4f-4e06-bd38-4ec3ecaaedbd None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:27.523709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3e41b2ce-7b4f-4e06-bd38-4ec3ecaaedbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:27.556644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:27.571454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 787/1570] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:27.572530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589d05a-d192-4d7b-b156-a94d406baf1b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.582369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589d05a-d192-4d7b-b156-a94d406baf1b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.587161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9e8d5-f67e-440c-80ce-1906f6a4afba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.587863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9e8d5-f67e-440c-80ce-1906f6a4afba admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.588151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9e8d5-f67e-440c-80ce-1906f6a4afba admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.588520 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9e8d5-f67e-440c-80ce-1906f6a4afba admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.588721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 784/1571] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:27.589321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9e8d5-f67e-440c-80ce-1906f6a4afba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.589544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41b2ce-7b4f-4e06-bd38-4ec3ecaaedbd None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.590951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9e8d5-f67e-440c-80ce-1906f6a4afba admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.600430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41b2ce-7b4f-4e06-bd38-4ec3ecaaedbd None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.602183 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 788/1572] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:27.602998 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9e8d5-f67e-440c-80ce-1906f6a4afba admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.605782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d87061-3890-417d-8ff6-fd2252504abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.606448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d87061-3890-417d-8ff6-fd2252504abb admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.606733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d87061-3890-417d-8ff6-fd2252504abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.607059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d87061-3890-417d-8ff6-fd2252504abb admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.607732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d87061-3890-417d-8ff6-fd2252504abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.607990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:27.609645 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d87061-3890-417d-8ff6-fd2252504abb admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.613658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9e8d5-f67e-440c-80ce-1906f6a4afba admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.619273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa246ed-154f-4d96-9014-fafb3f5b07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.620016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa246ed-154f-4d96-9014-fafb3f5b07e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.620375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa246ed-154f-4d96-9014-fafb3f5b07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.620662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa246ed-154f-4d96-9014-fafb3f5b07e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.621333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa246ed-154f-4d96-9014-fafb3f5b07e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.623281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa246ed-154f-4d96-9014-fafb3f5b07e9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.638408 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 785/1573] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:27.640452 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d87061-3890-417d-8ff6-fd2252504abb admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.655560 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 789/1574] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:27.656562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa246ed-154f-4d96-9014-fafb3f5b07e9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.704313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d87061-3890-417d-8ff6-fd2252504abb admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.719194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa246ed-154f-4d96-9014-fafb3f5b07e9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.724433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aebfe3-0a78-4b42-80c1-dbc386f7fdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.725095 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aebfe3-0a78-4b42-80c1-dbc386f7fdfc admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.725378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aebfe3-0a78-4b42-80c1-dbc386f7fdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.725655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aebfe3-0a78-4b42-80c1-dbc386f7fdfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.726373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aebfe3-0a78-4b42-80c1-dbc386f7fdfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:27.726680 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aebfe3-0a78-4b42-80c1-dbc386f7fdfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.728327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aebfe3-0a78-4b42-80c1-dbc386f7fdfc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.741279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 790/1575] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:27.742304 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aebfe3-0a78-4b42-80c1-dbc386f7fdfc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.753304 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aebfe3-0a78-4b42-80c1-dbc386f7fdfc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.758139 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3f836-cedb-445f-8594-3709c769cc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.758794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3f836-cedb-445f-8594-3709c769cc7a admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.759078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3f836-cedb-445f-8594-3709c769cc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.759388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3f836-cedb-445f-8594-3709c769cc7a admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.760066 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3f836-cedb-445f-8594-3709c769cc7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.761643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f6bae-9a66-4797-a706-d14187380d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.761960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3f836-cedb-445f-8594-3709c769cc7a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.762320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f6bae-9a66-4797-a706-d14187380d61 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.762608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f6bae-9a66-4797-a706-d14187380d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.762889 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f6bae-9a66-4797-a706-d14187380d61 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.763610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f6bae-9a66-4797-a706-d14187380d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.765564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f6bae-9a66-4797-a706-d14187380d61 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.782607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 791/1576] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:27.783937 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3f836-cedb-445f-8594-3709c769cc7a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.789925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 786/1577] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:27.790739 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f6bae-9a66-4797-a706-d14187380d61 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.796182 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3f836-cedb-445f-8594-3709c769cc7a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.800501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f6bae-9a66-4797-a706-d14187380d61 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.801002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3433fc2-1b5b-454b-948b-c8e114d4d0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.801649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433fc2-1b5b-454b-948b-c8e114d4d0ce admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.801936 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433fc2-1b5b-454b-948b-c8e114d4d0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.802208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433fc2-1b5b-454b-948b-c8e114d4d0ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.802923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3433fc2-1b5b-454b-948b-c8e114d4d0ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:27.803260 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3433fc2-1b5b-454b-948b-c8e114d4d0ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.804862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3433fc2-1b5b-454b-948b-c8e114d4d0ce admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.805730 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96833c-2b04-43b0-9288-80a945f3ec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.806383 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96833c-2b04-43b0-9288-80a945f3ec62 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.806781 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96833c-2b04-43b0-9288-80a945f3ec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.807524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96833c-2b04-43b0-9288-80a945f3ec62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.807835 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96833c-2b04-43b0-9288-80a945f3ec62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.809422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96833c-2b04-43b0-9288-80a945f3ec62 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.817328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 792/1578] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:27.818091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3433fc2-1b5b-454b-948b-c8e114d4d0ce admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.822375 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 787/1579] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:27.823361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96833c-2b04-43b0-9288-80a945f3ec62 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.833096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96833c-2b04-43b0-9288-80a945f3ec62 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.837560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d18d3d-d70f-429d-b12c-431eafd432f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.838385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d18d3d-d70f-429d-b12c-431eafd432f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.838668 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d18d3d-d70f-429d-b12c-431eafd432f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.838944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d18d3d-d70f-429d-b12c-431eafd432f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.839850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d18d3d-d70f-429d-b12c-431eafd432f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.841738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d18d3d-d70f-429d-b12c-431eafd432f3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.865608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 788/1580] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:27.865608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d18d3d-d70f-429d-b12c-431eafd432f3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.873207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d18d3d-d70f-429d-b12c-431eafd432f3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.878338 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aec4d-d79d-4bc2-8da1-a6a8df3d42b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.878979 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aec4d-d79d-4bc2-8da1-a6a8df3d42b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.879295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aec4d-d79d-4bc2-8da1-a6a8df3d42b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.879578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aec4d-d79d-4bc2-8da1-a6a8df3d42b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.880252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3433fc2-1b5b-454b-948b-c8e114d4d0ce admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.880369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aec4d-d79d-4bc2-8da1-a6a8df3d42b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.882177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aec4d-d79d-4bc2-8da1-a6a8df3d42b0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.883882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928e7be-7421-462a-9fcc-10e773ee1dfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.884526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928e7be-7421-462a-9fcc-10e773ee1dfc service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.884811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928e7be-7421-462a-9fcc-10e773ee1dfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.885088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928e7be-7421-462a-9fcc-10e773ee1dfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.896354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928e7be-7421-462a-9fcc-10e773ee1dfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.898275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928e7be-7421-462a-9fcc-10e773ee1dfc service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.903549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 789/1581] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:27.904591 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aec4d-d79d-4bc2-8da1-a6a8df3d42b0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.909348 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 793/1582] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:27.910171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928e7be-7421-462a-9fcc-10e773ee1dfc service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.915564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aec4d-d79d-4bc2-8da1-a6a8df3d42b0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.919536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928e7be-7421-462a-9fcc-10e773ee1dfc service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.920327 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751100c-4afb-4ad8-aa93-cc351d1c8e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.920979 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751100c-4afb-4ad8-aa93-cc351d1c8e96 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.921262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751100c-4afb-4ad8-aa93-cc351d1c8e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.921567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751100c-4afb-4ad8-aa93-cc351d1c8e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.922256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751100c-4afb-4ad8-aa93-cc351d1c8e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.924902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6e002-c896-410e-9134-455aa2d90fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.925046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751100c-4afb-4ad8-aa93-cc351d1c8e96 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.925565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e002-c896-410e-9134-455aa2d90fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.925846 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e002-c896-410e-9134-455aa2d90fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.926123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e002-c896-410e-9134-455aa2d90fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.926837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6e002-c896-410e-9134-455aa2d90fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.928456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6e002-c896-410e-9134-455aa2d90fd1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.928757 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:27.941059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 794/1583] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:27.941901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6e002-c896-410e-9134-455aa2d90fd1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.955387 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6e002-c896-410e-9134-455aa2d90fd1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:27.958647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 790/1584] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:27.959402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751100c-4afb-4ad8-aa93-cc351d1c8e96 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.964694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615cd0f-ef3f-4739-8cf6-af43c02744ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:27.965503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615cd0f-ef3f-4739-8cf6-af43c02744ea admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:27.965789 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615cd0f-ef3f-4739-8cf6-af43c02744ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:27.966124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615cd0f-ef3f-4739-8cf6-af43c02744ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:27.966922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615cd0f-ef3f-4739-8cf6-af43c02744ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:27.968648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615cd0f-ef3f-4739-8cf6-af43c02744ea admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:27.984211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 795/1585] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:27.984211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615cd0f-ef3f-4739-8cf6-af43c02744ea admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:27.996237 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615cd0f-ef3f-4739-8cf6-af43c02744ea admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.019881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:28.038850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751100c-4afb-4ad8-aa93-cc351d1c8e96 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.043919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970764f0-c26c-4130-bc4c-12261d76b696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.044778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970764f0-c26c-4130-bc4c-12261d76b696 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.045222 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970764f0-c26c-4130-bc4c-12261d76b696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.045517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970764f0-c26c-4130-bc4c-12261d76b696 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.046461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970764f0-c26c-4130-bc4c-12261d76b696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.048425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970764f0-c26c-4130-bc4c-12261d76b696 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.065904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96008ea8-3eb3-48c1-b513-fe3742078fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.066850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96008ea8-3eb3-48c1-b513-fe3742078fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.067161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96008ea8-3eb3-48c1-b513-fe3742078fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.067500 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96008ea8-3eb3-48c1-b513-fe3742078fe3 admin admin] PATH_INFO: `/v3/projects/f928d0d761934d7391e83ae91c304cc0/users/6e385494b5914b19a78f8d9a48260fcc/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.082780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 791/1586] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:27 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:28.082780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970764f0-c26c-4130-bc4c-12261d76b696 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.089251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96008ea8-3eb3-48c1-b513-fe3742078fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f928d0d761934d7391e83ae91c304cc0, user_id=6e385494b5914b19a78f8d9a48260fcc, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.090299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-96008ea8-3eb3-48c1-b513-fe3742078fe3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:41:28.090299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 06 20:41:28.090299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: Jul 06 20:41:28.094665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96008ea8-3eb3-48c1-b513-fe3742078fe3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.123329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 796/1587] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:27 2022] PUT /identity/v3/projects/f928d0d761934d7391e83ae91c304cc0/users/6e385494b5914b19a78f8d9a48260fcc/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:28.124450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96008ea8-3eb3-48c1-b513-fe3742078fe3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.170144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970764f0-c26c-4130-bc4c-12261d76b696 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.204493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96008ea8-3eb3-48c1-b513-fe3742078fe3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.210511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80b526-b1a8-4e22-a244-525c2c459320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.211312 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80b526-b1a8-4e22-a244-525c2c459320 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.211600 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80b526-b1a8-4e22-a244-525c2c459320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.211918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80b526-b1a8-4e22-a244-525c2c459320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.212825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80b526-b1a8-4e22-a244-525c2c459320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.214443 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80b526-b1a8-4e22-a244-525c2c459320 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.226273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 797/1588] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:28.227346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80b526-b1a8-4e22-a244-525c2c459320 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.241534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80b526-b1a8-4e22-a244-525c2c459320 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.253705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b52d95-d001-4e2f-be22-bc91fdd64f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.254958 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b52d95-d001-4e2f-be22-bc91fdd64f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.255419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b52d95-d001-4e2f-be22-bc91fdd64f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.255832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b52d95-d001-4e2f-be22-bc91fdd64f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.256810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b52d95-d001-4e2f-be22-bc91fdd64f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.258854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b52d95-d001-4e2f-be22-bc91fdd64f12 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.259387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e26e52-a5d9-46a3-bc4d-5d161feed4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.260428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e26e52-a5d9-46a3-bc4d-5d161feed4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.260735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e26e52-a5d9-46a3-bc4d-5d161feed4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.261077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e26e52-a5d9-46a3-bc4d-5d161feed4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.261874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e26e52-a5d9-46a3-bc4d-5d161feed4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.263589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e26e52-a5d9-46a3-bc4d-5d161feed4f5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.272575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 798/1589] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:28.273416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b52d95-d001-4e2f-be22-bc91fdd64f12 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.279642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 792/1590] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:28.280678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e26e52-a5d9-46a3-bc4d-5d161feed4f5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.288286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b52d95-d001-4e2f-be22-bc91fdd64f12 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.292147 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e26e52-a5d9-46a3-bc4d-5d161feed4f5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.294193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517a736-9912-45ee-a727-f1dfa0e60ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.294557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517a736-9912-45ee-a727-f1dfa0e60ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.294899 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517a736-9912-45ee-a727-f1dfa0e60ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.295202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517a736-9912-45ee-a727-f1dfa0e60ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.295968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517a736-9912-45ee-a727-f1dfa0e60ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.297580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa8d98-f164-4e4d-b6fb-806b4f2a633f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.298259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa8d98-f164-4e4d-b6fb-806b4f2a633f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.298401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517a736-9912-45ee-a727-f1dfa0e60ab8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.298814 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa8d98-f164-4e4d-b6fb-806b4f2a633f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.299302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa8d98-f164-4e4d-b6fb-806b4f2a633f admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.300081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa8d98-f164-4e4d-b6fb-806b4f2a633f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.302409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa8d98-f164-4e4d-b6fb-806b4f2a633f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.317269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 793/1591] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:28.318253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa8d98-f164-4e4d-b6fb-806b4f2a633f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.323824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:28.329836 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa8d98-f164-4e4d-b6fb-806b4f2a633f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.334749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 799/1592] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:28 2022] POST /identity/v3/users => generated 293 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:28.334749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af05cd-fdcb-48bb-84bc-9f9d6fbda805 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.334749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af05cd-fdcb-48bb-84bc-9f9d6fbda805 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.334749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af05cd-fdcb-48bb-84bc-9f9d6fbda805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.341673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565d362-85b8-4b80-ac2a-7084f3000dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.342945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565d362-85b8-4b80-ac2a-7084f3000dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.343793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565d362-85b8-4b80-ac2a-7084f3000dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.344142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565d362-85b8-4b80-ac2a-7084f3000dcb admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.344954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565d362-85b8-4b80-ac2a-7084f3000dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.351051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565d362-85b8-4b80-ac2a-7084f3000dcb admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.363670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f3af05cd-fdcb-48bb-84bc-9f9d6fbda805 None None] MFA Rules not processed for user `6e385494b5914b19a78f8d9a48260fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:28.365010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f3af05cd-fdcb-48bb-84bc-9f9d6fbda805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:28.375398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 794/1593] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:28 2022] POST /identity/v3/users => generated 293 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:28.376196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565d362-85b8-4b80-ac2a-7084f3000dcb admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.386691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565d362-85b8-4b80-ac2a-7084f3000dcb admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.391669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9972bb-67a7-45c4-b702-1a6cdaeea86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.392334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9972bb-67a7-45c4-b702-1a6cdaeea86d admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.392826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9972bb-67a7-45c4-b702-1a6cdaeea86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.393106 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9972bb-67a7-45c4-b702-1a6cdaeea86d admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.394224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9972bb-67a7-45c4-b702-1a6cdaeea86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.395768 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9972bb-67a7-45c4-b702-1a6cdaeea86d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.407506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 795/1594] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:28.408165 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9972bb-67a7-45c4-b702-1a6cdaeea86d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.420571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9972bb-67a7-45c4-b702-1a6cdaeea86d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.428522 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62429dad-3f2d-4ea5-a575-df642c69fa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.430638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62429dad-3f2d-4ea5-a575-df642c69fa80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.430926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62429dad-3f2d-4ea5-a575-df642c69fa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.431233 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62429dad-3f2d-4ea5-a575-df642c69fa80 admin admin] PATH_INFO: `/v3/projects/ccc03850c0954988b254c7354aa3a525/users/60770016e6b14eb2a2ea224e77883c9e/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.449014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62429dad-3f2d-4ea5-a575-df642c69fa80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc03850c0954988b254c7354aa3a525, user_id=60770016e6b14eb2a2ea224e77883c9e, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.451793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62429dad-3f2d-4ea5-a575-df642c69fa80 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.471333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 800/1595] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:28.472228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af05cd-fdcb-48bb-84bc-9f9d6fbda805 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.489565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 796/1596] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:28 2022] PUT /identity/v3/projects/ccc03850c0954988b254c7354aa3a525/users/60770016e6b14eb2a2ea224e77883c9e/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:28.489565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62429dad-3f2d-4ea5-a575-df642c69fa80 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.489870 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:28.491826 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af05cd-fdcb-48bb-84bc-9f9d6fbda805 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.580294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62429dad-3f2d-4ea5-a575-df642c69fa80 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.592282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89fc07-ae26-4d9d-bc72-ce4cf37b76e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.592779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1adb2d-e9cf-45cd-8d76-38f36e89dc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.593535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1adb2d-e9cf-45cd-8d76-38f36e89dc9b admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.593882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1adb2d-e9cf-45cd-8d76-38f36e89dc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.594169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1adb2d-e9cf-45cd-8d76-38f36e89dc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.594436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89fc07-ae26-4d9d-bc72-ce4cf37b76e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.594908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1adb2d-e9cf-45cd-8d76-38f36e89dc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.595146 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89fc07-ae26-4d9d-bc72-ce4cf37b76e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.595695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89fc07-ae26-4d9d-bc72-ce4cf37b76e5 admin admin] PATH_INFO: `/v3/projects/20a47e2671b14b769bd4bb8aaf2449ab/users/e651c2917c75425fb656dfb145a5bc4a/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.597701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1adb2d-e9cf-45cd-8d76-38f36e89dc9b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.611966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 801/1597] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:28.612879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1adb2d-e9cf-45cd-8d76-38f36e89dc9b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.628855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1adb2d-e9cf-45cd-8d76-38f36e89dc9b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.630735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89fc07-ae26-4d9d-bc72-ce4cf37b76e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a47e2671b14b769bd4bb8aaf2449ab, user_id=e651c2917c75425fb656dfb145a5bc4a, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.633699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89fc07-ae26-4d9d-bc72-ce4cf37b76e5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.635311 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7e483-cd1d-42d7-a7c1-1da1259abe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.638028 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7e483-cd1d-42d7-a7c1-1da1259abe5f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.638331 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7e483-cd1d-42d7-a7c1-1da1259abe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.638620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7e483-cd1d-42d7-a7c1-1da1259abe5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.639506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7e483-cd1d-42d7-a7c1-1da1259abe5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.641158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7e483-cd1d-42d7-a7c1-1da1259abe5f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.653203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 802/1598] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:28.654195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 797/1599] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:28 2022] PUT /identity/v3/projects/20a47e2671b14b769bd4bb8aaf2449ab/users/e651c2917c75425fb656dfb145a5bc4a/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:28.655482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89fc07-ae26-4d9d-bc72-ce4cf37b76e5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.655648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7e483-cd1d-42d7-a7c1-1da1259abe5f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.668852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7e483-cd1d-42d7-a7c1-1da1259abe5f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.755778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89fc07-ae26-4d9d-bc72-ce4cf37b76e5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.760733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abdf7a-f59c-4a70-adc4-e6fe706a6187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.761384 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f2bac-b384-4136-9c1a-48a480e8130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.761850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abdf7a-f59c-4a70-adc4-e6fe706a6187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.762068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f2bac-b384-4136-9c1a-48a480e8130b admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.762330 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abdf7a-f59c-4a70-adc4-e6fe706a6187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.762453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f2bac-b384-4136-9c1a-48a480e8130b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.762610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f2bac-b384-4136-9c1a-48a480e8130b admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.762998 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abdf7a-f59c-4a70-adc4-e6fe706a6187 admin admin] PATH_INFO: `/v3/projects/29b55ed16edc462290a22f62a5fdac4e/users/488e110f9fb842a8a0c1e6fd0461151d/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.765076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f2bac-b384-4136-9c1a-48a480e8130b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.768617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f2bac-b384-4136-9c1a-48a480e8130b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.791660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abdf7a-f59c-4a70-adc4-e6fe706a6187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b55ed16edc462290a22f62a5fdac4e, user_id=488e110f9fb842a8a0c1e6fd0461151d, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:28.792371 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 803/1600] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:28.793250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f2bac-b384-4136-9c1a-48a480e8130b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:28.796064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abdf7a-f59c-4a70-adc4-e6fe706a6187 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:28.819191 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 798/1601] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:28 2022] PUT /identity/v3/projects/29b55ed16edc462290a22f62a5fdac4e/users/488e110f9fb842a8a0c1e6fd0461151d/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:28.820770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23f2f9-9232-41d7-a7c5-eccb4950ab8d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.821126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23f2f9-9232-41d7-a7c5-eccb4950ab8d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.821475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23f2f9-9232-41d7-a7c5-eccb4950ab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:28.889180 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7a23f2f9-9232-41d7-a7c5-eccb4950ab8d None None] MFA Rules not processed for user `60770016e6b14eb2a2ea224e77883c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:28.890339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7a23f2f9-9232-41d7-a7c5-eccb4950ab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:28.895280 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f2bac-b384-4136-9c1a-48a480e8130b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:28.899973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:28.949169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:28.962433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4681e8-daa1-40d1-9f5b-d74a21e688e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:28.963279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4681e8-daa1-40d1-9f5b-d74a21e688e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:28.963953 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4681e8-daa1-40d1-9f5b-d74a21e688e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:28.963953 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4681e8-daa1-40d1-9f5b-d74a21e688e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:29.008560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 799/1602] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:29.009940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23f2f9-9232-41d7-a7c5-eccb4950ab8d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:29.078135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4681e8-daa1-40d1-9f5b-d74a21e688e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:29.079666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4681e8-daa1-40d1-9f5b-d74a21e688e1 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:29.092258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 804/1603] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:29.093350 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4681e8-daa1-40d1-9f5b-d74a21e688e1 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:29.114543 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23f2f9-9232-41d7-a7c5-eccb4950ab8d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:29.120126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7982a01-ce2c-4759-8bd1-45da6781c31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:29.121197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7982a01-ce2c-4759-8bd1-45da6781c31d admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:29.121607 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7982a01-ce2c-4759-8bd1-45da6781c31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:29.122005 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7982a01-ce2c-4759-8bd1-45da6781c31d admin admin] PATH_INFO: `/v3/projects/df2033b138714a77ba707321360c5a98/users/984f856cff954e34becd82fae4609173/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:29.143381 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7982a01-ce2c-4759-8bd1-45da6781c31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2033b138714a77ba707321360c5a98, user_id=984f856cff954e34becd82fae4609173, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:29.147468 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7982a01-ce2c-4759-8bd1-45da6781c31d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:29.178847 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 800/1604] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:29 2022] PUT /identity/v3/projects/df2033b138714a77ba707321360c5a98/users/984f856cff954e34becd82fae4609173/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:29.178847 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5c37-620a-40e9-b4f1-2c7636fd7a20 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:29.178847 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5c37-620a-40e9-b4f1-2c7636fd7a20 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:29.178847 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5c37-620a-40e9-b4f1-2c7636fd7a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:29.189026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4681e8-daa1-40d1-9f5b-d74a21e688e1 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:29.192073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-06fc5c37-620a-40e9-b4f1-2c7636fd7a20 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:29.193434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-06fc5c37-620a-40e9-b4f1-2c7636fd7a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:29.278699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 801/1605] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:29.279618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc5c37-620a-40e9-b4f1-2c7636fd7a20 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:29.292531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc5c37-620a-40e9-b4f1-2c7636fd7a20 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:29.298543 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38081-833c-4752-b9f5-765c821d0832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:29.299712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38081-833c-4752-b9f5-765c821d0832 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:29.300005 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38081-833c-4752-b9f5-765c821d0832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:29.300357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38081-833c-4752-b9f5-765c821d0832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:29.301103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c38081-833c-4752-b9f5-765c821d0832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:29.302899 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c38081-833c-4752-b9f5-765c821d0832 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:29.313260 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af374376-6125-4af2-8573-e862ac46274b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:29.315852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af374376-6125-4af2-8573-e862ac46274b admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:29.316180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af374376-6125-4af2-8573-e862ac46274b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:29.316468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af374376-6125-4af2-8573-e862ac46274b admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:29.317211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af374376-6125-4af2-8573-e862ac46274b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:29.317578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 802/1606] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:29.318849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af374376-6125-4af2-8573-e862ac46274b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:29.318968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dfd01-e48d-41a3-a9b9-e7e779d9a3f7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:29.319326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dfd01-e48d-41a3-a9b9-e7e779d9a3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:29.319611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dfd01-e48d-41a3-a9b9-e7e779d9a3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:29.357171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 805/1607] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:29.357785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df9d52-d6ac-4f69-a99a-f2632a6656c1 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:29.357785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df9d52-d6ac-4f69-a99a-f2632a6656c1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:29.358253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df9d52-d6ac-4f69-a99a-f2632a6656c1 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:29.364007 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-036dfd01-e48d-41a3-a9b9-e7e779d9a3f7 None None] MFA Rules not processed for user `488e110f9fb842a8a0c1e6fd0461151d`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:29.365445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-036dfd01-e48d-41a3-a9b9-e7e779d9a3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:29.366248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 806/1608] 10.222.0.33 () {54 vars in 961 bytes} [Wed Jul 6 20:41:29 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:41:29.367918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a99f3-e56c-45f2-9473-2fe47a4e535f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:29.368221 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a99f3-e56c-45f2-9473-2fe47a4e535f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:29.368507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a99f3-e56c-45f2-9473-2fe47a4e535f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:29.382366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:29.403524 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7c5a99f3-e56c-45f2-9473-2fe47a4e535f None None] MFA Rules not processed for user `984f856cff954e34becd82fae4609173`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:29.405600 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7c5a99f3-e56c-45f2-9473-2fe47a4e535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:29.451348 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:29.476826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 803/1609] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:29.483351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dfd01-e48d-41a3-a9b9-e7e779d9a3f7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:29.496618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dfd01-e48d-41a3-a9b9-e7e779d9a3f7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:29.508558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b998c-3ab5-4533-99e0-e0dfdf9d6e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:29.511419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b998c-3ab5-4533-99e0-e0dfdf9d6e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:29.511962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b998c-3ab5-4533-99e0-e0dfdf9d6e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:29.512256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b998c-3ab5-4533-99e0-e0dfdf9d6e3d admin admin] PATH_INFO: `/v3/projects/3a43f7696d634326bb3cc176c9245c5d/users/3ef7e8ce649e48538ceec1cbf79a216e/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:29.532479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 807/1610] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:29.537788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a99f3-e56c-45f2-9473-2fe47a4e535f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:29.558048 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b998c-3ab5-4533-99e0-e0dfdf9d6e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a43f7696d634326bb3cc176c9245c5d, user_id=3ef7e8ce649e48538ceec1cbf79a216e, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:29.563364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b998c-3ab5-4533-99e0-e0dfdf9d6e3d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:29.594466 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 804/1611] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:29 2022] PUT /identity/v3/projects/3a43f7696d634326bb3cc176c9245c5d/users/3ef7e8ce649e48538ceec1cbf79a216e/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:29.599783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b998c-3ab5-4533-99e0-e0dfdf9d6e3d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:29.672378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a99f3-e56c-45f2-9473-2fe47a4e535f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:29.729488 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b998c-3ab5-4533-99e0-e0dfdf9d6e3d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:29.739857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61de51-f4ee-4c26-bdec-a265ccde5648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:29.740941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61de51-f4ee-4c26-bdec-a265ccde5648 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:29.741304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61de51-f4ee-4c26-bdec-a265ccde5648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:29.741627 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61de51-f4ee-4c26-bdec-a265ccde5648 admin admin] PATH_INFO: `/v3/projects/cdb27a569e3f48a1a7076deb30da8618/users/fb6987f34f174552bab9495f3d50ee45/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:29.747767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b3874-7a4d-43ab-be61-15e70b4a744f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:29.749407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b3874-7a4d-43ab-be61-15e70b4a744f service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:29.749902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b3874-7a4d-43ab-be61-15e70b4a744f service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:29.750289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b3874-7a4d-43ab-be61-15e70b4a744f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:29.762794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61de51-f4ee-4c26-bdec-a265ccde5648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb27a569e3f48a1a7076deb30da8618, user_id=fb6987f34f174552bab9495f3d50ee45, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:29.767429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b3874-7a4d-43ab-be61-15e70b4a744f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:29.767621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61de51-f4ee-4c26-bdec-a265ccde5648 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:29.769929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b3874-7a4d-43ab-be61-15e70b4a744f service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:29.787149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 808/1612] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:29.788785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e41d97-d820-4478-acbe-2fee6e6460ce None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:29.789381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e41d97-d820-4478-acbe-2fee6e6460ce None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:29.789760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e41d97-d820-4478-acbe-2fee6e6460ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:29.790571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 805/1613] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:29 2022] PUT /identity/v3/projects/cdb27a569e3f48a1a7076deb30da8618/users/fb6987f34f174552bab9495f3d50ee45/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:29.792091 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e1e38-6dc3-453e-8283-e5b971e83220 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:29.792887 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e1e38-6dc3-453e-8283-e5b971e83220 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:29.792887 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e1e38-6dc3-453e-8283-e5b971e83220 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:29.800415 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 806/1614] 10.222.0.33 () {54 vars in 961 bytes} [Wed Jul 6 20:41:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:41:29.802951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e1e38-6dc3-453e-8283-e5b971e83220 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:29.834052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-77e41d97-d820-4478-acbe-2fee6e6460ce None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:29.835832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-77e41d97-d820-4478-acbe-2fee6e6460ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:30.047075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 809/1615] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Jul 6 20:41:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:30.047075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c788e-7177-450e-973f-928d8d070b6c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.047075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c788e-7177-450e-973f-928d8d070b6c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.047075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c788e-7177-450e-973f-928d8d070b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.048548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e1e38-6dc3-453e-8283-e5b971e83220 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:30.048548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175672e4-5760-4382-9b04-80eabac40848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:30.048548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175672e4-5760-4382-9b04-80eabac40848 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.048548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175672e4-5760-4382-9b04-80eabac40848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.049744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175672e4-5760-4382-9b04-80eabac40848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.049744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175672e4-5760-4382-9b04-80eabac40848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:30.049744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175672e4-5760-4382-9b04-80eabac40848 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:30.066878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-481c788e-7177-450e-973f-928d8d070b6c None None] MFA Rules not processed for user `3ef7e8ce649e48538ceec1cbf79a216e`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:30.069904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-481c788e-7177-450e-973f-928d8d070b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:30.075072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:30.120758 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 807/1616] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:29 2022] POST /identity/v3/projects => generated 363 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:30.126388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:30.128554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eeecd-2372-4f6b-8877-4673c264fa25 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.133783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eeecd-2372-4f6b-8877-4673c264fa25 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.136273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eeecd-2372-4f6b-8877-4673c264fa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.177149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-644eeecd-2372-4f6b-8877-4673c264fa25 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:30.178421 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-644eeecd-2372-4f6b-8877-4673c264fa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:30.246803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 810/1617] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:30.246803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a7771-935a-4a46-9dae-5efeaf8b6093 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.246803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a7771-935a-4a46-9dae-5efeaf8b6093 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.246803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a7771-935a-4a46-9dae-5efeaf8b6093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.270351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-355a7771-935a-4a46-9dae-5efeaf8b6093 None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:30.271682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-355a7771-935a-4a46-9dae-5efeaf8b6093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:30.279258 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 808/1618] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:30.280320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644eeecd-2372-4f6b-8877-4673c264fa25 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:30.366437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 811/1619] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Jul 6 20:41:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:30.374969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644eeecd-2372-4f6b-8877-4673c264fa25 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:30.375995 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a7771-935a-4a46-9dae-5efeaf8b6093 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:30.382269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3def52e-030c-48de-93bc-c3722e5ed438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:30.383068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3def52e-030c-48de-93bc-c3722e5ed438 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.383383 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3def52e-030c-48de-93bc-c3722e5ed438 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.383660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3def52e-030c-48de-93bc-c3722e5ed438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.388751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a7771-935a-4a46-9dae-5efeaf8b6093 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:30.395587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed794b-73fc-4665-9dca-59dc1024758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:30.396403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed794b-73fc-4665-9dca-59dc1024758f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.396794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed794b-73fc-4665-9dca-59dc1024758f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.397535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed794b-73fc-4665-9dca-59dc1024758f admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.398533 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed794b-73fc-4665-9dca-59dc1024758f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:30.400698 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed794b-73fc-4665-9dca-59dc1024758f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:30.425670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 812/1620] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:30 2022] POST /identity/v3/users => generated 288 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:30.429831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed794b-73fc-4665-9dca-59dc1024758f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:30.432104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ebed794b-73fc-4665-9dca-59dc1024758f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:30.454457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3def52e-030c-48de-93bc-c3722e5ed438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:30.456979 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3def52e-030c-48de-93bc-c3722e5ed438 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:30.467790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 809/1621] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:30.468723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3def52e-030c-48de-93bc-c3722e5ed438 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:30.480685 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3def52e-030c-48de-93bc-c3722e5ed438 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:30.489740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03643a43-d88f-4216-96af-da9bad12b571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:30.490432 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03643a43-d88f-4216-96af-da9bad12b571 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.490713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03643a43-d88f-4216-96af-da9bad12b571 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.490988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03643a43-d88f-4216-96af-da9bad12b571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.509177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed794b-73fc-4665-9dca-59dc1024758f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:30.515747 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f800a63-1f83-4243-a58e-ca04a1661f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:30.516792 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f800a63-1f83-4243-a58e-ca04a1661f72 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.518439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f800a63-1f83-4243-a58e-ca04a1661f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.519043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f800a63-1f83-4243-a58e-ca04a1661f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.534010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f800a63-1f83-4243-a58e-ca04a1661f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:30.536090 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f800a63-1f83-4243-a58e-ca04a1661f72 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:30.539311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:30.554832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 813/1622] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:30.569545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f800a63-1f83-4243-a58e-ca04a1661f72 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:30.578973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03643a43-d88f-4216-96af-da9bad12b571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:30.581386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03643a43-d88f-4216-96af-da9bad12b571 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:30.593934 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 810/1623] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:30.599239 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f800a63-1f83-4243-a58e-ca04a1661f72 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:30.605261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f677ea-cd2a-4c30-9d79-0a6c9f43820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:30.607335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f677ea-cd2a-4c30-9d79-0a6c9f43820e admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.607733 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f677ea-cd2a-4c30-9d79-0a6c9f43820e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.608095 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f677ea-cd2a-4c30-9d79-0a6c9f43820e admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.609007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f677ea-cd2a-4c30-9d79-0a6c9f43820e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:30.612517 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f677ea-cd2a-4c30-9d79-0a6c9f43820e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:30.626307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 814/1624] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:30.631364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03643a43-d88f-4216-96af-da9bad12b571 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:30.643327 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03643a43-d88f-4216-96af-da9bad12b571 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:30.650671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3faf5-e20b-427f-9fa5-e4ef102b9d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:30.651700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3faf5-e20b-427f-9fa5-e4ef102b9d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.652089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3faf5-e20b-427f-9fa5-e4ef102b9d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.652422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3faf5-e20b-427f-9fa5-e4ef102b9d38 admin admin] PATH_INFO: `/v3/projects/2da784fec24a42048c6e039b88e55e8f/users/92b1f2598cf24aaca1de2c3c2f05a8d7/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.670517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3faf5-e20b-427f-9fa5-e4ef102b9d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da784fec24a42048c6e039b88e55e8f, user_id=92b1f2598cf24aaca1de2c3c2f05a8d7, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:30.674409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3faf5-e20b-427f-9fa5-e4ef102b9d38 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:30.695555 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 811/1625] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:30 2022] PUT /identity/v3/projects/2da784fec24a42048c6e039b88e55e8f/users/92b1f2598cf24aaca1de2c3c2f05a8d7/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:30.696633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f677ea-cd2a-4c30-9d79-0a6c9f43820e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:30.710362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f677ea-cd2a-4c30-9d79-0a6c9f43820e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:30.739220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:30.843651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8081531-ee3a-4ee0-b3f3-5605115529ed None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.843975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8081531-ee3a-4ee0-b3f3-5605115529ed None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.844328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8081531-ee3a-4ee0-b3f3-5605115529ed None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.846491 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 812/1626] 10.222.0.33 () {54 vars in 912 bytes} [Wed Jul 6 20:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:41:30.853450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22b19-8df0-48c7-a01f-5842c9f94edc None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.853742 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22b19-8df0-48c7-a01f-5842c9f94edc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.854024 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22b19-8df0-48c7-a01f-5842c9f94edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.868863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19742561-093b-4948-9c00-5408ee043c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:30.869446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742561-093b-4948-9c00-5408ee043c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.870318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742561-093b-4948-9c00-5408ee043c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.870622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742561-093b-4948-9c00-5408ee043c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.871728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19742561-093b-4948-9c00-5408ee043c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:30.874085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19742561-093b-4948-9c00-5408ee043c5d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:30.888123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c0c22b19-8df0-48c7-a01f-5842c9f94edc None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:30.889578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c0c22b19-8df0-48c7-a01f-5842c9f94edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:30.889780 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 815/1627] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:41:30.894561 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19742561-093b-4948-9c00-5408ee043c5d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:30.922280 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19742561-093b-4948-9c00-5408ee043c5d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:30.938861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcfea7-5cab-4b47-85a5-c9717d9a01c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:30.940580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcfea7-5cab-4b47-85a5-c9717d9a01c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.940871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcfea7-5cab-4b47-85a5-c9717d9a01c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.941297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcfea7-5cab-4b47-85a5-c9717d9a01c5 admin admin] PATH_INFO: `/v3/projects/2da784fec24a42048c6e039b88e55e8f/users/92b1f2598cf24aaca1de2c3c2f05a8d7/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:30.948491 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcfea7-5cab-4b47-85a5-c9717d9a01c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da784fec24a42048c6e039b88e55e8f, user_id=92b1f2598cf24aaca1de2c3c2f05a8d7, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:30.951690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcfea7-5cab-4b47-85a5-c9717d9a01c5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:30.983874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 816/1628] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:30 2022] PUT /identity/v3/projects/2da784fec24a42048c6e039b88e55e8f/users/92b1f2598cf24aaca1de2c3c2f05a8d7/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:30.995764 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a9c85-2807-4166-8912-e96ac9fb2a42 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:30.996163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a9c85-2807-4166-8912-e96ac9fb2a42 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:30.996505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a9c85-2807-4166-8912-e96ac9fb2a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:31.042907 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 813/1629] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:41:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:41:31.058164 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c22b19-8df0-48c7-a01f-5842c9f94edc None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:31.104238 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-884a9c85-2807-4166-8912-e96ac9fb2a42 None None] MFA Rules not processed for user `92b1f2598cf24aaca1de2c3c2f05a8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:31.105499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-884a9c85-2807-4166-8912-e96ac9fb2a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:31.219906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c22b19-8df0-48c7-a01f-5842c9f94edc None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:31.371089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da578535-bb11-480e-9c68-cfa28f4a5554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:31.372103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da578535-bb11-480e-9c68-cfa28f4a5554 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:31.373943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da578535-bb11-480e-9c68-cfa28f4a5554 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:31.380817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da578535-bb11-480e-9c68-cfa28f4a5554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:31.381070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 817/1630] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:41:31.382459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a9c85-2807-4166-8912-e96ac9fb2a42 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:31.391658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:31.554822 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da578535-bb11-480e-9c68-cfa28f4a5554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:31.557886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da578535-bb11-480e-9c68-cfa28f4a5554 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:31.565504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a9c85-2807-4166-8912-e96ac9fb2a42 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:31.584480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0888ba-0370-471a-aeda-3d98dbe92dbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:31.589670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0888ba-0370-471a-aeda-3d98dbe92dbe service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:31.590583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0888ba-0370-471a-aeda-3d98dbe92dbe service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:31.591364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0888ba-0370-471a-aeda-3d98dbe92dbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:31.594328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 814/1631] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:41:31.597206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da578535-bb11-480e-9c68-cfa28f4a5554 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:31.617690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da578535-bb11-480e-9c68-cfa28f4a5554 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:31.630170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e801e-129f-4fe7-bf60-cc5775167c5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:31.631248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e801e-129f-4fe7-bf60-cc5775167c5d service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:31.631600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e801e-129f-4fe7-bf60-cc5775167c5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:31.632613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e801e-129f-4fe7-bf60-cc5775167c5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:31.640422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:31.657671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e801e-129f-4fe7-bf60-cc5775167c5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:31.661174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e801e-129f-4fe7-bf60-cc5775167c5d service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:31.696278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 815/1632] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:31 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:31.740055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0888ba-0370-471a-aeda-3d98dbe92dbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:31.741941 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0888ba-0370-471a-aeda-3d98dbe92dbe service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:31.768624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 818/1633] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:31.836323 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8918252-8a32-486d-a767-1900a192a4d3 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:31.837431 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8918252-8a32-486d-a767-1900a192a4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:31.849183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8918252-8a32-486d-a767-1900a192a4d3 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:31.855231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 816/1634] 10.222.0.33 () {54 vars in 912 bytes} [Wed Jul 6 20:41:31 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:41:31.862336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abc471-e2a6-45b0-8769-9a5ac77bb91e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:31.863444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abc471-e2a6-45b0-8769-9a5ac77bb91e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:31.864071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abc471-e2a6-45b0-8769-9a5ac77bb91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:31.950604 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-90abc471-e2a6-45b0-8769-9a5ac77bb91e None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:31.953581 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-90abc471-e2a6-45b0-8769-9a5ac77bb91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:31.990688 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 819/1635] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:41:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:32.018959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8918252-8a32-486d-a767-1900a192a4d3 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:32.035369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8918252-8a32-486d-a767-1900a192a4d3 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:32.043605 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893109f-ac21-4dd9-91ee-b38f1a161248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:32.046507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893109f-ac21-4dd9-91ee-b38f1a161248 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:32.046846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893109f-ac21-4dd9-91ee-b38f1a161248 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:32.047102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893109f-ac21-4dd9-91ee-b38f1a161248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:32.064260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893109f-ac21-4dd9-91ee-b38f1a161248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:32.067755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893109f-ac21-4dd9-91ee-b38f1a161248 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:32.116288 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 817/1636] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:41:34.144752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abc471-e2a6-45b0-8769-9a5ac77bb91e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:34.274831 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893109f-ac21-4dd9-91ee-b38f1a161248 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:34.334296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abc471-e2a6-45b0-8769-9a5ac77bb91e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:34.334296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c94c5-7ff8-403b-ba8a-cbfa0f039fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:34.334296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c94c5-7ff8-403b-ba8a-cbfa0f039fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:34.334296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c94c5-7ff8-403b-ba8a-cbfa0f039fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:34.337821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c94c5-7ff8-403b-ba8a-cbfa0f039fbb admin admin] PATH_INFO: `/v3/users/488e110f9fb842a8a0c1e6fd0461151d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:34.337821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c94c5-7ff8-403b-ba8a-cbfa0f039fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=488e110f9fb842a8a0c1e6fd0461151d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:34.337821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-8a9c94c5-7ff8-403b-ba8a-cbfa0f039fbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:41:34.337821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 06 20:41:34.337821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: Jul 06 20:41:34.337821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c94c5-7ff8-403b-ba8a-cbfa0f039fbb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:34.453008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893109f-ac21-4dd9-91ee-b38f1a161248 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:34.460487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8373a-8c3a-4390-ae73-3deb1a84362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:34.461710 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8373a-8c3a-4390-ae73-3deb1a84362c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:34.462610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8373a-8c3a-4390-ae73-3deb1a84362c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:34.463119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8373a-8c3a-4390-ae73-3deb1a84362c admin admin] PATH_INFO: `/v3/users/984f856cff954e34becd82fae4609173` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:34.465203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8373a-8c3a-4390-ae73-3deb1a84362c admin admin] RBAC: Authorizing `identity:delete_user(user_id=984f856cff954e34becd82fae4609173)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:34.478546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8373a-8c3a-4390-ae73-3deb1a84362c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:34.498011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a9c94c5-7ff8-403b-ba8a-cbfa0f039fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '488e110f9fb842a8a0c1e6fd0461151d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:34.522276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a9c94c5-7ff8-403b-ba8a-cbfa0f039fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '488e110f9fb842a8a0c1e6fd0461151d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:34.546265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a9c94c5-7ff8-403b-ba8a-cbfa0f039fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '488e110f9fb842a8a0c1e6fd0461151d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:34.547643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a9c94c5-7ff8-403b-ba8a-cbfa0f039fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '488e110f9fb842a8a0c1e6fd0461151d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:34.662844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9fc8373a-8c3a-4390-ae73-3deb1a84362c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984f856cff954e34becd82fae4609173'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:34.663664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9fc8373a-8c3a-4390-ae73-3deb1a84362c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984f856cff954e34becd82fae4609173'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:34.669359 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a9c94c5-7ff8-403b-ba8a-cbfa0f039fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '488e110f9fb842a8a0c1e6fd0461151d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:34.684164 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9fc8373a-8c3a-4390-ae73-3deb1a84362c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984f856cff954e34becd82fae4609173'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:34.686476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 820/1637] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:41:34 2022] DELETE /identity/v3/users/488e110f9fb842a8a0c1e6fd0461151d => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:34.692863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef1ae2-f6ac-4711-a87a-ef0a4cc6e346 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:34.693158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef1ae2-f6ac-4711-a87a-ef0a4cc6e346 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:34.693437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef1ae2-f6ac-4711-a87a-ef0a4cc6e346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:34.695055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:34.708223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9fc8373a-8c3a-4390-ae73-3deb1a84362c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984f856cff954e34becd82fae4609173'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:34.729287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9fc8373a-8c3a-4390-ae73-3deb1a84362c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984f856cff954e34becd82fae4609173'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:34.750415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4bef1ae2-f6ac-4711-a87a-ef0a4cc6e346 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:34.759599 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 818/1638] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:41:34 2022] DELETE /identity/v3/users/984f856cff954e34becd82fae4609173 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:34.759771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4bef1ae2-f6ac-4711-a87a-ef0a4cc6e346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:34.759851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fe637-e90c-4f1b-8f74-bf077796ff3c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:34.759851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fe637-e90c-4f1b-8f74-bf077796ff3c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:34.759851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fe637-e90c-4f1b-8f74-bf077796ff3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:34.803063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8c2fe637-e90c-4f1b-8f74-bf077796ff3c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:34.808759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8c2fe637-e90c-4f1b-8f74-bf077796ff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:34.871852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:34.994209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 821/1639] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:35.024233 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef1ae2-f6ac-4711-a87a-ef0a4cc6e346 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:35.026516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4bef1ae2-f6ac-4711-a87a-ef0a4cc6e346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:35.070563 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 819/1640] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:35.109173 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fe637-e90c-4f1b-8f74-bf077796ff3c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:35.110780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8c2fe637-e90c-4f1b-8f74-bf077796ff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:35.300616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef1ae2-f6ac-4711-a87a-ef0a4cc6e346 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:35.315045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f65c7-6c25-496e-9e5f-5709a6214183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:35.316928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f65c7-6c25-496e-9e5f-5709a6214183 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:35.317596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f65c7-6c25-496e-9e5f-5709a6214183 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:35.318552 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f65c7-6c25-496e-9e5f-5709a6214183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:35.368714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fe637-e90c-4f1b-8f74-bf077796ff3c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:35.392293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddac6c-e97c-44e5-b096-0aa4426c0e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:35.393605 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddac6c-e97c-44e5-b096-0aa4426c0e86 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:35.394125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddac6c-e97c-44e5-b096-0aa4426c0e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:35.395656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f65c7-6c25-496e-9e5f-5709a6214183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:35.397707 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddac6c-e97c-44e5-b096-0aa4426c0e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:35.399300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f65c7-6c25-496e-9e5f-5709a6214183 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:35.434608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddac6c-e97c-44e5-b096-0aa4426c0e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:35.437432 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddac6c-e97c-44e5-b096-0aa4426c0e86 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:35.438319 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 822/1641] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:41:35.459704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 820/1642] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:35.552597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f65c7-6c25-496e-9e5f-5709a6214183 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:35.554917 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4f8f65c7-6c25-496e-9e5f-5709a6214183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:35.581729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f65c7-6c25-496e-9e5f-5709a6214183 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:35.609955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:35.611047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:35.614141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:35.614609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] PATH_INFO: `/v3/users/60770016e6b14eb2a2ea224e77883c9e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:35.620072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60770016e6b14eb2a2ea224e77883c9e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:35.626586 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:35.733647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60770016e6b14eb2a2ea224e77883c9e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:35.758828 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60770016e6b14eb2a2ea224e77883c9e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:35.770443 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60770016e6b14eb2a2ea224e77883c9e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:35.771705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60770016e6b14eb2a2ea224e77883c9e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:35.805929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60770016e6b14eb2a2ea224e77883c9e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:35.822111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 823/1643] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:41:35 2022] DELETE /identity/v3/users/60770016e6b14eb2a2ea224e77883c9e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:35.824505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688e656-6cf3-4e72-aaed-8dfd4486a22f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:35.825817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688e656-6cf3-4e72-aaed-8dfd4486a22f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:35.826256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688e656-6cf3-4e72-aaed-8dfd4486a22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:35.873529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5688e656-6cf3-4e72-aaed-8dfd4486a22f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:35.874779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5688e656-6cf3-4e72-aaed-8dfd4486a22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:36.061555 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 821/1644] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:41:36.082773 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:36.085535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:36.245140 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:36.253179 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbed2d3-6de6-4ac3-883b-675a6d6482f9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:36.274261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c4361-2804-4b3f-8925-33b626821ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:36.275082 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c4361-2804-4b3f-8925-33b626821ccd service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:36.275496 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c4361-2804-4b3f-8925-33b626821ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:36.275875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c4361-2804-4b3f-8925-33b626821ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:36.296684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c4361-2804-4b3f-8925-33b626821ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:36.300727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c4361-2804-4b3f-8925-33b626821ccd service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:36.327679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 824/1645] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:36.757239 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634d094-454d-462f-b592-b39d00f73f9c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:36.758160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634d094-454d-462f-b592-b39d00f73f9c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:36.758732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634d094-454d-462f-b592-b39d00f73f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:36.807941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2634d094-454d-462f-b592-b39d00f73f9c None None] MFA Rules not processed for user `5330fbd804c44634b682d0a865dd8b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:36.809515 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2634d094-454d-462f-b592-b39d00f73f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:36.832778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:36.909137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 822/1646] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:36.910834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a217522-1e72-4a30-8e4e-1bbc798603d5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:36.911129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a217522-1e72-4a30-8e4e-1bbc798603d5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:36.911438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a217522-1e72-4a30-8e4e-1bbc798603d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:36.955631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9a217522-1e72-4a30-8e4e-1bbc798603d5 None None] MFA Rules not processed for user `5330fbd804c44634b682d0a865dd8b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:36.963212 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9a217522-1e72-4a30-8e4e-1bbc798603d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:36.976047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 825/1647] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:37.088779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634d094-454d-462f-b592-b39d00f73f9c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:37.090329 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2634d094-454d-462f-b592-b39d00f73f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:37.319155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634d094-454d-462f-b592-b39d00f73f9c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:37.327764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96348e57-6631-44c6-b510-abf493e4b4cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:37.328796 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348e57-6631-44c6-b510-abf493e4b4cf service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:37.329676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348e57-6631-44c6-b510-abf493e4b4cf service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:37.331256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348e57-6631-44c6-b510-abf493e4b4cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:37.344304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96348e57-6631-44c6-b510-abf493e4b4cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:37.346962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96348e57-6631-44c6-b510-abf493e4b4cf service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:37.404950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 823/1648] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:38.154619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a217522-1e72-4a30-8e4e-1bbc798603d5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:38.158472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9a217522-1e72-4a30-8e4e-1bbc798603d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:38.186198 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a217522-1e72-4a30-8e4e-1bbc798603d5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:38.209154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:38.210772 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:38.212628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:38.213030 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8 admin admin] PATH_INFO: `/v3/projects/df2033b138714a77ba707321360c5a98` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:38.218857 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df2033b138714a77ba707321360c5a98)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:38.227686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:38.347138 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df2033b138714a77ba707321360c5a98', 'request_id': 'req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:38.371946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df2033b138714a77ba707321360c5a98', 'request_id': 'req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:38.394862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df2033b138714a77ba707321360c5a98', 'request_id': 'req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:38.410891 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8 admin admin] The token cache is being invalidate because project df2033b138714a77ba707321360c5a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:41:38.413038 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:38.415351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0ae893f4-60eb-46c1-aef9-9f92aa38bfa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:38.420573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 826/1649] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:41:38 2022] DELETE /identity/v3/projects/df2033b138714a77ba707321360c5a98 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:38.424937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96348e57-6631-44c6-b510-abf493e4b4cf service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:38.445126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96348e57-6631-44c6-b510-abf493e4b4cf service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:38.472968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105cba-a40c-42d2-9857-6ffdd011f510 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:38.473938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105cba-a40c-42d2-9857-6ffdd011f510 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:38.474237 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105cba-a40c-42d2-9857-6ffdd011f510 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:38.475694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 827/1650] 10.222.0.33 () {54 vars in 912 bytes} [Wed Jul 6 20:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:41:38.483120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3d160-0c55-4b77-991f-493f2ae636b3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:38.483342 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3d160-0c55-4b77-991f-493f2ae636b3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:38.483659 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3d160-0c55-4b77-991f-493f2ae636b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:38.602708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-80e3d160-0c55-4b77-991f-493f2ae636b3 None None] MFA Rules not processed for user `d7bb4a244df24a19b4c3ad3d1ad2bc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:38.603664 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-80e3d160-0c55-4b77-991f-493f2ae636b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:38.643875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:38.644874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:38.645558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:38.645558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] PATH_INFO: `/v3/users/92b1f2598cf24aaca1de2c3c2f05a8d7` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:38.652197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b1f2598cf24aaca1de2c3c2f05a8d7)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:38.658861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:38.778896 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 828/1651] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:38.779996 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3d160-0c55-4b77-991f-493f2ae636b3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:38.787044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-80e3d160-0c55-4b77-991f-493f2ae636b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:38.797658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:38.801665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b1f2598cf24aaca1de2c3c2f05a8d7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:38.802380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b1f2598cf24aaca1de2c3c2f05a8d7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:38.813863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3d160-0c55-4b77-991f-493f2ae636b3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:38.825140 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:38.829529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:38.830508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b1f2598cf24aaca1de2c3c2f05a8d7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:38.830967 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:38.831420 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] PATH_INFO: `/v3/projects/29b55ed16edc462290a22f62a5fdac4e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:38.836848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b55ed16edc462290a22f62a5fdac4e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:38.841755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:38.846531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b1f2598cf24aaca1de2c3c2f05a8d7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:38.856017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b1f2598cf24aaca1de2c3c2f05a8d7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:38.872903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 824/1652] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:41:38 2022] DELETE /identity/v3/users/92b1f2598cf24aaca1de2c3c2f05a8d7 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:38.874020 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:38.876689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:38.957718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b55ed16edc462290a22f62a5fdac4e', 'request_id': 'req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:38.968472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b55ed16edc462290a22f62a5fdac4e', 'request_id': 'req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:38.979784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:38.990016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b55ed16edc462290a22f62a5fdac4e', 'request_id': 'req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:39.020189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed035814-67f6-43a7-bbb6-9331dc03a013 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:39.046789 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] The token cache is being invalidate because project 29b55ed16edc462290a22f62a5fdac4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:41:39.049892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:39.051307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:39.057487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 829/1653] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:41:38 2022] DELETE /identity/v3/projects/29b55ed16edc462290a22f62a5fdac4e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:39.058874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:39.060545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:39.169489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71565017-6a0e-41ed-8b96-8d92ac8ddbd1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:39.175992 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:39.177398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:39.177936 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:39.178391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] PATH_INFO: `/v3/projects/ccc03850c0954988b254c7354aa3a525` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:39.180178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc03850c0954988b254c7354aa3a525)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:39.182837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:39.218737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa791d9-d2da-4621-b509-c7022a9804c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:39.219323 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa791d9-d2da-4621-b509-c7022a9804c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:39.219745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa791d9-d2da-4621-b509-c7022a9804c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:39.220037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa791d9-d2da-4621-b509-c7022a9804c1 admin admin] PATH_INFO: `/v3/users/3ef7e8ce649e48538ceec1cbf79a216e` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:39.228054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa791d9-d2da-4621-b509-c7022a9804c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef7e8ce649e48538ceec1cbf79a216e)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:39.230067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa791d9-d2da-4621-b509-c7022a9804c1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:39.264051 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc03850c0954988b254c7354aa3a525', 'request_id': 'req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:39.274376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc03850c0954988b254c7354aa3a525', 'request_id': 'req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:39.293108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc03850c0954988b254c7354aa3a525', 'request_id': 'req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:39.328058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] The token cache is being invalidate because project ccc03850c0954988b254c7354aa3a525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:41:39.328268 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:39.332286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:39.337449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 830/1654] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:41:39 2022] DELETE /identity/v3/projects/ccc03850c0954988b254c7354aa3a525 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:39.338462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:39.340767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:39.344633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0aa791d9-d2da-4621-b509-c7022a9804c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef7e8ce649e48538ceec1cbf79a216e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:39.346459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0aa791d9-d2da-4621-b509-c7022a9804c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef7e8ce649e48538ceec1cbf79a216e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:39.381858 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0aa791d9-d2da-4621-b509-c7022a9804c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef7e8ce649e48538ceec1cbf79a216e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:39.417279 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0aa791d9-d2da-4621-b509-c7022a9804c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef7e8ce649e48538ceec1cbf79a216e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:39.419824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:39.443196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0aa791d9-d2da-4621-b509-c7022a9804c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef7e8ce649e48538ceec1cbf79a216e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:39.465116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 825/1655] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:41:38 2022] DELETE /identity/v3/users/3ef7e8ce649e48538ceec1cbf79a216e => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:39.470412 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4014e9-28cc-46ff-aeba-95ba0551a108 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:39.471850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4014e9-28cc-46ff-aeba-95ba0551a108 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:39.473740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4014e9-28cc-46ff-aeba-95ba0551a108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:39.525205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2d4014e9-28cc-46ff-aeba-95ba0551a108 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:39.527918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2d4014e9-28cc-46ff-aeba-95ba0551a108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:39.528983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb448e8c-7ae5-4cc1-a0d3-71ef93255526 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:39.618353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:39.663692 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238d8d8-11a7-4388-b37a-a95bb0409f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:39.664431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238d8d8-11a7-4388-b37a-a95bb0409f63 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:39.664714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238d8d8-11a7-4388-b37a-a95bb0409f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:39.665015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238d8d8-11a7-4388-b37a-a95bb0409f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:39.670084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8238d8d8-11a7-4388-b37a-a95bb0409f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:39.715990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 826/1656] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:39.716757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238d8d8-11a7-4388-b37a-a95bb0409f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:39.718464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238d8d8-11a7-4388-b37a-a95bb0409f63 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:39.720380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f5372-2c0c-4c95-94fa-35f3935901a9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:39.722037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f5372-2c0c-4c95-94fa-35f3935901a9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:39.722954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f5372-2c0c-4c95-94fa-35f3935901a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:39.743524 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 831/1657] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:39.744929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901da55-0452-47ee-bc9f-2424e442fbbc None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:39.745218 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901da55-0452-47ee-bc9f-2424e442fbbc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:39.745497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901da55-0452-47ee-bc9f-2424e442fbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:39.767683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d97f5372-2c0c-4c95-94fa-35f3935901a9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:39.769179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d97f5372-2c0c-4c95-94fa-35f3935901a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:39.790299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e901da55-0452-47ee-bc9f-2424e442fbbc None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:39.793541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 827/1658] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:39.795215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e901da55-0452-47ee-bc9f-2424e442fbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:39.797882 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636fef2-09a7-4bc5-b7b3-6e029a7c3426 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:39.798170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636fef2-09a7-4bc5-b7b3-6e029a7c3426 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:39.798449 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636fef2-09a7-4bc5-b7b3-6e029a7c3426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:39.817534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 832/1659] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:39.821457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3f671-ab9c-475a-8a67-678a4b70783e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:39.821758 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3f671-ab9c-475a-8a67-678a4b70783e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:39.822041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3f671-ab9c-475a-8a67-678a4b70783e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:39.847231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f636fef2-09a7-4bc5-b7b3-6e029a7c3426 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:39.848444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f636fef2-09a7-4bc5-b7b3-6e029a7c3426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:39.858624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 828/1660] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:39.864051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636fef2-09a7-4bc5-b7b3-6e029a7c3426 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:39.874703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-07d3f671-ab9c-475a-8a67-678a4b70783e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:39.878098 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636fef2-09a7-4bc5-b7b3-6e029a7c3426 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:39.884929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bb348-4b47-43c6-bcbb-2a0c39cc9507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:39.885775 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bb348-4b47-43c6-bcbb-2a0c39cc9507 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:39.886174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bb348-4b47-43c6-bcbb-2a0c39cc9507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:39.886636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bb348-4b47-43c6-bcbb-2a0c39cc9507 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:39.887764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bb348-4b47-43c6-bcbb-2a0c39cc9507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:39.888229 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bb348-4b47-43c6-bcbb-2a0c39cc9507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:39.889943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bb348-4b47-43c6-bcbb-2a0c39cc9507 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:39.893673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-07d3f671-ab9c-475a-8a67-678a4b70783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:39.910628 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 829/1661] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:39.912590 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bb348-4b47-43c6-bcbb-2a0c39cc9507 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:39.921727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 833/1662] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:39.924868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3f671-ab9c-475a-8a67-678a4b70783e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:39.928468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-07d3f671-ab9c-475a-8a67-678a4b70783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:39.936325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bb348-4b47-43c6-bcbb-2a0c39cc9507 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:39.951868 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d25d9-e3f5-4e08-944f-1be0b870ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:39.952597 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d25d9-e3f5-4e08-944f-1be0b870ca66 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:39.952893 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d25d9-e3f5-4e08-944f-1be0b870ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:39.953492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d25d9-e3f5-4e08-944f-1be0b870ca66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:39.956042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d25d9-e3f5-4e08-944f-1be0b870ca66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:39.959763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d25d9-e3f5-4e08-944f-1be0b870ca66 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:39.967542 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3f671-ab9c-475a-8a67-678a4b70783e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:39.977337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7a045-68f4-47ac-accc-121d6ae48634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:39.978173 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7a045-68f4-47ac-accc-121d6ae48634 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:39.978465 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7a045-68f4-47ac-accc-121d6ae48634 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:39.980251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7a045-68f4-47ac-accc-121d6ae48634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:39.997127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7a045-68f4-47ac-accc-121d6ae48634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:39.999344 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7a045-68f4-47ac-accc-121d6ae48634 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:40.002364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 830/1663] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:39 2022] POST /identity/v3/projects => generated 405 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:40.007018 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d25d9-e3f5-4e08-944f-1be0b870ca66 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:40.015019 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 834/1664] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:40.016042 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7a045-68f4-47ac-accc-121d6ae48634 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:40.034795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7a045-68f4-47ac-accc-121d6ae48634 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:40.209638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d25d9-e3f5-4e08-944f-1be0b870ca66 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:40.223773 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f6a0d-99f0-40cb-b97b-9af49d1ee3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:40.225954 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f6a0d-99f0-40cb-b97b-9af49d1ee3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:40.226254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f6a0d-99f0-40cb-b97b-9af49d1ee3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:40.226573 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54511b57-e2c9-4062-8ec0-4f670224a4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:40.227342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54511b57-e2c9-4062-8ec0-4f670224a4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:40.227630 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54511b57-e2c9-4062-8ec0-4f670224a4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:40.227907 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54511b57-e2c9-4062-8ec0-4f670224a4d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:40.228484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f6a0d-99f0-40cb-b97b-9af49d1ee3aa admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:40.228654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54511b57-e2c9-4062-8ec0-4f670224a4d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:40.228944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54511b57-e2c9-4062-8ec0-4f670224a4d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:40.229220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f6a0d-99f0-40cb-b97b-9af49d1ee3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:40.231405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54511b57-e2c9-4062-8ec0-4f670224a4d4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:40.231545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f6a0d-99f0-40cb-b97b-9af49d1ee3aa admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:40.261780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 831/1665] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:40.263902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54511b57-e2c9-4062-8ec0-4f670224a4d4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:40.286473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54511b57-e2c9-4062-8ec0-4f670224a4d4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:40.304657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84979c-694c-4b39-9502-de52cc8f95b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:40.306523 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 835/1666] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:40 2022] POST /identity/v3/users => generated 303 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:40.309695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84979c-694c-4b39-9502-de52cc8f95b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:40.309988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84979c-694c-4b39-9502-de52cc8f95b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:40.310272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84979c-694c-4b39-9502-de52cc8f95b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:40.310944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f6a0d-99f0-40cb-b97b-9af49d1ee3aa admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:40.311068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84979c-694c-4b39-9502-de52cc8f95b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:40.317137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84979c-694c-4b39-9502-de52cc8f95b5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:40.334368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f6a0d-99f0-40cb-b97b-9af49d1ee3aa admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:40.350466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76c871-d5c5-4069-885c-22dd9307da2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:40.352235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76c871-d5c5-4069-885c-22dd9307da2f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:40.353888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76c871-d5c5-4069-885c-22dd9307da2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:40.354250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76c871-d5c5-4069-885c-22dd9307da2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:40.356461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76c871-d5c5-4069-885c-22dd9307da2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:40.362859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76c871-d5c5-4069-885c-22dd9307da2f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:40.400073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 832/1667] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:40 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:40.400777 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 836/1668] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:41:40.404718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84979c-694c-4b39-9502-de52cc8f95b5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:40.405852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76c871-d5c5-4069-885c-22dd9307da2f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:40.436107 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76c871-d5c5-4069-885c-22dd9307da2f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:40.456589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:40.590787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84979c-694c-4b39-9502-de52cc8f95b5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:40.608675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779ec71-33db-44ce-b1da-3ee61e7455a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:40.609533 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779ec71-33db-44ce-b1da-3ee61e7455a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:40.609827 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779ec71-33db-44ce-b1da-3ee61e7455a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:40.610105 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779ec71-33db-44ce-b1da-3ee61e7455a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:40.611009 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779ec71-33db-44ce-b1da-3ee61e7455a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:40.613486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb73707-a538-4f2d-98b3-7bb7afdd9391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:40.614029 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779ec71-33db-44ce-b1da-3ee61e7455a5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:40.615269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb73707-a538-4f2d-98b3-7bb7afdd9391 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:40.615591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb73707-a538-4f2d-98b3-7bb7afdd9391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:40.615886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb73707-a538-4f2d-98b3-7bb7afdd9391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:40.618492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb73707-a538-4f2d-98b3-7bb7afdd9391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:40.621357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb73707-a538-4f2d-98b3-7bb7afdd9391 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:40.657860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 837/1669] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:40.662014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb73707-a538-4f2d-98b3-7bb7afdd9391 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:40.685400 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 833/1670] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:40 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:41:40.686757 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779ec71-33db-44ce-b1da-3ee61e7455a5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:40.704146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb73707-a538-4f2d-98b3-7bb7afdd9391 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:40.716176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbfc92-abc5-4575-9a32-98e0ef64b963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:40.718195 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbfc92-abc5-4575-9a32-98e0ef64b963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:40.719019 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbfc92-abc5-4575-9a32-98e0ef64b963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:40.719519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbfc92-abc5-4575-9a32-98e0ef64b963 admin admin] PATH_INFO: `/v3/projects/0e9a30fb9e7e4a499ff5bb3a7f9b45a4/users/24a7f2d5c5f04f8390b82b139ae59156/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:40.730066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779ec71-33db-44ce-b1da-3ee61e7455a5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:40.754955 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90858b-a31a-4ae1-a1e1-9f94dfdfeb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:40.755781 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90858b-a31a-4ae1-a1e1-9f94dfdfeb3f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:40.756090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90858b-a31a-4ae1-a1e1-9f94dfdfeb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:40.756465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90858b-a31a-4ae1-a1e1-9f94dfdfeb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:40.757203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90858b-a31a-4ae1-a1e1-9f94dfdfeb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:40.760356 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90858b-a31a-4ae1-a1e1-9f94dfdfeb3f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:40.788995 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbfc92-abc5-4575-9a32-98e0ef64b963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9a30fb9e7e4a499ff5bb3a7f9b45a4, user_id=24a7f2d5c5f04f8390b82b139ae59156, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:40.792268 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbfc92-abc5-4575-9a32-98e0ef64b963 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:40.795026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 834/1671] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:40.802015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90858b-a31a-4ae1-a1e1-9f94dfdfeb3f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:40.809938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:40.823312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90858b-a31a-4ae1-a1e1-9f94dfdfeb3f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:40.824012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 838/1672] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:40 2022] PUT /identity/v3/projects/0e9a30fb9e7e4a499ff5bb3a7f9b45a4/users/24a7f2d5c5f04f8390b82b139ae59156/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:40.835959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01272759-46c9-4421-acbc-f70ff0a46131 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:40.837031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01272759-46c9-4421-acbc-f70ff0a46131 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:40.837772 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01272759-46c9-4421-acbc-f70ff0a46131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:40.871470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-01272759-46c9-4421-acbc-f70ff0a46131 None None] MFA Rules not processed for user `24a7f2d5c5f04f8390b82b139ae59156`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:40.872910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-01272759-46c9-4421-acbc-f70ff0a46131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:40.984212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39a3fb-95bf-4d67-aa2e-b620cb28d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:40.984212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39a3fb-95bf-4d67-aa2e-b620cb28d0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:40.984212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39a3fb-95bf-4d67-aa2e-b620cb28d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:40.984212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39a3fb-95bf-4d67-aa2e-b620cb28d0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:40.984584 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39a3fb-95bf-4d67-aa2e-b620cb28d0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:40.985817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39a3fb-95bf-4d67-aa2e-b620cb28d0d4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:41.026962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 839/1673] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:41.027725 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 835/1674] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:41.027801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01272759-46c9-4421-acbc-f70ff0a46131 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:41.028171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39a3fb-95bf-4d67-aa2e-b620cb28d0d4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:41.054550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01272759-46c9-4421-acbc-f70ff0a46131 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:41.055879 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39a3fb-95bf-4d67-aa2e-b620cb28d0d4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:41.059867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ca126-7fb7-40e1-9e16-5cff28e05dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:41.061197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ca126-7fb7-40e1-9e16-5cff28e05dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:41.061871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ca126-7fb7-40e1-9e16-5cff28e05dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:41.061976 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ca126-7fb7-40e1-9e16-5cff28e05dfc admin admin] PATH_INFO: `/v3/projects/9a272c59182b4448bcb243bdb264f25c/users/3391ba3e64124dff890ab86b68cda6fd/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:41.068724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1fa55-15ba-46ca-8cad-ca8440401ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:41.069819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1fa55-15ba-46ca-8cad-ca8440401ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:41.069819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1fa55-15ba-46ca-8cad-ca8440401ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:41.069995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1fa55-15ba-46ca-8cad-ca8440401ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:41.070618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1fa55-15ba-46ca-8cad-ca8440401ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:41.072544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1fa55-15ba-46ca-8cad-ca8440401ef0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:41.078605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ca126-7fb7-40e1-9e16-5cff28e05dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a272c59182b4448bcb243bdb264f25c, user_id=3391ba3e64124dff890ab86b68cda6fd, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:41.082012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ca126-7fb7-40e1-9e16-5cff28e05dfc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:41.112734 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 840/1675] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:41 2022] PUT /identity/v3/projects/9a272c59182b4448bcb243bdb264f25c/users/3391ba3e64124dff890ab86b68cda6fd/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:41.124865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b78392-e95c-4dfc-876c-fcd3c4655c18 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:41.132681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b78392-e95c-4dfc-876c-fcd3c4655c18 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:41.133292 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b78392-e95c-4dfc-876c-fcd3c4655c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:41.168875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 836/1676] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:41 2022] POST /identity/v3/projects => generated 405 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:41:41.172865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1fa55-15ba-46ca-8cad-ca8440401ef0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:41.195571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-07b78392-e95c-4dfc-876c-fcd3c4655c18 None None] MFA Rules not processed for user `3391ba3e64124dff890ab86b68cda6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:41.198126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-07b78392-e95c-4dfc-876c-fcd3c4655c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:41.314354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1fa55-15ba-46ca-8cad-ca8440401ef0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:41.326579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 841/1677] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:41.332302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b78392-e95c-4dfc-876c-fcd3c4655c18 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:41.333804 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf7962-5358-4ee0-9ba0-2545622896f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:41.334511 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf7962-5358-4ee0-9ba0-2545622896f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:41.335132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf7962-5358-4ee0-9ba0-2545622896f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:41.335132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf7962-5358-4ee0-9ba0-2545622896f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:41.335792 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf7962-5358-4ee0-9ba0-2545622896f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:41.337772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf7962-5358-4ee0-9ba0-2545622896f4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:41.360924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b78392-e95c-4dfc-876c-fcd3c4655c18 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:41.364406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:41.371093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6d081-2327-4a61-8a81-635058b49f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:41.372165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6d081-2327-4a61-8a81-635058b49f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:41.372895 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6d081-2327-4a61-8a81-635058b49f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:41.373315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6d081-2327-4a61-8a81-635058b49f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:41.375202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6d081-2327-4a61-8a81-635058b49f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:41.380050 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6d081-2327-4a61-8a81-635058b49f8f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:41.386638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 837/1678] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:41 2022] POST /identity/v3/users => generated 309 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:41:41.391843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf7962-5358-4ee0-9ba0-2545622896f4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:41.415687 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf7962-5358-4ee0-9ba0-2545622896f4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:41.421950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e74ff-a475-47b9-ae34-2b60477be555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:41.422643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e74ff-a475-47b9-ae34-2b60477be555 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:41.422929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e74ff-a475-47b9-ae34-2b60477be555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:41.423278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e74ff-a475-47b9-ae34-2b60477be555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:41.424043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e74ff-a475-47b9-ae34-2b60477be555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:41.428850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 842/1679] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:41 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:41.432422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e74ff-a475-47b9-ae34-2b60477be555 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:41.432995 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6d081-2327-4a61-8a81-635058b49f8f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:41.462319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 838/1680] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:41.466120 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e74ff-a475-47b9-ae34-2b60477be555 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:41.481948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e74ff-a475-47b9-ae34-2b60477be555 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:41.522684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:41.603495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6d081-2327-4a61-8a81-635058b49f8f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:41.614726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b6dc6-d4ab-49f4-9dc5-9e69b07774c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:41.617387 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b6dc6-d4ab-49f4-9dc5-9e69b07774c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:41.617685 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b6dc6-d4ab-49f4-9dc5-9e69b07774c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:41.617971 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b6dc6-d4ab-49f4-9dc5-9e69b07774c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:41.618921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ff263-5e7f-468b-a6da-820802765203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:41.619848 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ff263-5e7f-468b-a6da-820802765203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:41.620131 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ff263-5e7f-468b-a6da-820802765203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:41.620407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ff263-5e7f-468b-a6da-820802765203 admin admin] PATH_INFO: `/v3/projects/6d66e511e7054af2aa59c3dedae97907/users/8029fbe5f92e4eff810c15f737fad729/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:41.621145 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b6dc6-d4ab-49f4-9dc5-9e69b07774c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:41.624812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b6dc6-d4ab-49f4-9dc5-9e69b07774c8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:41.657918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ff263-5e7f-468b-a6da-820802765203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d66e511e7054af2aa59c3dedae97907, user_id=8029fbe5f92e4eff810c15f737fad729, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:41.660706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ff263-5e7f-468b-a6da-820802765203 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:41.670307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 843/1681] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:41 2022] POST /identity/v3/users => generated 296 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:41.676092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b6dc6-d4ab-49f4-9dc5-9e69b07774c8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:41.694395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 839/1682] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:41 2022] PUT /identity/v3/projects/6d66e511e7054af2aa59c3dedae97907/users/8029fbe5f92e4eff810c15f737fad729/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:41:41.698094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ff263-5e7f-468b-a6da-820802765203 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:41.705534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b6dc6-d4ab-49f4-9dc5-9e69b07774c8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:41.827544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ff263-5e7f-468b-a6da-820802765203 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:41.846058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e66dc2-168a-4711-99d9-5af1f146619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:41.847757 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e66dc2-168a-4711-99d9-5af1f146619f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:41.848122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e66dc2-168a-4711-99d9-5af1f146619f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:41.848468 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e66dc2-168a-4711-99d9-5af1f146619f admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:41.849214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e66dc2-168a-4711-99d9-5af1f146619f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:41.850947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e66dc2-168a-4711-99d9-5af1f146619f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:41.878388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ab688-1bfa-4b74-ab92-6447908a1309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:41.882841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ab688-1bfa-4b74-ab92-6447908a1309 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:41.883254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ab688-1bfa-4b74-ab92-6447908a1309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:41.884057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 840/1683] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:41:41.884712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ab688-1bfa-4b74-ab92-6447908a1309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:41.887358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ab688-1bfa-4b74-ab92-6447908a1309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:41.889583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e66dc2-168a-4711-99d9-5af1f146619f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:41.891812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ab688-1bfa-4b74-ab92-6447908a1309 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:41.912877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e66dc2-168a-4711-99d9-5af1f146619f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:41.924883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b209b5-057b-4f0b-b099-18d584c275e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:41.925647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b209b5-057b-4f0b-b099-18d584c275e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:41.925932 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b209b5-057b-4f0b-b099-18d584c275e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:41.926198 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b209b5-057b-4f0b-b099-18d584c275e8 admin admin] PATH_INFO: `/v3/projects/6d66e511e7054af2aa59c3dedae97907/users/8029fbe5f92e4eff810c15f737fad729/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:41.940214 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 844/1684] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:41.942560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b209b5-057b-4f0b-b099-18d584c275e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d66e511e7054af2aa59c3dedae97907, user_id=8029fbe5f92e4eff810c15f737fad729, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:41.944406 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ab688-1bfa-4b74-ab92-6447908a1309 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:41.945350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b209b5-057b-4f0b-b099-18d584c275e8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:41.973245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ab688-1bfa-4b74-ab92-6447908a1309 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:41.982433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 841/1685] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:41 2022] PUT /identity/v3/projects/6d66e511e7054af2aa59c3dedae97907/users/8029fbe5f92e4eff810c15f737fad729/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:42.000821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565418f9-2b5d-4814-9fa9-064f29fe8dc4 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:42.001157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565418f9-2b5d-4814-9fa9-064f29fe8dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:42.001440 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565418f9-2b5d-4814-9fa9-064f29fe8dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:42.102648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-565418f9-2b5d-4814-9fa9-064f29fe8dc4 None None] MFA Rules not processed for user `8029fbe5f92e4eff810c15f737fad729`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:42.103973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-565418f9-2b5d-4814-9fa9-064f29fe8dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:42.144893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796c77-829d-445b-ae3d-0869b043ad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:42.147487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796c77-829d-445b-ae3d-0869b043ad2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:42.147876 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796c77-829d-445b-ae3d-0869b043ad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:42.148257 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796c77-829d-445b-ae3d-0869b043ad2d admin admin] PATH_INFO: `/v3/projects/a6bf361d22864712a1a2f6c843116b80/users/0873c75f48094f478b12c57b10e643ea/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:42.183934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee796c77-829d-445b-ae3d-0869b043ad2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6bf361d22864712a1a2f6c843116b80, user_id=0873c75f48094f478b12c57b10e643ea, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:42.190793 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee796c77-829d-445b-ae3d-0869b043ad2d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:42.211090 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 845/1686] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:41 2022] PUT /identity/v3/projects/a6bf361d22864712a1a2f6c843116b80/users/0873c75f48094f478b12c57b10e643ea/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:42.213258 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:42.214450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796c77-829d-445b-ae3d-0869b043ad2d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:42.239682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ee796c77-829d-445b-ae3d-0869b043ad2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:42.349469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 842/1687] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:41 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:42.353608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565418f9-2b5d-4814-9fa9-064f29fe8dc4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:42.359326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-565418f9-2b5d-4814-9fa9-064f29fe8dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:42.376506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:42.396434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565418f9-2b5d-4814-9fa9-064f29fe8dc4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:42.417815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796c77-829d-445b-ae3d-0869b043ad2d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:42.427887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:42.428943 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:42.429302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:42.430144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] PATH_INFO: `/v3/projects/2da784fec24a42048c6e039b88e55e8f` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:42.441496 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da784fec24a42048c6e039b88e55e8f)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:42.464030 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:42.591673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:42.592566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:42.592849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:42.593125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] PATH_INFO: `/v3/projects/3a43f7696d634326bb3cc176c9245c5d` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:42.594410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a43f7696d634326bb3cc176c9245c5d)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:42.595644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 20:41:42.595644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: warnings.warn(msg) Jul 06 20:41:42.595644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: Jul 06 20:41:42.597493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:42.606208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da784fec24a42048c6e039b88e55e8f', 'request_id': 'req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:42.621488 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da784fec24a42048c6e039b88e55e8f', 'request_id': 'req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:42.640835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da784fec24a42048c6e039b88e55e8f', 'request_id': 'req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:42.689142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] The token cache is being invalidate because project 2da784fec24a42048c6e039b88e55e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:41:42.691082 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:42.692045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:42.698479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 846/1688] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:41:42 2022] DELETE /identity/v3/projects/2da784fec24a42048c6e039b88e55e8f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:42.698479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:42.698479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:42.759537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a43f7696d634326bb3cc176c9245c5d', 'request_id': 'req-bf4e703b-27cf-48c9-b38a-1280650a6291'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:42.789018 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a43f7696d634326bb3cc176c9245c5d', 'request_id': 'req-bf4e703b-27cf-48c9-b38a-1280650a6291'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:42.807484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a43f7696d634326bb3cc176c9245c5d', 'request_id': 'req-bf4e703b-27cf-48c9-b38a-1280650a6291'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:42.893591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe73b0-3bad-4854-bcaa-caf7f59f9635 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:42.934200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] The token cache is being invalidate because project 3a43f7696d634326bb3cc176c9245c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:41:42.935326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:42.936458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:42.950839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 843/1689] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:41:42 2022] DELETE /identity/v3/projects/3a43f7696d634326bb3cc176c9245c5d => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:42.952214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:42.957203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:43.101738 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6873d47-9055-4fd2-9edb-acd22ad1ff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:43.101978 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873d47-9055-4fd2-9edb-acd22ad1ff00 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.102371 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873d47-9055-4fd2-9edb-acd22ad1ff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.102814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873d47-9055-4fd2-9edb-acd22ad1ff00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.103848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6873d47-9055-4fd2-9edb-acd22ad1ff00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:43.106047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6873d47-9055-4fd2-9edb-acd22ad1ff00 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:43.127722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 847/1690] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:43.132745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9755f96-f4f4-473c-9f07-bf9cb771b739 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.133165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9755f96-f4f4-473c-9f07-bf9cb771b739 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.133517 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9755f96-f4f4-473c-9f07-bf9cb771b739 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.144434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 848/1691] 10.222.0.33 () {54 vars in 960 bytes} [Wed Jul 6 20:41:43 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:41:43.146389 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a979-1d0d-407b-af51-37154352d1bd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.146748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a979-1d0d-407b-af51-37154352d1bd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.147495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a979-1d0d-407b-af51-37154352d1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.157051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e703b-27cf-48c9-b38a-1280650a6291 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:43.168966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239eed4-8f5e-49ca-a61a-0234c3e987c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:43.171406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239eed4-8f5e-49ca-a61a-0234c3e987c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.172863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239eed4-8f5e-49ca-a61a-0234c3e987c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.173362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239eed4-8f5e-49ca-a61a-0234c3e987c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.183789 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a239eed4-8f5e-49ca-a61a-0234c3e987c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:43.184330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5d79a979-1d0d-407b-af51-37154352d1bd None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:43.185748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5d79a979-1d0d-407b-af51-37154352d1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:43.211603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 849/1692] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:43.211603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79a979-1d0d-407b-af51-37154352d1bd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:43.211603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5d79a979-1d0d-407b-af51-37154352d1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:43.239548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79a979-1d0d-407b-af51-37154352d1bd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:43.256594 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:43.261449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a0ea8-7316-4d18-a040-b045f362e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:43.265951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a0ea8-7316-4d18-a040-b045f362e952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.266247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a0ea8-7316-4d18-a040-b045f362e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.266647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a0ea8-7316-4d18-a040-b045f362e952 admin admin] PATH_INFO: `/v3/users/6e385494b5914b19a78f8d9a48260fcc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.271094 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a0ea8-7316-4d18-a040-b045f362e952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e385494b5914b19a78f8d9a48260fcc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:43.276649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a0ea8-7316-4d18-a040-b045f362e952 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:43.280499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:43.372567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239eed4-8f5e-49ca-a61a-0234c3e987c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:43.374122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239eed4-8f5e-49ca-a61a-0234c3e987c4 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:43.381635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b31a0ea8-7316-4d18-a040-b045f362e952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e385494b5914b19a78f8d9a48260fcc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:43.387422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 844/1693] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:42 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:43.388937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdc5b9-364b-4f32-8d64-3989be70a7e2 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.389183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdc5b9-364b-4f32-8d64-3989be70a7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.389596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdc5b9-364b-4f32-8d64-3989be70a7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.405968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b31a0ea8-7316-4d18-a040-b045f362e952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e385494b5914b19a78f8d9a48260fcc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:43.416039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b31a0ea8-7316-4d18-a040-b045f362e952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e385494b5914b19a78f8d9a48260fcc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:43.417075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b31a0ea8-7316-4d18-a040-b045f362e952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e385494b5914b19a78f8d9a48260fcc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:43.425960 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-bdcdc5b9-364b-4f32-8d64-3989be70a7e2 None None] MFA Rules not processed for user `fb6987f34f174552bab9495f3d50ee45`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:43.427219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-bdcdc5b9-364b-4f32-8d64-3989be70a7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:43.445684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b31a0ea8-7316-4d18-a040-b045f362e952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e385494b5914b19a78f8d9a48260fcc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:43.472469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 850/1694] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:41:43 2022] DELETE /identity/v3/users/6e385494b5914b19a78f8d9a48260fcc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:43.474202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a0a86-6ba6-482f-8aae-5b784389a446 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.474766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a0a86-6ba6-482f-8aae-5b784389a446 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.474766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a0a86-6ba6-482f-8aae-5b784389a446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.496272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7c5a0a86-6ba6-482f-8aae-5b784389a446 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:43.497990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7c5a0a86-6ba6-482f-8aae-5b784389a446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:43.521481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 845/1695] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:43.521481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdc5b9-364b-4f32-8d64-3989be70a7e2 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:43.525128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-bdcdc5b9-364b-4f32-8d64-3989be70a7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:43.551054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdc5b9-364b-4f32-8d64-3989be70a7e2 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:43.618200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d7e72-678a-46f9-b9be-f3fa8123505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:43.619127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d7e72-678a-46f9-b9be-f3fa8123505a admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.619453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d7e72-678a-46f9-b9be-f3fa8123505a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.619732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d7e72-678a-46f9-b9be-f3fa8123505a admin admin] PATH_INFO: `/v3/projects/a6bf361d22864712a1a2f6c843116b80/users/0873c75f48094f478b12c57b10e643ea/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.623658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 851/1696] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:43.625513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d60ac-24bc-4846-ad39-6cc01df73f85 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.626083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d60ac-24bc-4846-ad39-6cc01df73f85 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.627491 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d60ac-24bc-4846-ad39-6cc01df73f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.628491 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d7e72-678a-46f9-b9be-f3fa8123505a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6bf361d22864712a1a2f6c843116b80, user_id=0873c75f48094f478b12c57b10e643ea, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:43.632501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d7e72-678a-46f9-b9be-f3fa8123505a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:43.653233 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7b2d60ac-24bc-4846-ad39-6cc01df73f85 None None] MFA Rules not processed for user `b98059ebef5d470db684fb78d19a8839`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:43.654630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7b2d60ac-24bc-4846-ad39-6cc01df73f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:43.656990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 846/1697] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:43 2022] PUT /identity/v3/projects/a6bf361d22864712a1a2f6c843116b80/users/0873c75f48094f478b12c57b10e643ea/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:43.658817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf9c03-dcc6-4303-827d-06886aed6701 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.659528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf9c03-dcc6-4303-827d-06886aed6701 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.660034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf9c03-dcc6-4303-827d-06886aed6701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.693724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-09cf9c03-dcc6-4303-827d-06886aed6701 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:43.696224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-09cf9c03-dcc6-4303-827d-06886aed6701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:43.742732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:43.762201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 852/1698] 10.222.0.33 () {58 vars in 1057 bytes} [Wed Jul 6 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:43.763934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16266987-bb4c-4a65-b454-977519144460 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.764232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16266987-bb4c-4a65-b454-977519144460 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.764515 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16266987-bb4c-4a65-b454-977519144460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.781446 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 847/1699] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:43.783452 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f425-2f72-4ee5-971d-b294c623dfc1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.784803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f425-2f72-4ee5-971d-b294c623dfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.785321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f425-2f72-4ee5-971d-b294c623dfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.796293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-16266987-bb4c-4a65-b454-977519144460 None None] MFA Rules not processed for user `e651c2917c75425fb656dfb145a5bc4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:43.798215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-16266987-bb4c-4a65-b454-977519144460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:43.805916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:43.882315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 853/1700] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:43.891082 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16266987-bb4c-4a65-b454-977519144460 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:43.892745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-16266987-bb4c-4a65-b454-977519144460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:43.947746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-44b8f425-2f72-4ee5-971d-b294c623dfc1 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:43.948971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-44b8f425-2f72-4ee5-971d-b294c623dfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:43.957282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 848/1701] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:43.958560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2fd16-b7ff-420a-b769-0ee947487bc1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.958842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2fd16-b7ff-420a-b769-0ee947487bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.959650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2fd16-b7ff-420a-b769-0ee947487bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.981547 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3be2fd16-b7ff-420a-b769-0ee947487bc1 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:43.982372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16266987-bb4c-4a65-b454-977519144460 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:43.983161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3be2fd16-b7ff-420a-b769-0ee947487bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:43.988722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc3091-deb9-4d22-b8d1-8d664aaf9ffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:43.989385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc3091-deb9-4d22-b8d1-8d664aaf9ffb service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:43.989681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc3091-deb9-4d22-b8d1-8d664aaf9ffb service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:43.989950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc3091-deb9-4d22-b8d1-8d664aaf9ffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:43.993711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 849/1702] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:43.997749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2fd16-b7ff-420a-b769-0ee947487bc1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:43.999261 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3be2fd16-b7ff-420a-b769-0ee947487bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:44.011638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2fd16-b7ff-420a-b769-0ee947487bc1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:44.016702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:44.018207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:44.018564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:44.018906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] PATH_INFO: `/v3/users/24a7f2d5c5f04f8390b82b139ae59156` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:44.020263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a7f2d5c5f04f8390b82b139ae59156)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:44.022512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:44.058208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc3091-deb9-4d22-b8d1-8d664aaf9ffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:44.060036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc3091-deb9-4d22-b8d1-8d664aaf9ffb service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:44.070043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 854/1703] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:44.071364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b7f9f-490e-4722-9da3-5619113dbf86 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:44.071658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b7f9f-490e-4722-9da3-5619113dbf86 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:44.071939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b7f9f-490e-4722-9da3-5619113dbf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:44.079201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a7f2d5c5f04f8390b82b139ae59156'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:44.080420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a7f2d5c5f04f8390b82b139ae59156'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:44.104063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a7f2d5c5f04f8390b82b139ae59156'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:44.109896 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5a1b7f9f-490e-4722-9da3-5619113dbf86 None None] MFA Rules not processed for user `0873c75f48094f478b12c57b10e643ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:44.111450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5a1b7f9f-490e-4722-9da3-5619113dbf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:44.124600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a7f2d5c5f04f8390b82b139ae59156'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:44.138662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a7f2d5c5f04f8390b82b139ae59156'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:44.149552 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 850/1704] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:41:43 2022] DELETE /identity/v3/users/24a7f2d5c5f04f8390b82b139ae59156 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:44.153304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:44.153304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:44.173296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:44.216248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 855/1705] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:44.217583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b7f9f-490e-4722-9da3-5619113dbf86 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:44.227788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5a1b7f9f-490e-4722-9da3-5619113dbf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:44.245383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b7f9f-490e-4722-9da3-5619113dbf86 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:44.254312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e185f-d7ae-4152-a0fc-dfae0f4b731f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:44.261189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5d47c-8620-40a6-a641-5215c070baa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98059ebef5d470db684fb78d19a8839', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:44.261908 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5d47c-8620-40a6-a641-5215c070baa7 service placement] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:44.262193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5d47c-8620-40a6-a641-5215c070baa7 service placement] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:44.262468 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5d47c-8620-40a6-a641-5215c070baa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:44.264332 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-27e5d47c-8620-40a6-a641-5215c070baa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:44.279200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5d47c-8620-40a6-a641-5215c070baa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:44.282133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5d47c-8620-40a6-a641-5215c070baa7 service placement] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:44.296520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 851/1706] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:44.297295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5d47c-8620-40a6-a641-5215c070baa7 service placement] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:44.299360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-27e5d47c-8620-40a6-a641-5215c070baa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:44.320281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0b83b-350d-4d7c-ba09-3877e3bee002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:44.320968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0b83b-350d-4d7c-ba09-3877e3bee002 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:44.321256 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0b83b-350d-4d7c-ba09-3877e3bee002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:44.321579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0b83b-350d-4d7c-ba09-3877e3bee002 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:44.322427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0b83b-350d-4d7c-ba09-3877e3bee002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:44.322746 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0b83b-350d-4d7c-ba09-3877e3bee002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:44.324418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0b83b-350d-4d7c-ba09-3877e3bee002 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:44.338453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:44.347528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 856/1707] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:44.348813 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0b83b-350d-4d7c-ba09-3877e3bee002 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:44.355138 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-91c0b83b-350d-4d7c-ba09-3877e3bee002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:44.419211 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5d47c-8620-40a6-a641-5215c070baa7 service placement] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:44.441204 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd30359-c327-42f0-a241-5c081b6ba459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:44.441891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd30359-c327-42f0-a241-5c081b6ba459 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:44.442225 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd30359-c327-42f0-a241-5c081b6ba459 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:44.442514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd30359-c327-42f0-a241-5c081b6ba459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:44.445081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5fd30359-c327-42f0-a241-5c081b6ba459 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:44.478794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0b83b-350d-4d7c-ba09-3877e3bee002 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:44.487959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36326692-758e-4679-871f-d2c1b20f6f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:44.489063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36326692-758e-4679-871f-d2c1b20f6f86 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:44.489553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36326692-758e-4679-871f-d2c1b20f6f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:44.490238 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36326692-758e-4679-871f-d2c1b20f6f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:44.493000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-36326692-758e-4679-871f-d2c1b20f6f86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:44.514572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36326692-758e-4679-871f-d2c1b20f6f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:44.516374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36326692-758e-4679-871f-d2c1b20f6f86 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:44.532852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 857/1708] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:44.534340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36326692-758e-4679-871f-d2c1b20f6f86 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:44.536232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-36326692-758e-4679-871f-d2c1b20f6f86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:44.554130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36326692-758e-4679-871f-d2c1b20f6f86 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:44.564878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c809d16-87a4-4c1b-986a-3b54e968142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:44.564878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c809d16-87a4-4c1b-986a-3b54e968142c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:44.564878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c809d16-87a4-4c1b-986a-3b54e968142c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:44.564878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c809d16-87a4-4c1b-986a-3b54e968142c admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:44.565480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c809d16-87a4-4c1b-986a-3b54e968142c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:44.565896 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c809d16-87a4-4c1b-986a-3b54e968142c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:44.568483 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c809d16-87a4-4c1b-986a-3b54e968142c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:44.592758 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 858/1709] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:44.594324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108714c-b875-48a2-a067-0896b21d9979 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:44.594754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108714c-b875-48a2-a067-0896b21d9979 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:44.595185 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108714c-b875-48a2-a067-0896b21d9979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:44.610778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd30359-c327-42f0-a241-5c081b6ba459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:44.613069 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd30359-c327-42f0-a241-5c081b6ba459 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:44.623135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9108714c-b875-48a2-a067-0896b21d9979 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:44.624646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9108714c-b875-48a2-a067-0896b21d9979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:44.634817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 859/1710] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:44.635961 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108714c-b875-48a2-a067-0896b21d9979 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:44.645540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9108714c-b875-48a2-a067-0896b21d9979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:44.647716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 852/1711] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:44.649127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd30359-c327-42f0-a241-5c081b6ba459 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:44.673485 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd30359-c327-42f0-a241-5c081b6ba459 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:44.689512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0ed05-0600-4d71-9347-a0efa0b0bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:44.690679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ed05-0600-4d71-9347-a0efa0b0bbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:44.691025 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ed05-0600-4d71-9347-a0efa0b0bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:44.691357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0ed05-0600-4d71-9347-a0efa0b0bbc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:44.692059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0ed05-0600-4d71-9347-a0efa0b0bbc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:44.696251 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0ed05-0600-4d71-9347-a0efa0b0bbc1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:44.750744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 853/1712] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:44 2022] POST /identity/v3/projects => generated 357 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:44.751759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0ed05-0600-4d71-9347-a0efa0b0bbc1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:44.787890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:44.800278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108714c-b875-48a2-a067-0896b21d9979 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:44.993253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0ed05-0600-4d71-9347-a0efa0b0bbc1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:44.998319 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9ac4c-b23a-45ce-9f01-2654e74cd4d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:45.003796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9ac4c-b23a-45ce-9f01-2654e74cd4d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.004250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9ac4c-b23a-45ce-9f01-2654e74cd4d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.004816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9ac4c-b23a-45ce-9f01-2654e74cd4d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.009016 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e9946-8d2a-44d5-89a2-43e920f15767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:45.010249 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e9946-8d2a-44d5-89a2-43e920f15767 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.010627 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e9946-8d2a-44d5-89a2-43e920f15767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.014083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e9946-8d2a-44d5-89a2-43e920f15767 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.015127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e9946-8d2a-44d5-89a2-43e920f15767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:45.017292 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e9946-8d2a-44d5-89a2-43e920f15767 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:45.084125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 854/1713] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:44 2022] POST /identity/v3/projects => generated 369 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:45.085582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e9946-8d2a-44d5-89a2-43e920f15767 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:45.088734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ed1e9946-8d2a-44d5-89a2-43e920f15767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:45.146320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:45.184564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e9946-8d2a-44d5-89a2-43e920f15767 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:45.190715 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed153ff0-816c-4860-82f8-49cf44157fbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:45.191724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153ff0-816c-4860-82f8-49cf44157fbe service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.192107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153ff0-816c-4860-82f8-49cf44157fbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.193343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153ff0-816c-4860-82f8-49cf44157fbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.243428 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9ac4c-b23a-45ce-9f01-2654e74cd4d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:45.250768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9ac4c-b23a-45ce-9f01-2654e74cd4d0 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:45.285542 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 860/1714] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:45.286484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9ac4c-b23a-45ce-9f01-2654e74cd4d0 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:45.310854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9ac4c-b23a-45ce-9f01-2654e74cd4d0 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:45.312530 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed153ff0-816c-4860-82f8-49cf44157fbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:45.313896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed153ff0-816c-4860-82f8-49cf44157fbe service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:45.331379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 855/1715] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:45.341549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed153ff0-816c-4860-82f8-49cf44157fbe service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:45.343900 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744de20f-c378-4576-a4ef-3478cb9de605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:45.344923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744de20f-c378-4576-a4ef-3478cb9de605 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.345736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744de20f-c378-4576-a4ef-3478cb9de605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.346186 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744de20f-c378-4576-a4ef-3478cb9de605 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.350794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744de20f-c378-4576-a4ef-3478cb9de605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:45.355436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed153ff0-816c-4860-82f8-49cf44157fbe service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:45.356460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744de20f-c378-4576-a4ef-3478cb9de605 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:45.363493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fa739-fd1c-4c9a-8a32-bce08ae06d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:45.364328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fa739-fd1c-4c9a-8a32-bce08ae06d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.365082 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fa739-fd1c-4c9a-8a32-bce08ae06d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.365492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fa739-fd1c-4c9a-8a32-bce08ae06d8f admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.366487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fa739-fd1c-4c9a-8a32-bce08ae06d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:45.369722 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fa739-fd1c-4c9a-8a32-bce08ae06d8f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:45.425440 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 856/1716] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:45 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:45.432853 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fa739-fd1c-4c9a-8a32-bce08ae06d8f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:45.445830 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 861/1717] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:45 2022] POST /identity/v3/users => generated 279 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:45.447690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744de20f-c378-4576-a4ef-3478cb9de605 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:45.449662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fa739-fd1c-4c9a-8a32-bce08ae06d8f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:45.457868 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5917d-201a-4ea0-ae00-dba3f990f1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:45.458803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5917d-201a-4ea0-ae00-dba3f990f1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.459425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5917d-201a-4ea0-ae00-dba3f990f1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.459973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5917d-201a-4ea0-ae00-dba3f990f1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.461297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5917d-201a-4ea0-ae00-dba3f990f1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:45.466512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5917d-201a-4ea0-ae00-dba3f990f1b1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:45.485174 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744de20f-c378-4576-a4ef-3478cb9de605 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:45.503428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 857/1718] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:45.506410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5917d-201a-4ea0-ae00-dba3f990f1b1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:45.537282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606544a-b67d-47a0-b182-b91786aa0ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:45.538260 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606544a-b67d-47a0-b182-b91786aa0ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.538260 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606544a-b67d-47a0-b182-b91786aa0ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.539285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606544a-b67d-47a0-b182-b91786aa0ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.540042 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606544a-b67d-47a0-b182-b91786aa0ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:45.554001 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606544a-b67d-47a0-b182-b91786aa0ae4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:45.586340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5917d-201a-4ea0-ae00-dba3f990f1b1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:45.594525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c84db6-6516-4a5c-91dc-6d47df7656a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:45.594701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 862/1719] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:45.594787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c84db6-6516-4a5c-91dc-6d47df7656a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.594787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c84db6-6516-4a5c-91dc-6d47df7656a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.594787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c84db6-6516-4a5c-91dc-6d47df7656a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.597193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f8c84db6-6516-4a5c-91dc-6d47df7656a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:45.602526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606544a-b67d-47a0-b182-b91786aa0ae4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:45.652083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606544a-b67d-47a0-b182-b91786aa0ae4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:45.672915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76b649-f69a-4f44-b67d-00808433e82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:45.673803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76b649-f69a-4f44-b67d-00808433e82d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.674094 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76b649-f69a-4f44-b67d-00808433e82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.674366 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76b649-f69a-4f44-b67d-00808433e82d admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.678155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76b649-f69a-4f44-b67d-00808433e82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:45.681315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76b649-f69a-4f44-b67d-00808433e82d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:45.689087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c84db6-6516-4a5c-91dc-6d47df7656a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:45.692133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c84db6-6516-4a5c-91dc-6d47df7656a9 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:45.712665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 858/1720] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:45.713752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c84db6-6516-4a5c-91dc-6d47df7656a9 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:45.723638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:45.732394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c84db6-6516-4a5c-91dc-6d47df7656a9 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:45.742097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 863/1721] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:45.745736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9402398-e169-4373-b691-b1ec38b45382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:45.746738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9402398-e169-4373-b691-b1ec38b45382 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.747773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9402398-e169-4373-b691-b1ec38b45382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.748925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9402398-e169-4373-b691-b1ec38b45382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.749909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9402398-e169-4373-b691-b1ec38b45382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:45.750639 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76b649-f69a-4f44-b67d-00808433e82d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:45.754642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9402398-e169-4373-b691-b1ec38b45382 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:45.774711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 859/1722] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:45.777455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76b649-f69a-4f44-b67d-00808433e82d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:45.779926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9402398-e169-4373-b691-b1ec38b45382 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:45.795456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ca618-88bd-4309-af59-a6df996c9aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:45.796469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ca618-88bd-4309-af59-a6df996c9aab admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.796822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ca618-88bd-4309-af59-a6df996c9aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.798037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ca618-88bd-4309-af59-a6df996c9aab admin admin] PATH_INFO: `/v3/projects/dcf8563c84774b5381fbdd20c49c6253/users/e59410be6b2a403da20014aa38bd27f3/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.805072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9402398-e169-4373-b691-b1ec38b45382 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:45.827575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1a030-93f5-4732-a199-3f2f15d62a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:45.827575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1a030-93f5-4732-a199-3f2f15d62a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.827575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1a030-93f5-4732-a199-3f2f15d62a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.827575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1a030-93f5-4732-a199-3f2f15d62a38 admin admin] PATH_INFO: `/v3/projects/12637fa1b1034406a06bcf4f19270928/users/26b3b11c616f42089633b8e8db3b08e8/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.853853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ca618-88bd-4309-af59-a6df996c9aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf8563c84774b5381fbdd20c49c6253, user_id=e59410be6b2a403da20014aa38bd27f3, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:45.856585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ca618-88bd-4309-af59-a6df996c9aab admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:45.890994 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1a030-93f5-4732-a199-3f2f15d62a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12637fa1b1034406a06bcf4f19270928, user_id=26b3b11c616f42089633b8e8db3b08e8, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:45.892810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 864/1723] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:45 2022] PUT /identity/v3/projects/dcf8563c84774b5381fbdd20c49c6253/users/e59410be6b2a403da20014aa38bd27f3/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:41:45.894103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1a030-93f5-4732-a199-3f2f15d62a38 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:45.903326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef009a-15e8-41b2-83ed-d4045657c5e2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.903626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef009a-15e8-41b2-83ed-d4045657c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.903940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef009a-15e8-41b2-83ed-d4045657c5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.947067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 860/1724] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:45 2022] PUT /identity/v3/projects/12637fa1b1034406a06bcf4f19270928/users/26b3b11c616f42089633b8e8db3b08e8/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:45.965467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35979b-e5dc-46fe-a242-8ff28d73377f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:45.965724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35979b-e5dc-46fe-a242-8ff28d73377f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:45.966145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35979b-e5dc-46fe-a242-8ff28d73377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:45.974431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-42ef009a-15e8-41b2-83ed-d4045657c5e2 None None] MFA Rules not processed for user `e59410be6b2a403da20014aa38bd27f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:45.975704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-42ef009a-15e8-41b2-83ed-d4045657c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:46.043055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3f35979b-e5dc-46fe-a242-8ff28d73377f None None] MFA Rules not processed for user `26b3b11c616f42089633b8e8db3b08e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:46.045265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3f35979b-e5dc-46fe-a242-8ff28d73377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:46.084524 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:46.168078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 865/1725] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:46.171018 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef009a-15e8-41b2-83ed-d4045657c5e2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:46.174675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-42ef009a-15e8-41b2-83ed-d4045657c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:46.204206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 861/1726] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:45 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:46.206093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35979b-e5dc-46fe-a242-8ff28d73377f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:46.207679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3f35979b-e5dc-46fe-a242-8ff28d73377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:46.291609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef009a-15e8-41b2-83ed-d4045657c5e2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:46.300395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35979b-e5dc-46fe-a242-8ff28d73377f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:46.305005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:46.306075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:46.306513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:46.306946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] PATH_INFO: `/v3/projects/f928d0d761934d7391e83ae91c304cc0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:46.308031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:46.308967 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f928d0d761934d7391e83ae91c304cc0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:46.309135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:46.309577 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:46.310079 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] PATH_INFO: `/v3/projects/0e9a30fb9e7e4a499ff5bb3a7f9b45a4` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:46.311639 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:46.311869 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9a30fb9e7e4a499ff5bb3a7f9b45a4)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:46.314055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:46.383844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f928d0d761934d7391e83ae91c304cc0', 'request_id': 'req-af85ba02-3423-470c-b81d-78568362041f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:46.389232 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9a30fb9e7e4a499ff5bb3a7f9b45a4', 'request_id': 'req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:46.391116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f928d0d761934d7391e83ae91c304cc0', 'request_id': 'req-af85ba02-3423-470c-b81d-78568362041f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:46.398741 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9a30fb9e7e4a499ff5bb3a7f9b45a4', 'request_id': 'req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:46.402444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f928d0d761934d7391e83ae91c304cc0', 'request_id': 'req-af85ba02-3423-470c-b81d-78568362041f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:46.403809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:46.406272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9a30fb9e7e4a499ff5bb3a7f9b45a4', 'request_id': 'req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:46.425477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] The token cache is being invalidate because project f928d0d761934d7391e83ae91c304cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:41:46.425835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:46.427334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] The token cache is being invalidate because project 0e9a30fb9e7e4a499ff5bb3a7f9b45a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:41:46.427606 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:46.428067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:46.429118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:46.429358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 866/1727] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:41:46 2022] DELETE /identity/v3/projects/f928d0d761934d7391e83ae91c304cc0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:46.430116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:46.431409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 862/1728] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:41:46 2022] DELETE /identity/v3/projects/0e9a30fb9e7e4a499ff5bb3a7f9b45a4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:46.432510 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:46.434190 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:46.436052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:46.527270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85ba02-3423-470c-b81d-78568362041f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:46.580431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:46.637288 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad065-7a2f-49a8-8bc0-418ac0cb172c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:46.645940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc886ae8-0548-4144-baeb-9f77f7cce305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:46.647014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc886ae8-0548-4144-baeb-9f77f7cce305 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:46.647781 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc886ae8-0548-4144-baeb-9f77f7cce305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:46.648179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc886ae8-0548-4144-baeb-9f77f7cce305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:46.649105 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc886ae8-0548-4144-baeb-9f77f7cce305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:46.651691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc886ae8-0548-4144-baeb-9f77f7cce305 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:46.711332 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 863/1729] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:46 2022] POST /identity/v3/projects => generated 357 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:46.711332 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b336f-37ab-4226-b0a0-d7d79d708468 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:46.712015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53b275-504f-472a-82f7-96249fa59740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:46.712107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b336f-37ab-4226-b0a0-d7d79d708468 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:46.713078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53b275-504f-472a-82f7-96249fa59740 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:46.713196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b336f-37ab-4226-b0a0-d7d79d708468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:46.713269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53b275-504f-472a-82f7-96249fa59740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:46.713269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53b275-504f-472a-82f7-96249fa59740 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:46.717606 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53b275-504f-472a-82f7-96249fa59740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:46.725637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53b275-504f-472a-82f7-96249fa59740 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:46.760047 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-af5b336f-37ab-4226-b0a0-d7d79d708468 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:46.761492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-af5b336f-37ab-4226-b0a0-d7d79d708468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:46.804468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 867/1730] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:46 2022] POST /identity/v3/projects => generated 369 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:46.805548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53b275-504f-472a-82f7-96249fa59740 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:46.811997 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cd53b275-504f-472a-82f7-96249fa59740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:46.924646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 864/1731] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:46.926006 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b336f-37ab-4226-b0a0-d7d79d708468 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:46.962573 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b336f-37ab-4226-b0a0-d7d79d708468 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:46.976043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2556de-1aaf-4182-a5f9-08a5e816e188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:46.976969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2556de-1aaf-4182-a5f9-08a5e816e188 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:46.977698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2556de-1aaf-4182-a5f9-08a5e816e188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:46.978171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2556de-1aaf-4182-a5f9-08a5e816e188 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:46.979060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2556de-1aaf-4182-a5f9-08a5e816e188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:46.981557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53b275-504f-472a-82f7-96249fa59740 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:46.981975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2556de-1aaf-4182-a5f9-08a5e816e188 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:46.993938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:46.996834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:46.997128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:46.997410 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] PATH_INFO: `/v3/users/8029fbe5f92e4eff810c15f737fad729` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:47.001608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8029fbe5f92e4eff810c15f737fad729)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:47.007238 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:47.035652 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 865/1732] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:46 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:47.036659 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2556de-1aaf-4182-a5f9-08a5e816e188 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:47.052295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1f2556de-1aaf-4182-a5f9-08a5e816e188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:47.083786 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2556de-1aaf-4182-a5f9-08a5e816e188 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:47.090390 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9419ead-87f8-4053-835b-7f4aaa60a3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:47.092097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9419ead-87f8-4053-835b-7f4aaa60a3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:47.092097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9419ead-87f8-4053-835b-7f4aaa60a3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:47.092395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9419ead-87f8-4053-835b-7f4aaa60a3e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:47.093132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9419ead-87f8-4053-835b-7f4aaa60a3e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:47.097510 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9419ead-87f8-4053-835b-7f4aaa60a3e2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:47.123864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8029fbe5f92e4eff810c15f737fad729'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:47.134289 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 866/1733] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:47 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:47.138184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e631-631d-42d6-ad9b-8743249543c0 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:47.138487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e631-631d-42d6-ad9b-8743249543c0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:47.138783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e631-631d-42d6-ad9b-8743249543c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:47.140162 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8029fbe5f92e4eff810c15f737fad729'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:47.154434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8029fbe5f92e4eff810c15f737fad729'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:47.155279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8029fbe5f92e4eff810c15f737fad729'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:47.169708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8029fbe5f92e4eff810c15f737fad729'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:47.180367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 868/1734] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:41:46 2022] DELETE /identity/v3/users/8029fbe5f92e4eff810c15f737fad729 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:47.181147 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d344e631-631d-42d6-ad9b-8743249543c0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:47.181730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:47.183925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:47.185691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d344e631-631d-42d6-ad9b-8743249543c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:47.232399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:47.277403 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=1,keystone:SELECT=92,keystone:INSERT=7 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:47.339965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 867/1735] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:47.340930 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e631-631d-42d6-ad9b-8743249543c0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:47.342497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d344e631-631d-42d6-ad9b-8743249543c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:47.356234 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e631-631d-42d6-ad9b-8743249543c0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:47.360538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5f961-3c18-4f61-9f4d-0d3fa3039260 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:47.364123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6eb439-7393-4c35-905c-d2364ff37e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:47.364713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6eb439-7393-4c35-905c-d2364ff37e75 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:47.365002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6eb439-7393-4c35-905c-d2364ff37e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:47.365935 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6eb439-7393-4c35-905c-d2364ff37e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:47.366695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6eb439-7393-4c35-905c-d2364ff37e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:47.369106 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6eb439-7393-4c35-905c-d2364ff37e75 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:47.376047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e80989-a229-40ce-9094-9c97f26b7143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:47.378511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80989-a229-40ce-9094-9c97f26b7143 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:47.378861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80989-a229-40ce-9094-9c97f26b7143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:47.379197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80989-a229-40ce-9094-9c97f26b7143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:47.381680 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e80989-a229-40ce-9094-9c97f26b7143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:47.385042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 868/1736] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:47.386312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6eb439-7393-4c35-905c-d2364ff37e75 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:47.390774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e80989-a229-40ce-9094-9c97f26b7143 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:47.402236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6eb439-7393-4c35-905c-d2364ff37e75 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:47.420895 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 869/1737] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:47.422783 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e80989-a229-40ce-9094-9c97f26b7143 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:47.425735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7ca3a-4436-4adf-b1fc-e6472f280a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:47.426596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7ca3a-4436-4adf-b1fc-e6472f280a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:47.426838 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7ca3a-4436-4adf-b1fc-e6472f280a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:47.427219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7ca3a-4436-4adf-b1fc-e6472f280a19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:47.428031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7ca3a-4436-4adf-b1fc-e6472f280a19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:47.428541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7ca3a-4436-4adf-b1fc-e6472f280a19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:47.431461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7ca3a-4436-4adf-b1fc-e6472f280a19 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:47.447034 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e80989-a229-40ce-9094-9c97f26b7143 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:47.463909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ac143-f485-4cfe-b8eb-3d2653895c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:47.464834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ac143-f485-4cfe-b8eb-3d2653895c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:47.466336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ac143-f485-4cfe-b8eb-3d2653895c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:47.466643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ac143-f485-4cfe-b8eb-3d2653895c62 admin admin] PATH_INFO: `/v3/projects/37704287f4014b46bc75f750de5af8bc/users/14d90dfd883d460e8957bb0887250555/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:47.503651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 869/1738] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:47.505221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7ca3a-4436-4adf-b1fc-e6472f280a19 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:47.514351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ac143-f485-4cfe-b8eb-3d2653895c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37704287f4014b46bc75f750de5af8bc, user_id=14d90dfd883d460e8957bb0887250555, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:47.519736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ac143-f485-4cfe-b8eb-3d2653895c62 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:47.530402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7ca3a-4436-4adf-b1fc-e6472f280a19 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:47.543990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecb226-1109-4352-a092-4775c33b2234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:47.545171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecb226-1109-4352-a092-4775c33b2234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:47.545603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecb226-1109-4352-a092-4775c33b2234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:47.546850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecb226-1109-4352-a092-4775c33b2234 admin admin] PATH_INFO: `/v3/projects/de1d36d0651d4dd0b32b72f1600c5f7f/users/09dc3f0834354406a69888586c67e85b/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:47.562588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 870/1739] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:47 2022] PUT /identity/v3/projects/37704287f4014b46bc75f750de5af8bc/users/14d90dfd883d460e8957bb0887250555/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:47.563728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ac143-f485-4cfe-b8eb-3d2653895c62 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:47.594054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecb226-1109-4352-a092-4775c33b2234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1d36d0651d4dd0b32b72f1600c5f7f, user_id=09dc3f0834354406a69888586c67e85b, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:47.603614 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecb226-1109-4352-a092-4775c33b2234 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:47.641038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 870/1740] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:47 2022] PUT /identity/v3/projects/de1d36d0651d4dd0b32b72f1600c5f7f/users/09dc3f0834354406a69888586c67e85b/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:47.641038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecb226-1109-4352-a092-4775c33b2234 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:47.778231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ac143-f485-4cfe-b8eb-3d2653895c62 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:47.828136 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecb226-1109-4352-a092-4775c33b2234 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:47.841696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6642a-f1c8-4d7b-9053-04f775ac31f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:47.842706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6642a-f1c8-4d7b-9053-04f775ac31f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:47.843108 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6642a-f1c8-4d7b-9053-04f775ac31f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:47.844619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6642a-f1c8-4d7b-9053-04f775ac31f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:47.847688 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6642a-f1c8-4d7b-9053-04f775ac31f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:47.851470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6642a-f1c8-4d7b-9053-04f775ac31f6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:47.884099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7396e53-cec3-4c63-9c79-5e51db4b5e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:47.884779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396e53-cec3-4c63-9c79-5e51db4b5e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:47.885060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396e53-cec3-4c63-9c79-5e51db4b5e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:47.885337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396e53-cec3-4c63-9c79-5e51db4b5e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:47.885904 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 871/1741] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:47.886021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7396e53-cec3-4c63-9c79-5e51db4b5e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:47.886864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6642a-f1c8-4d7b-9053-04f775ac31f6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:47.888153 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7396e53-cec3-4c63-9c79-5e51db4b5e77 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:47.920380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6642a-f1c8-4d7b-9053-04f775ac31f6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:47.924758 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 871/1742] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:47 2022] POST /identity/v3/projects => generated 377 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:47.926665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751a7a9-a455-42a8-8b98-1928978acc48 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:47.926957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751a7a9-a455-42a8-8b98-1928978acc48 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:47.927263 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751a7a9-a455-42a8-8b98-1928978acc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:47.935306 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e71b4-9b7c-4876-95b3-b17a1ce0eaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:47.936580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e71b4-9b7c-4876-95b3-b17a1ce0eaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:47.936826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e71b4-9b7c-4876-95b3-b17a1ce0eaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:47.937104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e71b4-9b7c-4876-95b3-b17a1ce0eaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:47.937832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e71b4-9b7c-4876-95b3-b17a1ce0eaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:47.944356 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e71b4-9b7c-4876-95b3-b17a1ce0eaf8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:47.978032 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 872/1743] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:47.978293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6751a7a9-a455-42a8-8b98-1928978acc48 None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:47.978383 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e71b4-9b7c-4876-95b3-b17a1ce0eaf8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:47.978461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6751a7a9-a455-42a8-8b98-1928978acc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:47.991036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e71b4-9b7c-4876-95b3-b17a1ce0eaf8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:48.041145 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:48.156981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cecb9d-612f-4d5e-8f17-50a87bc6f20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:48.158994 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cecb9d-612f-4d5e-8f17-50a87bc6f20e admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:48.159479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cecb9d-612f-4d5e-8f17-50a87bc6f20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:48.159766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cecb9d-612f-4d5e-8f17-50a87bc6f20e admin admin] PATH_INFO: `/v3/projects/37704287f4014b46bc75f750de5af8bc/users/14d90dfd883d460e8957bb0887250555/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:48.166324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cecb9d-612f-4d5e-8f17-50a87bc6f20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37704287f4014b46bc75f750de5af8bc, user_id=14d90dfd883d460e8957bb0887250555, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:48.171804 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cecb9d-612f-4d5e-8f17-50a87bc6f20e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:48.176969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 872/1744] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:41:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:48.180689 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751a7a9-a455-42a8-8b98-1928978acc48 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:48.211228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 873/1745] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:47 2022] PUT /identity/v3/projects/37704287f4014b46bc75f750de5af8bc/users/14d90dfd883d460e8957bb0887250555/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:48.211228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cecb9d-612f-4d5e-8f17-50a87bc6f20e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:48.232137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751a7a9-a455-42a8-8b98-1928978acc48 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:48.248238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:48.357734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cecb9d-612f-4d5e-8f17-50a87bc6f20e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:48.373878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a250b8-f15d-4bc8-917a-e136a239cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:48.374920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a250b8-f15d-4bc8-917a-e136a239cdba admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:48.378364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05ad9c-98bd-4040-a529-b6b69252e153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:48.379086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a250b8-f15d-4bc8-917a-e136a239cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:48.379561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a250b8-f15d-4bc8-917a-e136a239cdba admin admin] PATH_INFO: `/v3/projects/de1d36d0651d4dd0b32b72f1600c5f7f/users/09dc3f0834354406a69888586c67e85b/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:48.380238 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05ad9c-98bd-4040-a529-b6b69252e153 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:48.380685 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05ad9c-98bd-4040-a529-b6b69252e153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:48.381165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05ad9c-98bd-4040-a529-b6b69252e153 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:48.382414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a250b8-f15d-4bc8-917a-e136a239cdba admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1d36d0651d4dd0b32b72f1600c5f7f, user_id=09dc3f0834354406a69888586c67e85b, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:48.385959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a250b8-f15d-4bc8-917a-e136a239cdba admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:48.396213 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05ad9c-98bd-4040-a529-b6b69252e153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:48.401070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 874/1746] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:48 2022] PUT /identity/v3/projects/de1d36d0651d4dd0b32b72f1600c5f7f/users/09dc3f0834354406a69888586c67e85b/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:48.402833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444f158-9f39-443a-a855-346e0bb11736 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:48.403216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444f158-9f39-443a-a855-346e0bb11736 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:48.403559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444f158-9f39-443a-a855-346e0bb11736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:48.404820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05ad9c-98bd-4040-a529-b6b69252e153 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:48.440572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2444f158-9f39-443a-a855-346e0bb11736 None None] MFA Rules not processed for user `14d90dfd883d460e8957bb0887250555`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:48.442746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2444f158-9f39-443a-a855-346e0bb11736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:48.457816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 873/1747] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:48 2022] POST /identity/v3/users => generated 289 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:48.457816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05ad9c-98bd-4040-a529-b6b69252e153 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:48.464358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6d05ad9c-98bd-4040-a529-b6b69252e153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:48.583561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 875/1748] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:48.585679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c11e0-e238-42f2-a44c-fe117cd7f3b5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:48.585924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c11e0-e238-42f2-a44c-fe117cd7f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:48.586215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c11e0-e238-42f2-a44c-fe117cd7f3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:48.640564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05ad9c-98bd-4040-a529-b6b69252e153 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:48.648051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-544c11e0-e238-42f2-a44c-fe117cd7f3b5 None None] MFA Rules not processed for user `09dc3f0834354406a69888586c67e85b`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:48.651082 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-544c11e0-e238-42f2-a44c-fe117cd7f3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:48.740688 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:48.758107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 876/1749] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:48 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:48.759523 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c11e0-e238-42f2-a44c-fe117cd7f3b5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:48.760712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58e037-d635-4542-b0c4-751bec2487fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:48.761675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58e037-d635-4542-b0c4-751bec2487fe service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:48.761860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58e037-d635-4542-b0c4-751bec2487fe service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:48.762641 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58e037-d635-4542-b0c4-751bec2487fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:48.817301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:48.934175 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c11e0-e238-42f2-a44c-fe117cd7f3b5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:48.935025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58e037-d635-4542-b0c4-751bec2487fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:48.938701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58e037-d635-4542-b0c4-751bec2487fe service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:48.948005 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fae2f3-dc3c-4999-8b8a-a1acb35c2e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:48.948712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fae2f3-dc3c-4999-8b8a-a1acb35c2e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:48.949000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fae2f3-dc3c-4999-8b8a-a1acb35c2e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:48.949281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fae2f3-dc3c-4999-8b8a-a1acb35c2e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:48.950024 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fae2f3-dc3c-4999-8b8a-a1acb35c2e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:48.951698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fae2f3-dc3c-4999-8b8a-a1acb35c2e52 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:48.985972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 877/1750] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:48.987100 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fae2f3-dc3c-4999-8b8a-a1acb35c2e52 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:49.001460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 874/1751] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:41:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:41:49.002784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-21fae2f3-dc3c-4999-8b8a-a1acb35c2e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:49.004172 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58e037-d635-4542-b0c4-751bec2487fe service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:49.005852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3b58e037-d635-4542-b0c4-751bec2487fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:49.034339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58e037-d635-4542-b0c4-751bec2487fe service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:49.050585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:49.051506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:49.051798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:49.052075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] PATH_INFO: `/v3/projects/6d66e511e7054af2aa59c3dedae97907` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:49.054315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d66e511e7054af2aa59c3dedae97907)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:49.066914 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:49.131002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fae2f3-dc3c-4999-8b8a-a1acb35c2e52 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:49.141410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83276272-483a-4f5d-93ab-684e925d6a26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:49.142092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83276272-483a-4f5d-93ab-684e925d6a26 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:49.142481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83276272-483a-4f5d-93ab-684e925d6a26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:49.142861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83276272-483a-4f5d-93ab-684e925d6a26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:49.165899 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83276272-483a-4f5d-93ab-684e925d6a26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:49.168296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83276272-483a-4f5d-93ab-684e925d6a26 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:49.191484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 878/1752] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:49.192380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83276272-483a-4f5d-93ab-684e925d6a26 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:49.193898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d66e511e7054af2aa59c3dedae97907', 'request_id': 'req-949a7fd3-8d14-42bb-83f4-2d910632084a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:49.194026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-83276272-483a-4f5d-93ab-684e925d6a26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:49.207741 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d66e511e7054af2aa59c3dedae97907', 'request_id': 'req-949a7fd3-8d14-42bb-83f4-2d910632084a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:49.227089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d66e511e7054af2aa59c3dedae97907', 'request_id': 'req-949a7fd3-8d14-42bb-83f4-2d910632084a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:49.228620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83276272-483a-4f5d-93ab-684e925d6a26 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:49.248925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] The token cache is being invalidate because project 6d66e511e7054af2aa59c3dedae97907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:41:49.249281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:49.251093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:49.255080 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 875/1753] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:41:49 2022] DELETE /identity/v3/projects/6d66e511e7054af2aa59c3dedae97907 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:49.257233 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:49.261040 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:49.416525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670e866-0077-4b09-b824-7cadb3b23b25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:49.417406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e866-0077-4b09-b824-7cadb3b23b25 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:49.417951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e866-0077-4b09-b824-7cadb3b23b25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:49.417951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e866-0077-4b09-b824-7cadb3b23b25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:49.422865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0670e866-0077-4b09-b824-7cadb3b23b25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:49.491322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a7fd3-8d14-42bb-83f4-2d910632084a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:49.504088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbaf25a-ae0f-4f42-aacb-abc190fb2c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:49.505103 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaf25a-ae0f-4f42-aacb-abc190fb2c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:49.505638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaf25a-ae0f-4f42-aacb-abc190fb2c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:49.506229 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaf25a-ae0f-4f42-aacb-abc190fb2c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:49.507435 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbaf25a-ae0f-4f42-aacb-abc190fb2c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:49.509582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbaf25a-ae0f-4f42-aacb-abc190fb2c24 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:49.525562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 876/1754] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:49.527335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489569d-778c-4c84-adad-33819f2274d2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:49.527832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489569d-778c-4c84-adad-33819f2274d2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:49.528947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489569d-778c-4c84-adad-33819f2274d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:49.570529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3489569d-778c-4c84-adad-33819f2274d2 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:49.571979 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3489569d-778c-4c84-adad-33819f2274d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:49.573864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e866-0077-4b09-b824-7cadb3b23b25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:49.576515 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e866-0077-4b09-b824-7cadb3b23b25 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:49.607686 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 879/1756] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:49 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:49.610817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 877/1756] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:49.612779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19599bfb-3b03-4b8b-91c9-b642957c9371 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:49.616860 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19599bfb-3b03-4b8b-91c9-b642957c9371 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:49.618667 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19599bfb-3b03-4b8b-91c9-b642957c9371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:49.620730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489569d-778c-4c84-adad-33819f2274d2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:49.625033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3489569d-778c-4c84-adad-33819f2274d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:49.637072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:49.664419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-19599bfb-3b03-4b8b-91c9-b642957c9371 None None] MFA Rules not processed for user `e651c2917c75425fb656dfb145a5bc4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:49.668376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489569d-778c-4c84-adad-33819f2274d2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:49.676575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-19599bfb-3b03-4b8b-91c9-b642957c9371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:49.685257 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e1e16-fc2e-4210-acbc-3e8924949ce8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:49.688437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e1e16-fc2e-4210-acbc-3e8924949ce8 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:49.688906 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e1e16-fc2e-4210-acbc-3e8924949ce8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:49.690300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e1e16-fc2e-4210-acbc-3e8924949ce8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:49.699008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0a5e1e16-fc2e-4210-acbc-3e8924949ce8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:49.737445 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:49.852711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 880/1757] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:49.854399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19599bfb-3b03-4b8b-91c9-b642957c9371 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:49.898574 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e1e16-fc2e-4210-acbc-3e8924949ce8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:49.900174 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e1e16-fc2e-4210-acbc-3e8924949ce8 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:49.901680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19599bfb-3b03-4b8b-91c9-b642957c9371 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:49.926613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e0bff-f9d8-4a40-8212-69633b5030fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:49.927759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e0bff-f9d8-4a40-8212-69633b5030fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:49.928251 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e0bff-f9d8-4a40-8212-69633b5030fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:49.928424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e0bff-f9d8-4a40-8212-69633b5030fa admin admin] PATH_INFO: `/v3/projects/f19976a6bea1421f93cebd6d2b491d42/users/7044725f3be84ae7b646c75312913b81/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:49.929681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 878/1758] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:49.932144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bcf7c-913d-4159-9188-1e98f7a1cab8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:49.932442 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bcf7c-913d-4159-9188-1e98f7a1cab8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:49.932732 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bcf7c-913d-4159-9188-1e98f7a1cab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:49.963387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e0bff-f9d8-4a40-8212-69633b5030fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19976a6bea1421f93cebd6d2b491d42, user_id=7044725f3be84ae7b646c75312913b81, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:49.969894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e0bff-f9d8-4a40-8212-69633b5030fa admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:49.975519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-278bcf7c-913d-4159-9188-1e98f7a1cab8 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:49.979009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-278bcf7c-913d-4159-9188-1e98f7a1cab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:50.025537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 881/1759] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:49 2022] PUT /identity/v3/projects/f19976a6bea1421f93cebd6d2b491d42/users/7044725f3be84ae7b646c75312913b81/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:50.025537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c638e6c-1329-46c7-bdf9-f881f5c31fa7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:50.025537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c638e6c-1329-46c7-bdf9-f881f5c31fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:50.025537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c638e6c-1329-46c7-bdf9-f881f5c31fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:50.026180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 879/1760] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:50.026180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bcf7c-913d-4159-9188-1e98f7a1cab8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:50.052077 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bcf7c-913d-4159-9188-1e98f7a1cab8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:50.066352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4c638e6c-1329-46c7-bdf9-f881f5c31fa7 None None] MFA Rules not processed for user `fb6987f34f174552bab9495f3d50ee45`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:50.067620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4c638e6c-1329-46c7-bdf9-f881f5c31fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:50.204664 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b798aef-a362-4e41-9b61-a8e3895640d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:50.205809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b798aef-a362-4e41-9b61-a8e3895640d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:50.206096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b798aef-a362-4e41-9b61-a8e3895640d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:50.206375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b798aef-a362-4e41-9b61-a8e3895640d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:50.207112 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b798aef-a362-4e41-9b61-a8e3895640d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:41:50.207632 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b798aef-a362-4e41-9b61-a8e3895640d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:50.209126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b798aef-a362-4e41-9b61-a8e3895640d5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:50.226992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 882/1761] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:50.228537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f82fa2-7497-4fb1-969a-d4a0031657b0 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:50.228833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f82fa2-7497-4fb1-969a-d4a0031657b0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:50.229114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f82fa2-7497-4fb1-969a-d4a0031657b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:50.269070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 880/1762] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:41:50.271536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b798aef-a362-4e41-9b61-a8e3895640d5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:50.274257 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2b798aef-a362-4e41-9b61-a8e3895640d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:50.336292 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-02f82fa2-7497-4fb1-969a-d4a0031657b0 None None] MFA Rules not processed for user `7044725f3be84ae7b646c75312913b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:50.337751 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-02f82fa2-7497-4fb1-969a-d4a0031657b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:50.433463 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b798aef-a362-4e41-9b61-a8e3895640d5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:50.445863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e42c6-177f-44c9-8750-0a9ba850637f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:50.446874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e42c6-177f-44c9-8750-0a9ba850637f service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:50.446874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e42c6-177f-44c9-8750-0a9ba850637f service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:50.448302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e42c6-177f-44c9-8750-0a9ba850637f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:50.451929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-269e42c6-177f-44c9-8750-0a9ba850637f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:50.577382 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 883/1763] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:50.579572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f82fa2-7497-4fb1-969a-d4a0031657b0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:50.631274 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f82fa2-7497-4fb1-969a-d4a0031657b0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:50.641907 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620525f-48a3-4cff-8cf8-0b0f394526b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:50.646277 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620525f-48a3-4cff-8cf8-0b0f394526b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:50.646879 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620525f-48a3-4cff-8cf8-0b0f394526b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:50.647676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620525f-48a3-4cff-8cf8-0b0f394526b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:50.650223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620525f-48a3-4cff-8cf8-0b0f394526b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:50.657095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620525f-48a3-4cff-8cf8-0b0f394526b3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:50.707183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:50.708461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:50.727069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e42c6-177f-44c9-8750-0a9ba850637f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:50.727069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e42c6-177f-44c9-8750-0a9ba850637f service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:50.727481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 884/1764] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:50 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:50.727481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620525f-48a3-4cff-8cf8-0b0f394526b3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:50.749120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 881/1765] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:50 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:50.756498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbef43-6e07-4dc7-b812-13239bd7a157 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:50.756799 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbef43-6e07-4dc7-b812-13239bd7a157 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:50.757143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbef43-6e07-4dc7-b812-13239bd7a157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:50.801069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f0fbef43-6e07-4dc7-b812-13239bd7a157 None None] MFA Rules not processed for user `d7bb4a244df24a19b4c3ad3d1ad2bc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:50.804277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f0fbef43-6e07-4dc7-b812-13239bd7a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:50.908411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620525f-48a3-4cff-8cf8-0b0f394526b3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:50.915907 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcfa25-ab77-4349-ae49-15e223e9122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:50.916776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcfa25-ab77-4349-ae49-15e223e9122b admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:50.917211 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcfa25-ab77-4349-ae49-15e223e9122b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:50.917502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcfa25-ab77-4349-ae49-15e223e9122b admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:50.934455 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcfa25-ab77-4349-ae49-15e223e9122b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:50.936771 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcfa25-ab77-4349-ae49-15e223e9122b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:50.949952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 882/1766] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Jul 6 20:41:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:50.952539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbef43-6e07-4dc7-b812-13239bd7a157 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:51.005153 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbef43-6e07-4dc7-b812-13239bd7a157 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:51.020532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94971f90-6c2c-4e81-80ff-3517ab68bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:51.021651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94971f90-6c2c-4e81-80ff-3517ab68bda0 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:51.022696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94971f90-6c2c-4e81-80ff-3517ab68bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:51.023206 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94971f90-6c2c-4e81-80ff-3517ab68bda0 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:51.025009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94971f90-6c2c-4e81-80ff-3517ab68bda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:51.030927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94971f90-6c2c-4e81-80ff-3517ab68bda0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:51.060688 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 885/1767] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:50 2022] POST /identity/v3/projects => generated 375 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:51.071688 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcfa25-ab77-4349-ae49-15e223e9122b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:51.096986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 883/1768] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:50 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:51.100467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94971f90-6c2c-4e81-80ff-3517ab68bda0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:51.103906 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-94971f90-6c2c-4e81-80ff-3517ab68bda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:51.136811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94971f90-6c2c-4e81-80ff-3517ab68bda0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:51.245801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e2083-a94b-4042-b882-e6b85a18425b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:51.246717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e2083-a94b-4042-b882-e6b85a18425b service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:51.247012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e2083-a94b-4042-b882-e6b85a18425b service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:51.247858 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e2083-a94b-4042-b882-e6b85a18425b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:51.257205 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e2083-a94b-4042-b882-e6b85a18425b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:51.258721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e2083-a94b-4042-b882-e6b85a18425b service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:51.264172 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcfa25-ab77-4349-ae49-15e223e9122b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:51.269656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 884/1769] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:51.270921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e2083-a94b-4042-b882-e6b85a18425b service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:51.281118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d894c-59d1-4782-8911-43b9d9d3c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:51.285078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d894c-59d1-4782-8911-43b9d9d3c0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:51.285431 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d894c-59d1-4782-8911-43b9d9d3c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:51.285718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d894c-59d1-4782-8911-43b9d9d3c0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:51.286482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d894c-59d1-4782-8911-43b9d9d3c0e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:51.288444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d894c-59d1-4782-8911-43b9d9d3c0e8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:51.291300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e2083-a94b-4042-b882-e6b85a18425b service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:51.298026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452c8c7-edc8-43f2-9fa3-7255ecc3f1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:51.298847 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452c8c7-edc8-43f2-9fa3-7255ecc3f1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:51.299205 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452c8c7-edc8-43f2-9fa3-7255ecc3f1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:51.299527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452c8c7-edc8-43f2-9fa3-7255ecc3f1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:51.300332 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452c8c7-edc8-43f2-9fa3-7255ecc3f1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:51.302563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452c8c7-edc8-43f2-9fa3-7255ecc3f1ce admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:51.316131 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 885/1770] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:51.323703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6721e-1de5-435e-b024-267b1320b701 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:51.324003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6721e-1de5-435e-b024-267b1320b701 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:51.324285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6721e-1de5-435e-b024-267b1320b701 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:51.333714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 886/1771] 10.222.0.33 () {54 vars in 912 bytes} [Wed Jul 6 20:41:51 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:41:51.335513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6721e-1de5-435e-b024-267b1320b701 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:51.339249 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 886/1772] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:51 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:51.343832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f277c52-bbec-4fc7-a5d5-507eb21b9256 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:51.344125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f277c52-bbec-4fc7-a5d5-507eb21b9256 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:51.344412 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f277c52-bbec-4fc7-a5d5-507eb21b9256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:51.353856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6721e-1de5-435e-b024-267b1320b701 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:51.360704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111f2e6-6649-4960-a1d3-bb5f3abd1c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:51.362126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111f2e6-6649-4960-a1d3-bb5f3abd1c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:51.362421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111f2e6-6649-4960-a1d3-bb5f3abd1c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:51.362819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111f2e6-6649-4960-a1d3-bb5f3abd1c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:51.363882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111f2e6-6649-4960-a1d3-bb5f3abd1c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:51.368709 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111f2e6-6649-4960-a1d3-bb5f3abd1c3d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:51.382706 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 887/1773] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:51.384711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111f2e6-6649-4960-a1d3-bb5f3abd1c3d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:51.404015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1f277c52-bbec-4fc7-a5d5-507eb21b9256 None None] MFA Rules not processed for user `d7bb4a244df24a19b4c3ad3d1ad2bc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:51.405275 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1f277c52-bbec-4fc7-a5d5-507eb21b9256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:51.412748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111f2e6-6649-4960-a1d3-bb5f3abd1c3d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:51.424907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f8bdf-195b-43d9-a547-5b289b44c36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:51.426369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 887/1774] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:41:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:51.427249 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f277c52-bbec-4fc7-a5d5-507eb21b9256 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:51.444309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f8bdf-195b-43d9-a547-5b289b44c36a admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:51.445092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f8bdf-195b-43d9-a547-5b289b44c36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:51.445389 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f8bdf-195b-43d9-a547-5b289b44c36a admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:51.446628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f8bdf-195b-43d9-a547-5b289b44c36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:51.449186 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f8bdf-195b-43d9-a547-5b289b44c36a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:51.466404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f277c52-bbec-4fc7-a5d5-507eb21b9256 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:51.468418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 888/1775] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:51.469327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f8bdf-195b-43d9-a547-5b289b44c36a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:51.475763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e22ff-46f3-4366-9460-a33712a0dcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:51.476716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e22ff-46f3-4366-9460-a33712a0dcbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:51.476944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e22ff-46f3-4366-9460-a33712a0dcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:51.477227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e22ff-46f3-4366-9460-a33712a0dcbc admin admin] PATH_INFO: `/v3/projects/ccdcd94a05fa49c39c1e71d0b0c015d2/users/69c906a3d3d743e299b4be7f66779901/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:51.484014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f8bdf-195b-43d9-a547-5b289b44c36a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:51.489805 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3670b-d13b-468e-8906-39520e759dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:51.490544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3670b-d13b-468e-8906-39520e759dfa service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:51.491038 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3670b-d13b-468e-8906-39520e759dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:51.491293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3670b-d13b-468e-8906-39520e759dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:51.505266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3670b-d13b-468e-8906-39520e759dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:51.507703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3670b-d13b-468e-8906-39520e759dfa service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:51.520784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e22ff-46f3-4366-9460-a33712a0dcbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccdcd94a05fa49c39c1e71d0b0c015d2, user_id=69c906a3d3d743e299b4be7f66779901, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:51.524010 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e22ff-46f3-4366-9460-a33712a0dcbc admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:51.525169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 889/1776] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:51.526019 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3670b-d13b-468e-8906-39520e759dfa service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:51.544971 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3670b-d13b-468e-8906-39520e759dfa service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:51.554118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 888/1777] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:51 2022] PUT /identity/v3/projects/ccdcd94a05fa49c39c1e71d0b0c015d2/users/69c906a3d3d743e299b4be7f66779901/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:51.565832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba43de-47db-46d4-9833-e2e85c6c54ae None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:51.572158 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba43de-47db-46d4-9833-e2e85c6c54ae None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:51.572158 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba43de-47db-46d4-9833-e2e85c6c54ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:51.695262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-41ba43de-47db-46d4-9833-e2e85c6c54ae None None] MFA Rules not processed for user `69c906a3d3d743e299b4be7f66779901`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:51.696988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-41ba43de-47db-46d4-9833-e2e85c6c54ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:51.703475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:51.768416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9f23c-d37a-4619-82f6-7a6f66b0ac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:51.769430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9f23c-d37a-4619-82f6-7a6f66b0ac5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:51.769720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9f23c-d37a-4619-82f6-7a6f66b0ac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:51.770002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9f23c-d37a-4619-82f6-7a6f66b0ac5b admin admin] PATH_INFO: `/v3/projects/9378be51ca264bc6a209211604037184/users/ef3663e5fde5416fb13e9688d8c91124/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:51.831110 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9f23c-d37a-4619-82f6-7a6f66b0ac5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9378be51ca264bc6a209211604037184, user_id=ef3663e5fde5416fb13e9688d8c91124, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:51.833316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:51.836539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9f23c-d37a-4619-82f6-7a6f66b0ac5b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:51.896679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 890/1778] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:51 2022] PUT /identity/v3/projects/9378be51ca264bc6a209211604037184/users/ef3663e5fde5416fb13e9688d8c91124/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:51.898505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9f23c-d37a-4619-82f6-7a6f66b0ac5b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:51.924199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 889/1779] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:51.927775 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba43de-47db-46d4-9833-e2e85c6c54ae None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:51.975921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba43de-47db-46d4-9833-e2e85c6c54ae None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:52.086108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9f23c-d37a-4619-82f6-7a6f66b0ac5b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:52.101131 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe68dde-a30d-4dc9-a1e9-121d60ec228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:52.102199 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe68dde-a30d-4dc9-a1e9-121d60ec228c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:52.102729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe68dde-a30d-4dc9-a1e9-121d60ec228c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:52.103091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe68dde-a30d-4dc9-a1e9-121d60ec228c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:52.103983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe68dde-a30d-4dc9-a1e9-121d60ec228c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:52.105912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe68dde-a30d-4dc9-a1e9-121d60ec228c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:52.135816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 891/1780] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:52.137025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe68dde-a30d-4dc9-a1e9-121d60ec228c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:52.152460 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6faaf-090c-4e96-b9a5-e2f5f95786a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:52.153949 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6faaf-090c-4e96-b9a5-e2f5f95786a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:52.154437 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6faaf-090c-4e96-b9a5-e2f5f95786a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:52.154924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6faaf-090c-4e96-b9a5-e2f5f95786a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:52.156751 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6faaf-090c-4e96-b9a5-e2f5f95786a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:52.165759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6faaf-090c-4e96-b9a5-e2f5f95786a2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:52.169570 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe68dde-a30d-4dc9-a1e9-121d60ec228c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:52.200982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f66bbd-3cf5-4f01-9c6a-8e0dcf57b963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:52.201908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f66bbd-3cf5-4f01-9c6a-8e0dcf57b963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:52.202200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f66bbd-3cf5-4f01-9c6a-8e0dcf57b963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:52.202485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f66bbd-3cf5-4f01-9c6a-8e0dcf57b963 admin admin] PATH_INFO: `/v3/projects/9378be51ca264bc6a209211604037184/users/ef3663e5fde5416fb13e9688d8c91124/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:52.222272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f66bbd-3cf5-4f01-9c6a-8e0dcf57b963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9378be51ca264bc6a209211604037184, user_id=ef3663e5fde5416fb13e9688d8c91124, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:52.226090 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f66bbd-3cf5-4f01-9c6a-8e0dcf57b963 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:52.241916 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 890/1781] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:41:51 2022] POST /identity/v3/projects => generated 387 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:52.246477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6faaf-090c-4e96-b9a5-e2f5f95786a2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:52.265974 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 892/1782] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:52 2022] PUT /identity/v3/projects/9378be51ca264bc6a209211604037184/users/ef3663e5fde5416fb13e9688d8c91124/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:52.277569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1ff2-b84a-40f2-bd90-7a62d37ed589 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:52.277878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1ff2-b84a-40f2-bd90-7a62d37ed589 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:52.278153 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1ff2-b84a-40f2-bd90-7a62d37ed589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:52.374209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4b0c1ff2-b84a-40f2-bd90-7a62d37ed589 None None] MFA Rules not processed for user `ef3663e5fde5416fb13e9688d8c91124`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:52.375514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4b0c1ff2-b84a-40f2-bd90-7a62d37ed589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:52.581119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6faaf-090c-4e96-b9a5-e2f5f95786a2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:52.633671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 893/1783] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:52.884337 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9271c6-ae94-462f-a642-d3994aebe3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:52.885528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9271c6-ae94-462f-a642-d3994aebe3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:52.886047 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9271c6-ae94-462f-a642-d3994aebe3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:52.886648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9271c6-ae94-462f-a642-d3994aebe3e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:52.887869 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9271c6-ae94-462f-a642-d3994aebe3e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:52.893983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9271c6-ae94-462f-a642-d3994aebe3e3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:52.933811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:52.967930 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c1ff2-b84a-40f2-bd90-7a62d37ed589 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:52.969278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 891/1784] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:41:52 2022] POST /identity/v3/users => generated 300 bytes in 721 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:41:52.985745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9271c6-ae94-462f-a642-d3994aebe3e3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:52.997016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c1ff2-b84a-40f2-bd90-7a62d37ed589 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:53.030612 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa016981-d602-4e71-b52a-7d64f47a30cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:53.035357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa016981-d602-4e71-b52a-7d64f47a30cd admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:53.035693 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa016981-d602-4e71-b52a-7d64f47a30cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:53.037953 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa016981-d602-4e71-b52a-7d64f47a30cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:53.038754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa016981-d602-4e71-b52a-7d64f47a30cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:53.044152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa016981-d602-4e71-b52a-7d64f47a30cd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:53.100000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 894/1785] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:53.102142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa016981-d602-4e71-b52a-7d64f47a30cd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:53.141765 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa016981-d602-4e71-b52a-7d64f47a30cd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:53.163047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63de8a7-2a67-46f0-aa7f-48848ce95c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:53.165333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63de8a7-2a67-46f0-aa7f-48848ce95c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:53.165692 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63de8a7-2a67-46f0-aa7f-48848ce95c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:53.168864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63de8a7-2a67-46f0-aa7f-48848ce95c09 admin admin] PATH_INFO: `/v3/projects/a6d9cb01d56f4a6c89c0468d5c4aab87/users/975c865454b74765aa336acd2eae5113/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:53.254305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63de8a7-2a67-46f0-aa7f-48848ce95c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d9cb01d56f4a6c89c0468d5c4aab87, user_id=975c865454b74765aa336acd2eae5113, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:53.263202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63de8a7-2a67-46f0-aa7f-48848ce95c09 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:53.267981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9271c6-ae94-462f-a642-d3994aebe3e3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:53.279425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1deb00-7ac4-45e8-8326-885fc4ebbb5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:53.280119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1deb00-7ac4-45e8-8326-885fc4ebbb5a service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:53.281545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1deb00-7ac4-45e8-8326-885fc4ebbb5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:53.281830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1deb00-7ac4-45e8-8326-885fc4ebbb5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:53.286636 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:53.301668 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 895/1786] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:53 2022] PUT /identity/v3/projects/a6d9cb01d56f4a6c89c0468d5c4aab87/users/975c865454b74765aa336acd2eae5113/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:53.322487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63de8a7-2a67-46f0-aa7f-48848ce95c09 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:53.507612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1deb00-7ac4-45e8-8326-885fc4ebbb5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:53.509095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1deb00-7ac4-45e8-8326-885fc4ebbb5a service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:53.539286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63de8a7-2a67-46f0-aa7f-48848ce95c09 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:53.543965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 892/1787] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:53.553720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98fa05-6968-4c65-86f2-8c269bda3df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:53.554629 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98fa05-6968-4c65-86f2-8c269bda3df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:53.555150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98fa05-6968-4c65-86f2-8c269bda3df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:53.555634 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98fa05-6968-4c65-86f2-8c269bda3df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:53.556557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98fa05-6968-4c65-86f2-8c269bda3df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:53.561236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98fa05-6968-4c65-86f2-8c269bda3df6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:53.590121 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1deb00-7ac4-45e8-8326-885fc4ebbb5a service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:53.600486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 896/1788] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:41:53.608347 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1deb00-7ac4-45e8-8326-885fc4ebbb5a service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:53.619424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bad7f-0d57-47f7-86bf-ebeccf75da07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:53.620064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bad7f-0d57-47f7-86bf-ebeccf75da07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:53.620471 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bad7f-0d57-47f7-86bf-ebeccf75da07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:53.620872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bad7f-0d57-47f7-86bf-ebeccf75da07 admin admin] PATH_INFO: `/v3/projects/a6d9cb01d56f4a6c89c0468d5c4aab87/users/975c865454b74765aa336acd2eae5113/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:53.624410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bad7f-0d57-47f7-86bf-ebeccf75da07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d9cb01d56f4a6c89c0468d5c4aab87, user_id=975c865454b74765aa336acd2eae5113, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:53.629776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bad7f-0d57-47f7-86bf-ebeccf75da07 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:53.658812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 893/1789] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:41:53 2022] PUT /identity/v3/projects/a6d9cb01d56f4a6c89c0468d5c4aab87/users/975c865454b74765aa336acd2eae5113/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:53.668113 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d338ac2-8a79-47db-b343-5f9ca87e8754 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:53.668525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d338ac2-8a79-47db-b343-5f9ca87e8754 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:53.668913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d338ac2-8a79-47db-b343-5f9ca87e8754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:53.748012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1d338ac2-8a79-47db-b343-5f9ca87e8754 None None] MFA Rules not processed for user `975c865454b74765aa336acd2eae5113`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:53.749407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1d338ac2-8a79-47db-b343-5f9ca87e8754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:53.996757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 897/1790] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:54.427897 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bad7f-0d57-47f7-86bf-ebeccf75da07 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:54.655716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bad7f-0d57-47f7-86bf-ebeccf75da07 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:54.674527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5485b2d-32b5-44dd-bcf6-f3896f06f1a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:54.675378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5485b2d-32b5-44dd-bcf6-f3896f06f1a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:54.675768 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5485b2d-32b5-44dd-bcf6-f3896f06f1a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:54.676282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5485b2d-32b5-44dd-bcf6-f3896f06f1a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:54.763081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5485b2d-32b5-44dd-bcf6-f3896f06f1a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:54.790954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5485b2d-32b5-44dd-bcf6-f3896f06f1a8 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:54.918193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 894/1791] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:55.328831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2232c-a325-4859-b611-0230a20be35e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:55.329393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2232c-a325-4859-b611-0230a20be35e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:55.329393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2232c-a325-4859-b611-0230a20be35e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:55.331433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 898/1792] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:41:55.396719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5485b2d-32b5-44dd-bcf6-f3896f06f1a8 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:55.542236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493e0c4-e8ef-4351-8ffe-c56a470bf1ce None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:55.542921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493e0c4-e8ef-4351-8ffe-c56a470bf1ce None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:55.543435 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493e0c4-e8ef-4351-8ffe-c56a470bf1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:55.598815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c493e0c4-e8ef-4351-8ffe-c56a470bf1ce None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:55.605340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c493e0c4-e8ef-4351-8ffe-c56a470bf1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:55.625374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:55.839605 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5485b2d-32b5-44dd-bcf6-f3896f06f1a8 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:55.866330 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:55.868763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:55.870125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:55.871042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] PATH_INFO: `/v3/users/69c906a3d3d743e299b4be7f66779901` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:55.876852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c906a3d3d743e299b4be7f66779901)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:55.886703 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:55.900088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 899/1793] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:41:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:56.213900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c906a3d3d743e299b4be7f66779901'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:56.220137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c906a3d3d743e299b4be7f66779901'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:56.321212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c906a3d3d743e299b4be7f66779901'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:56.349413 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c906a3d3d743e299b4be7f66779901'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:56.412894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c906a3d3d743e299b4be7f66779901'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:56.438851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 895/1794] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:41:55 2022] DELETE /identity/v3/users/69c906a3d3d743e299b4be7f66779901 => generated 0 bytes in 1042 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:56.444089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524de1f-ba71-4683-a06c-80b6f7ac7acb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:56.445102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524de1f-ba71-4683-a06c-80b6f7ac7acb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:56.445553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524de1f-ba71-4683-a06c-80b6f7ac7acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:56.505357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:56.507091 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:56.541621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0524de1f-ba71-4683-a06c-80b6f7ac7acb None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:56.549231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0524de1f-ba71-4683-a06c-80b6f7ac7acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:56.603809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:56.836553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 900/1795] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:56.843245 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099ccf1-ed4c-4b27-ad0c-b35c75975484 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:56.859476 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c776d-2309-4618-a8d7-375c270508da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:56.860651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c776d-2309-4618-a8d7-375c270508da service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:56.862473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c776d-2309-4618-a8d7-375c270508da service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:56.862977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c776d-2309-4618-a8d7-375c270508da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:56.865445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e44c776d-2309-4618-a8d7-375c270508da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:56.894836 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c776d-2309-4618-a8d7-375c270508da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:56.902428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c776d-2309-4618-a8d7-375c270508da service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:56.960805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 896/1796] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:41:57.003961 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524de1f-ba71-4683-a06c-80b6f7ac7acb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:57.005727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0524de1f-ba71-4683-a06c-80b6f7ac7acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:57.284265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524de1f-ba71-4683-a06c-80b6f7ac7acb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:57.296811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d6748-2310-485b-a716-fb0111e42bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:57.304506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d6748-2310-485b-a716-fb0111e42bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:57.305488 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d6748-2310-485b-a716-fb0111e42bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:57.306138 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d6748-2310-485b-a716-fb0111e42bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:57.330588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d6748-2310-485b-a716-fb0111e42bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:57.332691 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d6748-2310-485b-a716-fb0111e42bc8 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:57.365093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 901/1797] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:57.723846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c776d-2309-4618-a8d7-375c270508da service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:57.725285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e44c776d-2309-4618-a8d7-375c270508da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:57.770688 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c776d-2309-4618-a8d7-375c270508da service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:57.799708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:57.799708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:57.799708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:57.799708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] PATH_INFO: `/v3/users/e59410be6b2a403da20014aa38bd27f3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:57.806462 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59410be6b2a403da20014aa38bd27f3)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:57.815758 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:58.086325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:58.119512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59410be6b2a403da20014aa38bd27f3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:58.121151 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59410be6b2a403da20014aa38bd27f3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:58.181317 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59410be6b2a403da20014aa38bd27f3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:58.201661 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59410be6b2a403da20014aa38bd27f3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:58.228180 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59410be6b2a403da20014aa38bd27f3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:58.249023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 897/1798] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:41:57 2022] DELETE /identity/v3/users/e59410be6b2a403da20014aa38bd27f3 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:41:58.254445 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6e471-6148-44ee-b878-fb5ed6b85d3a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:58.255035 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6e471-6148-44ee-b878-fb5ed6b85d3a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:58.255150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6e471-6148-44ee-b878-fb5ed6b85d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:58.319284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-afc6e471-6148-44ee-b878-fb5ed6b85d3a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:58.323093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-afc6e471-6148-44ee-b878-fb5ed6b85d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:58.389362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:58.391250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:58.620765 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 902/1799] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:58.624651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6e471-6148-44ee-b878-fb5ed6b85d3a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:58.627426 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-afc6e471-6148-44ee-b878-fb5ed6b85d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:58.640426 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825d22d-8be7-4541-b0ec-29dfc548e881 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:58.646469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7a58b-dedc-4b29-b1ce-99d170f97870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:58.648350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7a58b-dedc-4b29-b1ce-99d170f97870 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:58.648891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7a58b-dedc-4b29-b1ce-99d170f97870 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:58.649434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7a58b-dedc-4b29-b1ce-99d170f97870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:58.651637 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-74b7a58b-dedc-4b29-b1ce-99d170f97870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:58.691601 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6e471-6148-44ee-b878-fb5ed6b85d3a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:58.729078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e446382-9985-42f6-8adc-95280936b002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:58.730977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e446382-9985-42f6-8adc-95280936b002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:58.733537 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e446382-9985-42f6-8adc-95280936b002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:58.733932 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e446382-9985-42f6-8adc-95280936b002 admin admin] PATH_INFO: `/v3/users/3391ba3e64124dff890ab86b68cda6fd` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:58.738949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e446382-9985-42f6-8adc-95280936b002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3391ba3e64124dff890ab86b68cda6fd)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:58.742287 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e446382-9985-42f6-8adc-95280936b002 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:58.936455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5e446382-9985-42f6-8adc-95280936b002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3391ba3e64124dff890ab86b68cda6fd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:58.949707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:58.952867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7a58b-dedc-4b29-b1ce-99d170f97870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:58.954331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7a58b-dedc-4b29-b1ce-99d170f97870 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:58.967271 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 898/1800] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:58.968281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7a58b-dedc-4b29-b1ce-99d170f97870 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:58.970431 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-74b7a58b-dedc-4b29-b1ce-99d170f97870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:58.971767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5e446382-9985-42f6-8adc-95280936b002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3391ba3e64124dff890ab86b68cda6fd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:58.990382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5e446382-9985-42f6-8adc-95280936b002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3391ba3e64124dff890ab86b68cda6fd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:58.992627 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5e446382-9985-42f6-8adc-95280936b002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3391ba3e64124dff890ab86b68cda6fd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:59.032968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5e446382-9985-42f6-8adc-95280936b002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3391ba3e64124dff890ab86b68cda6fd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:59.049870 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 903/1801] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:41:58 2022] DELETE /identity/v3/users/3391ba3e64124dff890ab86b68cda6fd => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:41:59.054737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc7c79-9af4-4150-8a34-ad3d3f930428 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:59.055324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc7c79-9af4-4150-8a34-ad3d3f930428 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:59.056005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc7c79-9af4-4150-8a34-ad3d3f930428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:59.081520 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-23dc7c79-9af4-4150-8a34-ad3d3f930428 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:41:59.083550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-23dc7c79-9af4-4150-8a34-ad3d3f930428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:59.163678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7a58b-dedc-4b29-b1ce-99d170f97870 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:59.243725 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:41:59.313609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 904/1802] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:41:59.394938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7257b84-21db-469c-abc0-71d76d831d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:59.398619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7257b84-21db-469c-abc0-71d76d831d14 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:59.398912 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7257b84-21db-469c-abc0-71d76d831d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:59.399227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7257b84-21db-469c-abc0-71d76d831d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:59.415522 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d7257b84-21db-469c-abc0-71d76d831d14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:59.450572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7257b84-21db-469c-abc0-71d76d831d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:59.475516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7257b84-21db-469c-abc0-71d76d831d14 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:59.523369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc7c79-9af4-4150-8a34-ad3d3f930428 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:59.524875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-23dc7c79-9af4-4150-8a34-ad3d3f930428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:59.567235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc7c79-9af4-4150-8a34-ad3d3f930428 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:59.571342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 899/1803] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:59.607819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98fac8-1757-44a3-b3ee-cdd35393f112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:59.617585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98fac8-1757-44a3-b3ee-cdd35393f112 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:59.617585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98fac8-1757-44a3-b3ee-cdd35393f112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:59.617585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98fac8-1757-44a3-b3ee-cdd35393f112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:59.622454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98fac8-1757-44a3-b3ee-cdd35393f112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:59.625014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98fac8-1757-44a3-b3ee-cdd35393f112 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:59.651249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 905/1804] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:41:59.663893 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7257b84-21db-469c-abc0-71d76d831d14 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:59.666414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d7257b84-21db-469c-abc0-71d76d831d14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:41:59.704081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7257b84-21db-469c-abc0-71d76d831d14 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:41:59.730900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:41:59.732118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:41:59.732622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:41:59.733599 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] PATH_INFO: `/v3/projects/ccdcd94a05fa49c39c1e71d0b0c015d2` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:41:59.736872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccdcd94a05fa49c39c1e71d0b0c015d2)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:41:59.750390 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:41:59.909584 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccdcd94a05fa49c39c1e71d0b0c015d2', 'request_id': 'req-621a1344-b9c1-4177-a83d-2f964c30e701'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:59.945642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccdcd94a05fa49c39c1e71d0b0c015d2', 'request_id': 'req-621a1344-b9c1-4177-a83d-2f964c30e701'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:59.964732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccdcd94a05fa49c39c1e71d0b0c015d2', 'request_id': 'req-621a1344-b9c1-4177-a83d-2f964c30e701'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:59.983831 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] The token cache is being invalidate because project ccdcd94a05fa49c39c1e71d0b0c015d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:41:59.984288 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:59.985214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:41:59.992003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98fac8-1757-44a3-b3ee-cdd35393f112 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:41:59.994857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 900/1805] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:41:59 2022] DELETE /identity/v3/projects/ccdcd94a05fa49c39c1e71d0b0c015d2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:00.007021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98fac8-1757-44a3-b3ee-cdd35393f112 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:00.178505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:00.180716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:00.181125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:00.182213 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] PATH_INFO: `/v3/users/975c865454b74765aa336acd2eae5113` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:00.186007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=975c865454b74765aa336acd2eae5113)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:00.195350 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:00.370881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975c865454b74765aa336acd2eae5113'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:00.384449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975c865454b74765aa336acd2eae5113'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:00.409295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:00.417433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975c865454b74765aa336acd2eae5113'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:00.420130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975c865454b74765aa336acd2eae5113'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:00.443208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975c865454b74765aa336acd2eae5113'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:00.456704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 906/1806] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:41:59 2022] DELETE /identity/v3/users/975c865454b74765aa336acd2eae5113 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:01.411014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:01.412876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:01.469922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a1344-b9c1-4177-a83d-2f964c30e701 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:01.712736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:01.713631 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:01.713915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:01.714352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] PATH_INFO: `/v3/projects/dcf8563c84774b5381fbdd20c49c6253` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:01.715559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf8563c84774b5381fbdd20c49c6253)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:01.717581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:01.806156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:01.808882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:01.842096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1efd0-bb7d-4bf4-86ee-71f27a982189 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:01.861173 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:01.866120 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf8563c84774b5381fbdd20c49c6253', 'request_id': 'req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:01.893305 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf8563c84774b5381fbdd20c49c6253', 'request_id': 'req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:01.910904 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf8563c84774b5381fbdd20c49c6253', 'request_id': 'req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:01.951770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] The token cache is being invalidate because project dcf8563c84774b5381fbdd20c49c6253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:01.952065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:01.959690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:01.961671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 901/1807] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:01 2022] DELETE /identity/v3/projects/dcf8563c84774b5381fbdd20c49c6253 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:01.965373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:01.966835 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:01.983460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:01.988113 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:01.989476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:01.990055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] PATH_INFO: `/v3/projects/9a272c59182b4448bcb243bdb264f25c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:01.993017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a272c59182b4448bcb243bdb264f25c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:02.000182 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:02.114610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe09a2-0562-44ff-ba5f-ac9a19a2c5b6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:02.123493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:02.124399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:02.124688 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:02.125535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] PATH_INFO: `/v3/users/14d90dfd883d460e8957bb0887250555` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:02.126217 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14d90dfd883d460e8957bb0887250555)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:02.129259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:02.206110 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a272c59182b4448bcb243bdb264f25c', 'request_id': 'req-a3c124c3-49d5-4a83-a782-b3793d3147dd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.219057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a272c59182b4448bcb243bdb264f25c', 'request_id': 'req-a3c124c3-49d5-4a83-a782-b3793d3147dd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.240558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a272c59182b4448bcb243bdb264f25c', 'request_id': 'req-a3c124c3-49d5-4a83-a782-b3793d3147dd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.244434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14d90dfd883d460e8957bb0887250555'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.245982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14d90dfd883d460e8957bb0887250555'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.260597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] The token cache is being invalidate because project 9a272c59182b4448bcb243bdb264f25c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:02.260998 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.269089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.274888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 907/1808] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:01 2022] DELETE /identity/v3/projects/9a272c59182b4448bcb243bdb264f25c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:02.276667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:02.279440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:02.288078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14d90dfd883d460e8957bb0887250555'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.304977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14d90dfd883d460e8957bb0887250555'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.344040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14d90dfd883d460e8957bb0887250555'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.367815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 902/1809] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:01 2022] DELETE /identity/v3/users/14d90dfd883d460e8957bb0887250555 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:02.469229 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c124c3-49d5-4a83-a782-b3793d3147dd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:02.491856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:02.628674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:02.629887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:02.630369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:02.635479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] PATH_INFO: `/v3/users/0873c75f48094f478b12c57b10e643ea` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:02.637543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0873c75f48094f478b12c57b10e643ea)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:02.658217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:02.758671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0873c75f48094f478b12c57b10e643ea'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.789903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0873c75f48094f478b12c57b10e643ea'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.810505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0873c75f48094f478b12c57b10e643ea'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.816350 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0873c75f48094f478b12c57b10e643ea'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.920621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0873c75f48094f478b12c57b10e643ea'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:02.959574 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 908/1810] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:02 2022] DELETE /identity/v3/users/0873c75f48094f478b12c57b10e643ea => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:03.851609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:03.853891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:03.891787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efdbed-df19-46f0-bd5b-0abc79117813 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:04.009698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:04.022653 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49149376-e34a-4ba8-a650-e3369bd94d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:04.024259 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49149376-e34a-4ba8-a650-e3369bd94d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:04.025367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49149376-e34a-4ba8-a650-e3369bd94d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:04.025899 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49149376-e34a-4ba8-a650-e3369bd94d58 admin admin] PATH_INFO: `/v3/projects/a6d9cb01d56f4a6c89c0468d5c4aab87` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:04.028087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49149376-e34a-4ba8-a650-e3369bd94d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d9cb01d56f4a6c89c0468d5c4aab87)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:04.035442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49149376-e34a-4ba8-a650-e3369bd94d58 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:04.066213 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:04.069335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:04.089602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd3523-b625-4955-8275-aca51802f39d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:04.095689 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ab441-38e4-47e8-9907-388f2e2a32e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:04.096678 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ab441-38e4-47e8-9907-388f2e2a32e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:04.097170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ab441-38e4-47e8-9907-388f2e2a32e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:04.097651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ab441-38e4-47e8-9907-388f2e2a32e3 admin admin] PATH_INFO: `/v3/projects/37704287f4014b46bc75f750de5af8bc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:04.099000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ab441-38e4-47e8-9907-388f2e2a32e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37704287f4014b46bc75f750de5af8bc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:04.101410 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ab441-38e4-47e8-9907-388f2e2a32e3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:04.112999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-49149376-e34a-4ba8-a650-e3369bd94d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d9cb01d56f4a6c89c0468d5c4aab87', 'request_id': 'req-49149376-e34a-4ba8-a650-e3369bd94d58'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.128651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-49149376-e34a-4ba8-a650-e3369bd94d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d9cb01d56f4a6c89c0468d5c4aab87', 'request_id': 'req-49149376-e34a-4ba8-a650-e3369bd94d58'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.148075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-49149376-e34a-4ba8-a650-e3369bd94d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d9cb01d56f4a6c89c0468d5c4aab87', 'request_id': 'req-49149376-e34a-4ba8-a650-e3369bd94d58'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.167888 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-49149376-e34a-4ba8-a650-e3369bd94d58 admin admin] The token cache is being invalidate because project a6d9cb01d56f4a6c89c0468d5c4aab87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:04.168296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-49149376-e34a-4ba8-a650-e3369bd94d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.169167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-49149376-e34a-4ba8-a650-e3369bd94d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.175299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 903/1811] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:03 2022] DELETE /identity/v3/projects/a6d9cb01d56f4a6c89c0468d5c4aab87 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:04.178538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca88e12-e233-4278-8d45-57c690264c25 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:04.178860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e21ab441-38e4-47e8-9907-388f2e2a32e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37704287f4014b46bc75f750de5af8bc', 'request_id': 'req-e21ab441-38e4-47e8-9907-388f2e2a32e3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.179300 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca88e12-e233-4278-8d45-57c690264c25 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:04.179749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca88e12-e233-4278-8d45-57c690264c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:04.187923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e21ab441-38e4-47e8-9907-388f2e2a32e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37704287f4014b46bc75f750de5af8bc', 'request_id': 'req-e21ab441-38e4-47e8-9907-388f2e2a32e3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.200374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e21ab441-38e4-47e8-9907-388f2e2a32e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37704287f4014b46bc75f750de5af8bc', 'request_id': 'req-e21ab441-38e4-47e8-9907-388f2e2a32e3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.210155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7ca88e12-e233-4278-8d45-57c690264c25 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:04.211451 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7ca88e12-e233-4278-8d45-57c690264c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:04.219034 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e21ab441-38e4-47e8-9907-388f2e2a32e3 admin admin] The token cache is being invalidate because project 37704287f4014b46bc75f750de5af8bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:04.219497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e21ab441-38e4-47e8-9907-388f2e2a32e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.220871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e21ab441-38e4-47e8-9907-388f2e2a32e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.223730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 909/1812] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:04 2022] DELETE /identity/v3/projects/37704287f4014b46bc75f750de5af8bc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:04.240386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db60620-3935-454f-a6cc-ea0813f96c42 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:04.240819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db60620-3935-454f-a6cc-ea0813f96c42 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:04.241201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db60620-3935-454f-a6cc-ea0813f96c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:04.262810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6db60620-3935-454f-a6cc-ea0813f96c42 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:04.265424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6db60620-3935-454f-a6cc-ea0813f96c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:04.282109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:04.303500 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 904/1813] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:04.306132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc172ca-c0d5-40f1-b499-390c66ab1603 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:04.306421 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc172ca-c0d5-40f1-b499-390c66ab1603 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:04.306700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc172ca-c0d5-40f1-b499-390c66ab1603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:04.332716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-bbc172ca-c0d5-40f1-b499-390c66ab1603 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:04.335026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-bbc172ca-c0d5-40f1-b499-390c66ab1603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:04.350249 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 905/1814] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:04.351358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc172ca-c0d5-40f1-b499-390c66ab1603 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:04.363918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc172ca-c0d5-40f1-b499-390c66ab1603 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:04.371511 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53675ca-0eb3-49e9-97e5-0548a83bc8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:04.372600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53675ca-0eb3-49e9-97e5-0548a83bc8ac admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:04.372905 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53675ca-0eb3-49e9-97e5-0548a83bc8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:04.373699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53675ca-0eb3-49e9-97e5-0548a83bc8ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:04.374102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53675ca-0eb3-49e9-97e5-0548a83bc8ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:04.374520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53675ca-0eb3-49e9-97e5-0548a83bc8ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:04.376187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53675ca-0eb3-49e9-97e5-0548a83bc8ac admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:04.378418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 910/1815] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:04.385648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c8e5f-c765-41a4-af1e-b4711c3f935f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:04.386550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c8e5f-c765-41a4-af1e-b4711c3f935f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:04.386550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c8e5f-c765-41a4-af1e-b4711c3f935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:04.403157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 906/1816] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:04.408491 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53675ca-0eb3-49e9-97e5-0548a83bc8ac admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:04.413078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b18c8e5f-c765-41a4-af1e-b4711c3f935f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:04.415689 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b18c8e5f-c765-41a4-af1e-b4711c3f935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:04.430674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53675ca-0eb3-49e9-97e5-0548a83bc8ac admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:04.435816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f895c9-fc5d-44ee-ae6f-e385002a5e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:04.436487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f895c9-fc5d-44ee-ae6f-e385002a5e61 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:04.436777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f895c9-fc5d-44ee-ae6f-e385002a5e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:04.437055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f895c9-fc5d-44ee-ae6f-e385002a5e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:04.437752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f895c9-fc5d-44ee-ae6f-e385002a5e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:04.439638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 911/1817] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:04.440733 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c8e5f-c765-41a4-af1e-b4711c3f935f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:04.441579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f895c9-fc5d-44ee-ae6f-e385002a5e61 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:04.450338 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c8e5f-c765-41a4-af1e-b4711c3f935f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:04.457414 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca99a4-f347-44df-b168-d2b397a7af31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:04.458110 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca99a4-f347-44df-b168-d2b397a7af31 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:04.458362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca99a4-f347-44df-b168-d2b397a7af31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:04.458635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca99a4-f347-44df-b168-d2b397a7af31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:04.463835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca99a4-f347-44df-b168-d2b397a7af31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:04.464139 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca99a4-f347-44df-b168-d2b397a7af31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:04.466648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca99a4-f347-44df-b168-d2b397a7af31 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:04.489518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 912/1818] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:04.489518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca99a4-f347-44df-b168-d2b397a7af31 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:04.490541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e1ca99a4-f347-44df-b168-d2b397a7af31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:04.518296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca99a4-f347-44df-b168-d2b397a7af31 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:04.519057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 907/1819] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:04 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:04.520124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f895c9-fc5d-44ee-ae6f-e385002a5e61 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:04.631856 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:04.663217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:04.664553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:04.664846 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:04.665123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] PATH_INFO: `/v3/projects/a6bf361d22864712a1a2f6c843116b80` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:04.668409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6bf361d22864712a1a2f6c843116b80)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:04.669353 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f895c9-fc5d-44ee-ae6f-e385002a5e61 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:04.676726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:04.677294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fda2a-f405-4bb1-bd3c-4cf2e9298ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:04.677976 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fda2a-f405-4bb1-bd3c-4cf2e9298ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:04.678348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fda2a-f405-4bb1-bd3c-4cf2e9298ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:04.678771 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fda2a-f405-4bb1-bd3c-4cf2e9298ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:04.679601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fda2a-f405-4bb1-bd3c-4cf2e9298ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:04.681810 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fda2a-f405-4bb1-bd3c-4cf2e9298ca6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:04.724596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 908/1820] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:04 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:04.727969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fda2a-f405-4bb1-bd3c-4cf2e9298ca6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:04.791444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6bf361d22864712a1a2f6c843116b80', 'request_id': 'req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.808991 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6bf361d22864712a1a2f6c843116b80', 'request_id': 'req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.825180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6bf361d22864712a1a2f6c843116b80', 'request_id': 'req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.855532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] The token cache is being invalidate because project a6bf361d22864712a1a2f6c843116b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:04.856060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.856973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:04.859157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 913/1821] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:04 2022] DELETE /identity/v3/projects/a6bf361d22864712a1a2f6c843116b80 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:04.860342 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:04.863481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:04.875316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fda2a-f405-4bb1-bd3c-4cf2e9298ca6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:04.912365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:04.954977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b845ad1-a508-4de0-afbf-aeef86b5d43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:04.955791 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b845ad1-a508-4de0-afbf-aeef86b5d43f admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:04.956096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b845ad1-a508-4de0-afbf-aeef86b5d43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:04.956400 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b845ad1-a508-4de0-afbf-aeef86b5d43f admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:04.957150 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b845ad1-a508-4de0-afbf-aeef86b5d43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:04.959708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b845ad1-a508-4de0-afbf-aeef86b5d43f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:05.003464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 909/1822] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:04 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:05.004894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb2ab3-2d03-4457-8090-a0e4dd8810d5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.005189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb2ab3-2d03-4457-8090-a0e4dd8810d5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.006279 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb2ab3-2d03-4457-8090-a0e4dd8810d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.009387 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5ecfa-b18b-486e-8ff5-0864530e4ca8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:05.025311 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692413f-157e-4b27-93d0-517073b32eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:05.026010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692413f-157e-4b27-93d0-517073b32eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.026298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692413f-157e-4b27-93d0-517073b32eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.026876 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692413f-157e-4b27-93d0-517073b32eaf admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.027342 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692413f-157e-4b27-93d0-517073b32eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:05.030886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692413f-157e-4b27-93d0-517073b32eaf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:05.041177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7feb2ab3-2d03-4457-8090-a0e4dd8810d5 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:05.042725 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7feb2ab3-2d03-4457-8090-a0e4dd8810d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:05.064981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 910/1823] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:05.065773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb2ab3-2d03-4457-8090-a0e4dd8810d5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:05.067152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7feb2ab3-2d03-4457-8090-a0e4dd8810d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:05.084351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb2ab3-2d03-4457-8090-a0e4dd8810d5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:05.089742 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4bcfa-f528-49cc-bff6-e5360dd35708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:05.090534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4bcfa-f528-49cc-bff6-e5360dd35708 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.091754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4bcfa-f528-49cc-bff6-e5360dd35708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.092041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4bcfa-f528-49cc-bff6-e5360dd35708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.092800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4bcfa-f528-49cc-bff6-e5360dd35708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:05.094438 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4bcfa-f528-49cc-bff6-e5360dd35708 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:05.100782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 914/1824] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:04 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:05.106578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381a65-4c0d-40b7-81ab-7dbdb2370e0c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.109853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381a65-4c0d-40b7-81ab-7dbdb2370e0c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.110142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381a65-4c0d-40b7-81ab-7dbdb2370e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.115754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 911/1825] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:05.117286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4bcfa-f528-49cc-bff6-e5360dd35708 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:05.128459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4bcfa-f528-49cc-bff6-e5360dd35708 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:05.133879 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33375e40-243b-41d8-9906-5a881c76f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:05.134559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33375e40-243b-41d8-9906-5a881c76f114 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.134844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33375e40-243b-41d8-9906-5a881c76f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.135116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33375e40-243b-41d8-9906-5a881c76f114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.136035 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33375e40-243b-41d8-9906-5a881c76f114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:05.137663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33375e40-243b-41d8-9906-5a881c76f114 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:05.156139 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 912/1826] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:05.162610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33375e40-243b-41d8-9906-5a881c76f114 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:05.168566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-30381a65-4c0d-40b7-81ab-7dbdb2370e0c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:05.170400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-30381a65-4c0d-40b7-81ab-7dbdb2370e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:05.176117 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33375e40-243b-41d8-9906-5a881c76f114 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:05.180970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f395abd-b596-438b-b66d-67cd4ee9c73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:05.181650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f395abd-b596-438b-b66d-67cd4ee9c73e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.181935 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f395abd-b596-438b-b66d-67cd4ee9c73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.182223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f395abd-b596-438b-b66d-67cd4ee9c73e admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.182944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f395abd-b596-438b-b66d-67cd4ee9c73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:05.184307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 915/1827] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:05.185371 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30381a65-4c0d-40b7-81ab-7dbdb2370e0c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:05.187945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f395abd-b596-438b-b66d-67cd4ee9c73e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:05.204144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30381a65-4c0d-40b7-81ab-7dbdb2370e0c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:05.211386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5846cc-8924-4fa6-acf7-e4965ddecaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:05.212625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5846cc-8924-4fa6-acf7-e4965ddecaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.213962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 913/1828] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:05.214356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5846cc-8924-4fa6-acf7-e4965ddecaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.214856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5846cc-8924-4fa6-acf7-e4965ddecaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.214957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f395abd-b596-438b-b66d-67cd4ee9c73e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:05.215927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5846cc-8924-4fa6-acf7-e4965ddecaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:05.220468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5846cc-8924-4fa6-acf7-e4965ddecaf2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:05.237511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 916/1829] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:05.238569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5846cc-8924-4fa6-acf7-e4965ddecaf2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:05.239953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f395abd-b596-438b-b66d-67cd4ee9c73e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:05.245033 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f7773-9259-41ae-abc2-1d97bb262567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:05.245947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f7773-9259-41ae-abc2-1d97bb262567 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.246241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f7773-9259-41ae-abc2-1d97bb262567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.246520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f7773-9259-41ae-abc2-1d97bb262567 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.247283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f7773-9259-41ae-abc2-1d97bb262567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:05.247597 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f7773-9259-41ae-abc2-1d97bb262567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:05.249203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f7773-9259-41ae-abc2-1d97bb262567 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:05.255067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5846cc-8924-4fa6-acf7-e4965ddecaf2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:05.262896 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba91b3d-abb6-4071-8d29-ac8bd4a2b553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:05.264194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba91b3d-abb6-4071-8d29-ac8bd4a2b553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.264756 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 914/1830] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:05.264874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba91b3d-abb6-4071-8d29-ac8bd4a2b553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.265317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba91b3d-abb6-4071-8d29-ac8bd4a2b553 admin admin] PATH_INFO: `/v3/projects/40aa8f181225435a83600bbbb7528143/users/ba96f7c1642c49c18d5d4e1f06b0d446/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.270085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f7773-9259-41ae-abc2-1d97bb262567 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:05.286084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f7773-9259-41ae-abc2-1d97bb262567 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:05.295899 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa18e02-8049-4183-9f63-113bfa1b60e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:05.296808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa18e02-8049-4183-9f63-113bfa1b60e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.297729 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa18e02-8049-4183-9f63-113bfa1b60e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.298022 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa18e02-8049-4183-9f63-113bfa1b60e9 admin admin] PATH_INFO: `/v3/projects/1e5c1b219017462683fc08690850d353/users/5eb10c5313554ebab5b3f99ed224e47b/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.300179 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba91b3d-abb6-4071-8d29-ac8bd4a2b553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40aa8f181225435a83600bbbb7528143, user_id=ba96f7c1642c49c18d5d4e1f06b0d446, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:05.303370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba91b3d-abb6-4071-8d29-ac8bd4a2b553 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:05.319970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:05.334009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 917/1831] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:05 2022] PUT /identity/v3/projects/40aa8f181225435a83600bbbb7528143/users/ba96f7c1642c49c18d5d4e1f06b0d446/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:05.346394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b916b-cf3f-4aeb-bd7d-30d8043c1b26 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.346697 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b916b-cf3f-4aeb-bd7d-30d8043c1b26 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.348013 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b916b-cf3f-4aeb-bd7d-30d8043c1b26 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.349695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 918/1832] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:42:05 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:42:05.350545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b916b-cf3f-4aeb-bd7d-30d8043c1b26 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:05.350967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa18e02-8049-4183-9f63-113bfa1b60e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5c1b219017462683fc08690850d353, user_id=5eb10c5313554ebab5b3f99ed224e47b, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:05.355702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa18e02-8049-4183-9f63-113bfa1b60e9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:05.385015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 915/1833] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:05 2022] PUT /identity/v3/projects/1e5c1b219017462683fc08690850d353/users/5eb10c5313554ebab5b3f99ed224e47b/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:05.386554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b25e0f-743d-40eb-8866-47d179a74dfa None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.386849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b25e0f-743d-40eb-8866-47d179a74dfa None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.387130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b25e0f-743d-40eb-8866-47d179a74dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.429877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-52b25e0f-743d-40eb-8866-47d179a74dfa None None] MFA Rules not processed for user `ba96f7c1642c49c18d5d4e1f06b0d446`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:05.431586 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-52b25e0f-743d-40eb-8866-47d179a74dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:05.472796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b916b-cf3f-4aeb-bd7d-30d8043c1b26 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:05.553385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729a6b4-d6f1-4cbe-9a1d-b096f3b97d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:05.554025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a6b4-d6f1-4cbe-9a1d-b096f3b97d66 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.554220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a6b4-d6f1-4cbe-9a1d-b096f3b97d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.554599 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a6b4-d6f1-4cbe-9a1d-b096f3b97d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.555346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729a6b4-d6f1-4cbe-9a1d-b096f3b97d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:05.557451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729a6b4-d6f1-4cbe-9a1d-b096f3b97d66 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:05.594589 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 919/1834] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:05 2022] POST /identity/v3/projects => generated 363 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:05.604364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f115283-4ce8-4da7-9b4d-3ed446685063 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.605386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f115283-4ce8-4da7-9b4d-3ed446685063 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.606449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f115283-4ce8-4da7-9b4d-3ed446685063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.607244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 916/1835] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:05.615937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe4ea-f4b3-483d-b28e-9d018014560e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.616417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe4ea-f4b3-483d-b28e-9d018014560e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.616779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe4ea-f4b3-483d-b28e-9d018014560e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.663803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:05.675294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-694fe4ea-f4b3-483d-b28e-9d018014560e None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:05.676995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-694fe4ea-f4b3-483d-b28e-9d018014560e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:05.714637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2f115283-4ce8-4da7-9b4d-3ed446685063 None None] MFA Rules not processed for user `5eb10c5313554ebab5b3f99ed224e47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:05.717879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2f115283-4ce8-4da7-9b4d-3ed446685063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:05.857579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 920/1836] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:05.859087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f115283-4ce8-4da7-9b4d-3ed446685063 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:05.878779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 917/1837] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:42:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:05.880979 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fe4ea-f4b3-483d-b28e-9d018014560e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:05.974729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f115283-4ce8-4da7-9b4d-3ed446685063 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:05.992537 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cf263-0ecb-4645-b174-0f6144c7ed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:05.993317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cf263-0ecb-4645-b174-0f6144c7ed46 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:05.993975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cf263-0ecb-4645-b174-0f6144c7ed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:05.994333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cf263-0ecb-4645-b174-0f6144c7ed46 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:05.994770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fe4ea-f4b3-483d-b28e-9d018014560e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:05.995397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cf263-0ecb-4645-b174-0f6144c7ed46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:05.997882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cf263-0ecb-4645-b174-0f6144c7ed46 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.000132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5dd20-25f7-420f-977c-a51d0f9ccef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.000955 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5dd20-25f7-420f-977c-a51d0f9ccef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.002030 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5dd20-25f7-420f-977c-a51d0f9ccef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.002393 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5dd20-25f7-420f-977c-a51d0f9ccef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.003164 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5dd20-25f7-420f-977c-a51d0f9ccef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.006157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5dd20-25f7-420f-977c-a51d0f9ccef9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.030809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:06.048016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 921/1838] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:05 2022] POST /identity/v3/users => generated 282 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:06.048458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 918/1839] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:05 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:06.049246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5dd20-25f7-420f-977c-a51d0f9ccef9 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.052247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cf263-0ecb-4645-b174-0f6144c7ed46 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.056476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-847cf263-0ecb-4645-b174-0f6144c7ed46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:06.096716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cf263-0ecb-4645-b174-0f6144c7ed46 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.139277 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5dd20-25f7-420f-977c-a51d0f9ccef9 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.147658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f2658-fbbe-4042-a6cb-de091f620199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.147943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f2658-fbbe-4042-a6cb-de091f620199 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.148257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f2658-fbbe-4042-a6cb-de091f620199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.148541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f2658-fbbe-4042-a6cb-de091f620199 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.149345 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f2658-fbbe-4042-a6cb-de091f620199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.151689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f2658-fbbe-4042-a6cb-de091f620199 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.198772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 919/1840] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:06 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:06.199704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f2658-fbbe-4042-a6cb-de091f620199 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.247448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b9932-1f90-4f08-a7ea-9bb5a9f6e9cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.251308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b9932-1f90-4f08-a7ea-9bb5a9f6e9cd service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.253295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b9932-1f90-4f08-a7ea-9bb5a9f6e9cd service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.254496 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b9932-1f90-4f08-a7ea-9bb5a9f6e9cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.272762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b9932-1f90-4f08-a7ea-9bb5a9f6e9cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.280424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b9932-1f90-4f08-a7ea-9bb5a9f6e9cd service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.307854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 922/1841] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:06.316228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b9932-1f90-4f08-a7ea-9bb5a9f6e9cd service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.323800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f2658-fbbe-4042-a6cb-de091f620199 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.332944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b604a-dcc7-4e32-b8e7-d41171e2d24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.333705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b604a-dcc7-4e32-b8e7-d41171e2d24c admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.333966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b604a-dcc7-4e32-b8e7-d41171e2d24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.334268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b604a-dcc7-4e32-b8e7-d41171e2d24c admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.335070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b604a-dcc7-4e32-b8e7-d41171e2d24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.336903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b604a-dcc7-4e32-b8e7-d41171e2d24c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.339574 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b9932-1f90-4f08-a7ea-9bb5a9f6e9cd service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.348245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28d46-4cd0-4ccb-ab6b-04561a9e0938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.348947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28d46-4cd0-4ccb-ab6b-04561a9e0938 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.349264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28d46-4cd0-4ccb-ab6b-04561a9e0938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.349547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28d46-4cd0-4ccb-ab6b-04561a9e0938 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.350246 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28d46-4cd0-4ccb-ab6b-04561a9e0938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.352395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28d46-4cd0-4ccb-ab6b-04561a9e0938 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.353759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 920/1842] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:06.354759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b604a-dcc7-4e32-b8e7-d41171e2d24c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.366094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b604a-dcc7-4e32-b8e7-d41171e2d24c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.369977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:06.372126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f53df-6c57-42d5-b055-9f874960d94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.373646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f53df-6c57-42d5-b055-9f874960d94c admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.373964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f53df-6c57-42d5-b055-9f874960d94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.374297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f53df-6c57-42d5-b055-9f874960d94c admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.375111 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f53df-6c57-42d5-b055-9f874960d94c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.379337 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f53df-6c57-42d5-b055-9f874960d94c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.396310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 923/1843] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:06 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:06.397509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28d46-4cd0-4ccb-ab6b-04561a9e0938 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.409100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28d46-4cd0-4ccb-ab6b-04561a9e0938 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.413103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 921/1844] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:06 2022] POST /identity/v3/users => generated 294 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:06.413952 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f53df-6c57-42d5-b055-9f874960d94c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.414490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55125d8-e977-4429-b171-377632f9a3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.415927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55125d8-e977-4429-b171-377632f9a3dd admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.416231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55125d8-e977-4429-b171-377632f9a3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.416513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55125d8-e977-4429-b171-377632f9a3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.418486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55125d8-e977-4429-b171-377632f9a3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.420373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55125d8-e977-4429-b171-377632f9a3dd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.426130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f53df-6c57-42d5-b055-9f874960d94c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.432113 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf16f6b-5684-484c-9d36-d94889f4ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.435683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf16f6b-5684-484c-9d36-d94889f4ddc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.440579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf16f6b-5684-484c-9d36-d94889f4ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.440579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf16f6b-5684-484c-9d36-d94889f4ddc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.440813 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 924/1845] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:06.440890 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf16f6b-5684-484c-9d36-d94889f4ddc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.440964 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55125d8-e977-4429-b171-377632f9a3dd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.441039 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf16f6b-5684-484c-9d36-d94889f4ddc4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.453002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55125d8-e977-4429-b171-377632f9a3dd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.459312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 922/1846] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:06.460086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf16f6b-5684-484c-9d36-d94889f4ddc4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.462350 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70399a5-cd78-4a68-94ae-5aa29f3ee8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.463420 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70399a5-cd78-4a68-94ae-5aa29f3ee8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.463722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70399a5-cd78-4a68-94ae-5aa29f3ee8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.464193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70399a5-cd78-4a68-94ae-5aa29f3ee8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.464935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70399a5-cd78-4a68-94ae-5aa29f3ee8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.468184 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70399a5-cd78-4a68-94ae-5aa29f3ee8f4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.470694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf16f6b-5684-484c-9d36-d94889f4ddc4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.480695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d1565-2470-4447-a670-f813df9d895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.485267 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 925/1847] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:06.485421 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d1565-2470-4447-a670-f813df9d895b admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.485421 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d1565-2470-4447-a670-f813df9d895b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.486238 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70399a5-cd78-4a68-94ae-5aa29f3ee8f4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.486373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d1565-2470-4447-a670-f813df9d895b admin admin] PATH_INFO: `/v3/projects/5646aa7bbde747b0b5679493a41ba963/users/6a8054bce6b44fcf829cc3fa5195fdab/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.498694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70399a5-cd78-4a68-94ae-5aa29f3ee8f4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.504980 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10ebc8-83ef-470e-8649-78b489b7c0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.506044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10ebc8-83ef-470e-8649-78b489b7c0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.506410 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10ebc8-83ef-470e-8649-78b489b7c0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.506620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10ebc8-83ef-470e-8649-78b489b7c0bf admin admin] PATH_INFO: `/v3/projects/6fbe2c1dce7f47479c6dabdfceb9e90a/users/a7657972d08d4f5496b35cc8a3be93a9/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.508081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d1565-2470-4447-a670-f813df9d895b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5646aa7bbde747b0b5679493a41ba963, user_id=6a8054bce6b44fcf829cc3fa5195fdab, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.511071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d1565-2470-4447-a670-f813df9d895b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.526252 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 923/1848] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:06 2022] PUT /identity/v3/projects/5646aa7bbde747b0b5679493a41ba963/users/6a8054bce6b44fcf829cc3fa5195fdab/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:06.536929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10ebc8-83ef-470e-8649-78b489b7c0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbe2c1dce7f47479c6dabdfceb9e90a, user_id=a7657972d08d4f5496b35cc8a3be93a9, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.537042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d1565-2470-4447-a670-f813df9d895b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.537152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10ebc8-83ef-470e-8649-78b489b7c0bf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.551128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 926/1849] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:06 2022] PUT /identity/v3/projects/6fbe2c1dce7f47479c6dabdfceb9e90a/users/a7657972d08d4f5496b35cc8a3be93a9/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:06.552568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63418c67-be8b-427c-b47d-76fe01256c2c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.552913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63418c67-be8b-427c-b47d-76fe01256c2c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.553386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63418c67-be8b-427c-b47d-76fe01256c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.573128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:06.587831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-63418c67-be8b-427c-b47d-76fe01256c2c None None] MFA Rules not processed for user `6a8054bce6b44fcf829cc3fa5195fdab`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:06.589163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-63418c67-be8b-427c-b47d-76fe01256c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:06.633809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d1565-2470-4447-a670-f813df9d895b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.674961 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 927/1850] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:06.676258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63418c67-be8b-427c-b47d-76fe01256c2c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.697583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1266808-dfca-45a2-a6f7-faaa53e18bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.698487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1266808-dfca-45a2-a6f7-faaa53e18bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.698771 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1266808-dfca-45a2-a6f7-faaa53e18bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.699052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1266808-dfca-45a2-a6f7-faaa53e18bb1 admin admin] PATH_INFO: `/v3/projects/c1a994e931694bd8a4e6dea964525a5c/users/115eac3243f24363ab59c63afb727a16/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.717723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1266808-dfca-45a2-a6f7-faaa53e18bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a994e931694bd8a4e6dea964525a5c, user_id=115eac3243f24363ab59c63afb727a16, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.721674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1266808-dfca-45a2-a6f7-faaa53e18bb1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.741125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 924/1851] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:06 2022] PUT /identity/v3/projects/c1a994e931694bd8a4e6dea964525a5c/users/115eac3243f24363ab59c63afb727a16/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:06.741925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1266808-dfca-45a2-a6f7-faaa53e18bb1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.767196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63418c67-be8b-427c-b47d-76fe01256c2c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.820590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:06.835334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1266808-dfca-45a2-a6f7-faaa53e18bb1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.838741 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dfb2f-7a94-429b-af81-25d96a27b423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.840139 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dfb2f-7a94-429b-af81-25d96a27b423 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.840682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dfb2f-7a94-429b-af81-25d96a27b423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.841389 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302ca29-8494-4ce7-9d7d-713c845dbe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.841815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dfb2f-7a94-429b-af81-25d96a27b423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.842295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ca29-8494-4ce7-9d7d-713c845dbe6f admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.843206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ca29-8494-4ce7-9d7d-713c845dbe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.843206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ca29-8494-4ce7-9d7d-713c845dbe6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.843720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302ca29-8494-4ce7-9d7d-713c845dbe6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.844913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dfb2f-7a94-429b-af81-25d96a27b423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.846330 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302ca29-8494-4ce7-9d7d-713c845dbe6f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.850928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dfb2f-7a94-429b-af81-25d96a27b423 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.868071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 928/1852] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:06.870163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dfb2f-7a94-429b-af81-25d96a27b423 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.884044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dfb2f-7a94-429b-af81-25d96a27b423 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.888368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 925/1853] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:06 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:06.888368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302ca29-8494-4ce7-9d7d-713c845dbe6f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:06.942471 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:06.966972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302ca29-8494-4ce7-9d7d-713c845dbe6f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:06.973467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde15dc-9e6a-436b-946e-354d736b3542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.974369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde15dc-9e6a-436b-946e-354d736b3542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.974665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde15dc-9e6a-436b-946e-354d736b3542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.974937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde15dc-9e6a-436b-946e-354d736b3542 admin admin] PATH_INFO: `/v3/projects/6fbe2c1dce7f47479c6dabdfceb9e90a/users/a7657972d08d4f5496b35cc8a3be93a9/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.975342 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d5bb0-47e8-40f0-a305-767c2019dea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:06.976090 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d5bb0-47e8-40f0-a305-767c2019dea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:06.976435 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d5bb0-47e8-40f0-a305-767c2019dea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:06.976778 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d5bb0-47e8-40f0-a305-767c2019dea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:06.977108 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde15dc-9e6a-436b-946e-354d736b3542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbe2c1dce7f47479c6dabdfceb9e90a, user_id=a7657972d08d4f5496b35cc8a3be93a9, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.977638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d5bb0-47e8-40f0-a305-767c2019dea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:06.979475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d5bb0-47e8-40f0-a305-767c2019dea5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:06.980152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde15dc-9e6a-436b-946e-354d736b3542 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:07.004826 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 929/1854] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:07.005016 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 926/1855] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:06 2022] PUT /identity/v3/projects/6fbe2c1dce7f47479c6dabdfceb9e90a/users/a7657972d08d4f5496b35cc8a3be93a9/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:07.005096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d5bb0-47e8-40f0-a305-767c2019dea5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:07.005204 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde15dc-9e6a-436b-946e-354d736b3542 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:07.006469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d5bb0-47e8-40f0-a305-767c2019dea5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:07.088045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde15dc-9e6a-436b-946e-354d736b3542 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:07.093371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec91a11-4404-499d-a8c2-afd0684d9944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:07.094302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec91a11-4404-499d-a8c2-afd0684d9944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:07.094589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec91a11-4404-499d-a8c2-afd0684d9944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:07.094867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec91a11-4404-499d-a8c2-afd0684d9944 admin admin] PATH_INFO: `/v3/projects/c1a994e931694bd8a4e6dea964525a5c/users/115eac3243f24363ab59c63afb727a16/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:07.097817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec91a11-4404-499d-a8c2-afd0684d9944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a994e931694bd8a4e6dea964525a5c, user_id=115eac3243f24363ab59c63afb727a16, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:07.100583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec91a11-4404-499d-a8c2-afd0684d9944 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:07.117617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 927/1856] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:06 2022] PUT /identity/v3/projects/c1a994e931694bd8a4e6dea964525a5c/users/115eac3243f24363ab59c63afb727a16/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:07.121507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419147a-6eaf-4c6a-b463-3e9cc6f73f92 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:07.121795 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419147a-6eaf-4c6a-b463-3e9cc6f73f92 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:07.122083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419147a-6eaf-4c6a-b463-3e9cc6f73f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:07.155459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3419147a-6eaf-4c6a-b463-3e9cc6f73f92 None None] MFA Rules not processed for user `a7657972d08d4f5496b35cc8a3be93a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:07.156720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3419147a-6eaf-4c6a-b463-3e9cc6f73f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:07.193919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09679c9b-ff9a-4e30-b1c6-7c319129e441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:07.194683 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09679c9b-ff9a-4e30-b1c6-7c319129e441 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:07.195195 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09679c9b-ff9a-4e30-b1c6-7c319129e441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:07.195550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09679c9b-ff9a-4e30-b1c6-7c319129e441 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:07.196333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09679c9b-ff9a-4e30-b1c6-7c319129e441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:07.198571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09679c9b-ff9a-4e30-b1c6-7c319129e441 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:07.223844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 930/1857] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:06 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:07.225056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faf04d-6699-4105-8efa-37b4b121c7da None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:07.225369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faf04d-6699-4105-8efa-37b4b121c7da None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:07.225654 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faf04d-6699-4105-8efa-37b4b121c7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:07.244286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 928/1858] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:07.245127 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419147a-6eaf-4c6a-b463-3e9cc6f73f92 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:07.251788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d0faf04d-6699-4105-8efa-37b4b121c7da None None] MFA Rules not processed for user `115eac3243f24363ab59c63afb727a16`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:07.253401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d0faf04d-6699-4105-8efa-37b4b121c7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:07.304364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:07.306455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:07.318361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419147a-6eaf-4c6a-b463-3e9cc6f73f92 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:07.324432 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8ccf0-74cd-47d4-9d7e-558530fad2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:07.325391 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8ccf0-74cd-47d4-9d7e-558530fad2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:07.325682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8ccf0-74cd-47d4-9d7e-558530fad2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:07.326140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8ccf0-74cd-47d4-9d7e-558530fad2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:07.326855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8ccf0-74cd-47d4-9d7e-558530fad2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:07.328667 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8ccf0-74cd-47d4-9d7e-558530fad2a3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:07.329248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 931/1859] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:07.330766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faf04d-6699-4105-8efa-37b4b121c7da None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:07.332876 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d0faf04d-6699-4105-8efa-37b4b121c7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:07.340801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 929/1860] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:07.344880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8ccf0-74cd-47d4-9d7e-558530fad2a3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:07.359925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8ccf0-74cd-47d4-9d7e-558530fad2a3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:07.365772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8c32f-599b-468a-9a3f-11bf0ff66b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:07.366671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8c32f-599b-468a-9a3f-11bf0ff66b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:07.366958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8c32f-599b-468a-9a3f-11bf0ff66b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:07.367280 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8c32f-599b-468a-9a3f-11bf0ff66b3c admin admin] PATH_INFO: `/v3/projects/9787582a8e1c42afa49c11b7119aa37a/users/3ab889a2788441a3b0ebc07327932749/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:07.383262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8c32f-599b-468a-9a3f-11bf0ff66b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9787582a8e1c42afa49c11b7119aa37a, user_id=3ab889a2788441a3b0ebc07327932749, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:07.385960 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8c32f-599b-468a-9a3f-11bf0ff66b3c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:07.400657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 930/1861] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:07 2022] PUT /identity/v3/projects/9787582a8e1c42afa49c11b7119aa37a/users/3ab889a2788441a3b0ebc07327932749/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:07.403766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faf04d-6699-4105-8efa-37b4b121c7da None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:07.404505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8c32f-599b-468a-9a3f-11bf0ff66b3c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:07.406054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-04d8c32f-599b-468a-9a3f-11bf0ff66b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:07.451510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46ede5-e2d8-42af-a1f1-b563f48f7b00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:07.452161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46ede5-e2d8-42af-a1f1-b563f48f7b00 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:07.452474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46ede5-e2d8-42af-a1f1-b563f48f7b00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:07.452778 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46ede5-e2d8-42af-a1f1-b563f48f7b00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:07.462361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8c32f-599b-468a-9a3f-11bf0ff66b3c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:07.465979 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311c702-8530-424f-b8a7-5e4d3cf563c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:07.466619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311c702-8530-424f-b8a7-5e4d3cf563c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:07.466903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311c702-8530-424f-b8a7-5e4d3cf563c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:07.467199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311c702-8530-424f-b8a7-5e4d3cf563c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:07.513663 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46ede5-e2d8-42af-a1f1-b563f48f7b00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:07.515026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46ede5-e2d8-42af-a1f1-b563f48f7b00 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:07.523617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311c702-8530-424f-b8a7-5e4d3cf563c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:07.525002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 932/1862] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:07.525108 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311c702-8530-424f-b8a7-5e4d3cf563c4 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:07.525808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46ede5-e2d8-42af-a1f1-b563f48f7b00 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:07.535717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 931/1863] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:07.620573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:07.630083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46ede5-e2d8-42af-a1f1-b563f48f7b00 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:07.646158 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c20ab-af0f-487b-af2b-4e34009e6b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:07.648595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c20ab-af0f-487b-af2b-4e34009e6b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:07.648888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c20ab-af0f-487b-af2b-4e34009e6b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:07.649167 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c20ab-af0f-487b-af2b-4e34009e6b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:07.650785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c20ab-af0f-487b-af2b-4e34009e6b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:07.652752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c20ab-af0f-487b-af2b-4e34009e6b89 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:07.667236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 933/1864] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:07.670145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311c702-8530-424f-b8a7-5e4d3cf563c4 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:07.682325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311c702-8530-424f-b8a7-5e4d3cf563c4 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:07.691721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba73865-51fc-4616-ab12-b94ed9538617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:07.692945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba73865-51fc-4616-ab12-b94ed9538617 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:07.693303 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba73865-51fc-4616-ab12-b94ed9538617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:07.693659 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba73865-51fc-4616-ab12-b94ed9538617 admin admin] PATH_INFO: `/v3/projects/9787582a8e1c42afa49c11b7119aa37a/users/3ab889a2788441a3b0ebc07327932749/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:07.696186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba73865-51fc-4616-ab12-b94ed9538617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9787582a8e1c42afa49c11b7119aa37a, user_id=3ab889a2788441a3b0ebc07327932749, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:07.699014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba73865-51fc-4616-ab12-b94ed9538617 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:07.720944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 932/1865] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:07 2022] PUT /identity/v3/projects/9787582a8e1c42afa49c11b7119aa37a/users/3ab889a2788441a3b0ebc07327932749/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:07.722188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01123519-025f-44b3-bd29-9acd875b24e7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:07.722553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01123519-025f-44b3-bd29-9acd875b24e7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:07.722903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01123519-025f-44b3-bd29-9acd875b24e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:07.765123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-01123519-025f-44b3-bd29-9acd875b24e7 None None] MFA Rules not processed for user `3ab889a2788441a3b0ebc07327932749`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:07.766351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-01123519-025f-44b3-bd29-9acd875b24e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:07.883470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 934/1866] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:08.074477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba73865-51fc-4616-ab12-b94ed9538617 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:08.140892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba73865-51fc-4616-ab12-b94ed9538617 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:08.146693 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb5a13-6963-47aa-9597-11c8f4a57b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:08.147880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb5a13-6963-47aa-9597-11c8f4a57b03 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:08.148168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb5a13-6963-47aa-9597-11c8f4a57b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:08.148444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb5a13-6963-47aa-9597-11c8f4a57b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:08.160049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb5a13-6963-47aa-9597-11c8f4a57b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:08.165341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb5a13-6963-47aa-9597-11c8f4a57b03 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:08.168406 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01123519-025f-44b3-bd29-9acd875b24e7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:08.175632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 933/1867] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:08.293274 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb5a13-6963-47aa-9597-11c8f4a57b03 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:08.306108 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb5a13-6963-47aa-9597-11c8f4a57b03 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:08.321769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ee268-feb8-4adf-b67d-9e88bf9c8ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:08.323472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ee268-feb8-4adf-b67d-9e88bf9c8ead service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:08.324385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ee268-feb8-4adf-b67d-9e88bf9c8ead service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:08.325450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ee268-feb8-4adf-b67d-9e88bf9c8ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:08.340367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:08.346802 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01123519-025f-44b3-bd29-9acd875b24e7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:08.359248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924f9a3-5fa0-4b96-b3b6-9a8837e5b6f4 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7657972d08d4f5496b35cc8a3be93a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fbe2c1dce7f47479c6dabdfceb9e90a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:08.360032 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f9a3-5fa0-4b96-b3b6-9a8837e5b6f4 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:08.360322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f9a3-5fa0-4b96-b3b6-9a8837e5b6f4 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:08.361175 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f9a3-5fa0-4b96-b3b6-9a8837e5b6f4 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:08.361933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924f9a3-5fa0-4b96-b3b6-9a8837e5b6f4 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:08.362251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924f9a3-5fa0-4b96-b3b6-9a8837e5b6f4 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:08.366617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924f9a3-5fa0-4b96-b3b6-9a8837e5b6f4 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:08.397098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 935/1868] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:42:08.403602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924f9a3-5fa0-4b96-b3b6-9a8837e5b6f4 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:08.436593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924f9a3-5fa0-4b96-b3b6-9a8837e5b6f4 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:08.467253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17412a51-815d-478a-92f0-89e81eba4148 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7657972d08d4f5496b35cc8a3be93a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fbe2c1dce7f47479c6dabdfceb9e90a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:08.467907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17412a51-815d-478a-92f0-89e81eba4148 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:08.468555 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17412a51-815d-478a-92f0-89e81eba4148 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:08.468555 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17412a51-815d-478a-92f0-89e81eba4148 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:08.469547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17412a51-815d-478a-92f0-89e81eba4148 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:08.473630 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ee268-feb8-4adf-b67d-9e88bf9c8ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:08.475247 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ee268-feb8-4adf-b67d-9e88bf9c8ead service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:08.482073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17412a51-815d-478a-92f0-89e81eba4148 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:08.487669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 934/1869] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:08.551286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 936/1870] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:08 2022] POST /identity/v3/projects => generated 354 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:08.554917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ee268-feb8-4adf-b67d-9e88bf9c8ead service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:08.574974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ee268-feb8-4adf-b67d-9e88bf9c8ead service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:08.666118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884972e1-9311-482b-8cfe-68066c5b17a5 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7657972d08d4f5496b35cc8a3be93a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fbe2c1dce7f47479c6dabdfceb9e90a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:08.667006 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884972e1-9311-482b-8cfe-68066c5b17a5 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:08.668061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884972e1-9311-482b-8cfe-68066c5b17a5 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:08.668061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884972e1-9311-482b-8cfe-68066c5b17a5 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:08.668798 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884972e1-9311-482b-8cfe-68066c5b17a5 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:08.669565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884972e1-9311-482b-8cfe-68066c5b17a5 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:08.672478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884972e1-9311-482b-8cfe-68066c5b17a5 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:08.706614 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 935/1871] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:42:08.754480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17412a51-815d-478a-92f0-89e81eba4148 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:08.764824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17412a51-815d-478a-92f0-89e81eba4148 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:08.769931 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7657972d08d4f5496b35cc8a3be93a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fbe2c1dce7f47479c6dabdfceb9e90a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:08.770813 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:08.771095 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:08.771434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] PATH_INFO: `/v3/projects/ec70fdef223b42ed838fa4f90d71c248` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:08.772924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ec70fdef223b42ed838fa4f90d71c248)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:08.774843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:08.844482 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:08.865211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec70fdef223b42ed838fa4f90d71c248', 'request_id': 'req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:08.879494 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec70fdef223b42ed838fa4f90d71c248', 'request_id': 'req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:08.889950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec70fdef223b42ed838fa4f90d71c248', 'request_id': 'req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:08.905198 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] The token cache is being invalidate because project ec70fdef223b42ed838fa4f90d71c248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:08.905534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:08.906217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:08.909248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 937/1872] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:08 2022] DELETE /identity/v3/projects/ec70fdef223b42ed838fa4f90d71c248 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:09.140164 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884972e1-9311-482b-8cfe-68066c5b17a5 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:09.142526 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-884972e1-9311-482b-8cfe-68066c5b17a5 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:09.143860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:09.146420 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:09.240852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0bcdb-7f1e-4a81-ae6f-00a065a16ae1 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:09.254824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba623973-2576-4fec-8a11-ad391cb0effe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:09.255739 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba623973-2576-4fec-8a11-ad391cb0effe service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:09.256122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba623973-2576-4fec-8a11-ad391cb0effe service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:09.256521 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba623973-2576-4fec-8a11-ad391cb0effe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:09.258628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ba623973-2576-4fec-8a11-ad391cb0effe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:09.274287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884972e1-9311-482b-8cfe-68066c5b17a5 tempest-VolumeQuotaClassesTest-1330584720 tempest-VolumeQuotaClassesTest-1330584720-project-admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:09.348604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:09.366897 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:09.367974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:09.368380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:09.368737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] PATH_INFO: `/v3/users/ba96f7c1642c49c18d5d4e1f06b0d446` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:09.370035 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba96f7c1642c49c18d5d4e1f06b0d446)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:09.370374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba623973-2576-4fec-8a11-ad391cb0effe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:09.372236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:09.372564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba623973-2576-4fec-8a11-ad391cb0effe service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:09.391658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 938/1873] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:09.461055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba96f7c1642c49c18d5d4e1f06b0d446'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:09.461860 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba96f7c1642c49c18d5d4e1f06b0d446'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:09.478414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba96f7c1642c49c18d5d4e1f06b0d446'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:09.497904 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba96f7c1642c49c18d5d4e1f06b0d446'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:09.510930 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba96f7c1642c49c18d5d4e1f06b0d446'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:09.522770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 936/1874] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:09 2022] DELETE /identity/v3/users/ba96f7c1642c49c18d5d4e1f06b0d446 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:09.527249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df717de8-1963-422e-aa1b-d64dad067861 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:09.527707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df717de8-1963-422e-aa1b-d64dad067861 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:09.528045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df717de8-1963-422e-aa1b-d64dad067861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:09.552181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-df717de8-1963-422e-aa1b-d64dad067861 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:09.555205 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-df717de8-1963-422e-aa1b-d64dad067861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:09.726381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 939/1875] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:09.734905 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:09.736819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:09.872484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f8613-cd19-47a0-8d39-906841f8b37a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:09.879312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988099c7-19ac-4230-a581-056f3c56a321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:09.879984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988099c7-19ac-4230-a581-056f3c56a321 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:09.880275 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988099c7-19ac-4230-a581-056f3c56a321 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:09.880555 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988099c7-19ac-4230-a581-056f3c56a321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:09.891478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988099c7-19ac-4230-a581-056f3c56a321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:09.893687 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988099c7-19ac-4230-a581-056f3c56a321 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:09.906398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 937/1876] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:10.271606 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df717de8-1963-422e-aa1b-d64dad067861 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:10.273940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-df717de8-1963-422e-aa1b-d64dad067861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:10.314269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df717de8-1963-422e-aa1b-d64dad067861 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:10.320742 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:10.321686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:10.321975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:10.322255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90 admin admin] PATH_INFO: `/v3/projects/40aa8f181225435a83600bbbb7528143` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:10.323517 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40aa8f181225435a83600bbbb7528143)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:10.325970 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:10.366950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:10.421439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40aa8f181225435a83600bbbb7528143', 'request_id': 'req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:10.430245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40aa8f181225435a83600bbbb7528143', 'request_id': 'req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:10.440144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40aa8f181225435a83600bbbb7528143', 'request_id': 'req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:10.458765 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90 admin admin] The token cache is being invalidate because project 40aa8f181225435a83600bbbb7528143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:10.458988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:10.460125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2f874f3e-8dc1-4ae9-8382-e5b87d9e3b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:10.462666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 940/1877] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:10 2022] DELETE /identity/v3/projects/40aa8f181225435a83600bbbb7528143 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:10.465908 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988099c7-19ac-4230-a581-056f3c56a321 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:10.476808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988099c7-19ac-4230-a581-056f3c56a321 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:10.549615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:10.550534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:10.550804 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:10.551079 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] PATH_INFO: `/v3/users/a7657972d08d4f5496b35cc8a3be93a9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:10.552344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7657972d08d4f5496b35cc8a3be93a9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:10.554313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:10.569272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:10.624284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7657972d08d4f5496b35cc8a3be93a9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:10.624953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7657972d08d4f5496b35cc8a3be93a9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:10.644837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62ab00-0523-4211-992b-a8586acb4af1 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:10.645126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62ab00-0523-4211-992b-a8586acb4af1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:10.645288 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7657972d08d4f5496b35cc8a3be93a9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:10.645753 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62ab00-0523-4211-992b-a8586acb4af1 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:10.647609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 941/1878] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:42:10.658192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7657972d08d4f5496b35cc8a3be93a9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:10.664773 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcda9c-55e0-4105-a73e-036739aa629f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:10.665566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcda9c-55e0-4105-a73e-036739aa629f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:10.666102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcda9c-55e0-4105-a73e-036739aa629f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:10.671584 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7657972d08d4f5496b35cc8a3be93a9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:10.680624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 938/1879] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:10 2022] DELETE /identity/v3/users/a7657972d08d4f5496b35cc8a3be93a9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:10.726281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-14bcda9c-55e0-4105-a73e-036739aa629f None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:10.727403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-14bcda9c-55e0-4105-a73e-036739aa629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:10.930133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 942/1880] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:42:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:11.039253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:11.040657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:11.073057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154f8c8-aec1-4c5e-bf70-ee040a54062e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:11.082477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0f367-3230-4e30-9dd4-44cf42318361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:11.083244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0f367-3230-4e30-9dd4-44cf42318361 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:11.084016 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0f367-3230-4e30-9dd4-44cf42318361 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:11.084016 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0f367-3230-4e30-9dd4-44cf42318361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:11.096333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0f367-3230-4e30-9dd4-44cf42318361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:11.098553 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0f367-3230-4e30-9dd4-44cf42318361 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:11.142737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 939/1881] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:11.202973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcda9c-55e0-4105-a73e-036739aa629f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:11.205718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-14bcda9c-55e0-4105-a73e-036739aa629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:11.316328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcda9c-55e0-4105-a73e-036739aa629f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:11.321178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0830e-418a-402a-a08b-af308b3090a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:11.322298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0830e-418a-402a-a08b-af308b3090a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:11.322703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0830e-418a-402a-a08b-af308b3090a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:11.323093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0830e-418a-402a-a08b-af308b3090a6 admin admin] PATH_INFO: `/v3/projects/6fbe2c1dce7f47479c6dabdfceb9e90a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:11.324629 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0830e-418a-402a-a08b-af308b3090a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fbe2c1dce7f47479c6dabdfceb9e90a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:11.326962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0830e-418a-402a-a08b-af308b3090a6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:11.382127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:11.399932 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-18d0830e-418a-402a-a08b-af308b3090a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fbe2c1dce7f47479c6dabdfceb9e90a', 'request_id': 'req-18d0830e-418a-402a-a08b-af308b3090a6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:11.406940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-18d0830e-418a-402a-a08b-af308b3090a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fbe2c1dce7f47479c6dabdfceb9e90a', 'request_id': 'req-18d0830e-418a-402a-a08b-af308b3090a6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:11.418669 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-18d0830e-418a-402a-a08b-af308b3090a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fbe2c1dce7f47479c6dabdfceb9e90a', 'request_id': 'req-18d0830e-418a-402a-a08b-af308b3090a6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:11.436955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-18d0830e-418a-402a-a08b-af308b3090a6 admin admin] The token cache is being invalidate because project 6fbe2c1dce7f47479c6dabdfceb9e90a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:11.437514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-18d0830e-418a-402a-a08b-af308b3090a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:11.438039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-18d0830e-418a-402a-a08b-af308b3090a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:11.440561 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 943/1882] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:11 2022] DELETE /identity/v3/projects/6fbe2c1dce7f47479c6dabdfceb9e90a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:11.446326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b7393-e6ba-4d9b-b836-fa79b788812e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:11.446618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b7393-e6ba-4d9b-b836-fa79b788812e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:11.446895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b7393-e6ba-4d9b-b836-fa79b788812e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:11.474023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a71b7393-e6ba-4d9b-b836-fa79b788812e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:11.475433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a71b7393-e6ba-4d9b-b836-fa79b788812e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:11.568618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 940/1883] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:11.576567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4679e39-757d-4341-82f6-76a95211cb8b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:11.576923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4679e39-757d-4341-82f6-76a95211cb8b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:11.577213 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4679e39-757d-4341-82f6-76a95211cb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:11.633294 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f4679e39-757d-4341-82f6-76a95211cb8b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:11.639767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f4679e39-757d-4341-82f6-76a95211cb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:11.676782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 944/1884] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:11.678000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b7393-e6ba-4d9b-b836-fa79b788812e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:11.693144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b7393-e6ba-4d9b-b836-fa79b788812e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:11.700624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9030da-6dc3-49be-a5aa-10e870fbc794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:11.701166 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9030da-6dc3-49be-a5aa-10e870fbc794 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:11.701455 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9030da-6dc3-49be-a5aa-10e870fbc794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:11.701828 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9030da-6dc3-49be-a5aa-10e870fbc794 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:11.702622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9030da-6dc3-49be-a5aa-10e870fbc794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:11.702943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9030da-6dc3-49be-a5aa-10e870fbc794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:11.705630 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9030da-6dc3-49be-a5aa-10e870fbc794 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:11.722279 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 941/1885] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:42:11.726501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4679e39-757d-4341-82f6-76a95211cb8b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:11.739963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4679e39-757d-4341-82f6-76a95211cb8b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:11.748028 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9030da-6dc3-49be-a5aa-10e870fbc794 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:11.750803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cf9030da-6dc3-49be-a5aa-10e870fbc794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:11.756125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6d845-37de-4f90-a473-c010a5f220d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:11.757921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6d845-37de-4f90-a473-c010a5f220d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:11.758496 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6d845-37de-4f90-a473-c010a5f220d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:11.762553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6d845-37de-4f90-a473-c010a5f220d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:11.763662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6d845-37de-4f90-a473-c010a5f220d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:11.765752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6d845-37de-4f90-a473-c010a5f220d7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:11.786520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9030da-6dc3-49be-a5aa-10e870fbc794 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:11.792472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:11.793571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:11.794097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:11.794654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] PATH_INFO: `/v3/users/6a8054bce6b44fcf829cc3fa5195fdab` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:11.796315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8054bce6b44fcf829cc3fa5195fdab)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:11.799038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:11.815537 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 945/1886] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:11 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:42:11.816464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6d845-37de-4f90-a473-c010a5f220d7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:11.818128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5bb6d845-37de-4f90-a473-c010a5f220d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:11.864546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8054bce6b44fcf829cc3fa5195fdab'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:11.865335 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8054bce6b44fcf829cc3fa5195fdab'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:11.874678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:11.883128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8054bce6b44fcf829cc3fa5195fdab'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:11.896838 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8054bce6b44fcf829cc3fa5195fdab'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:11.901629 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6d845-37de-4f90-a473-c010a5f220d7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:11.904728 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8054bce6b44fcf829cc3fa5195fdab'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:11.907696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72e98f-078c-46c1-b722-8e1ac8ea81d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:11.908680 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72e98f-078c-46c1-b722-8e1ac8ea81d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:11.909340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72e98f-078c-46c1-b722-8e1ac8ea81d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:11.909705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72e98f-078c-46c1-b722-8e1ac8ea81d9 admin admin] PATH_INFO: `/v3/users/26b3b11c616f42089633b8e8db3b08e8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:11.910998 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72e98f-078c-46c1-b722-8e1ac8ea81d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b3b11c616f42089633b8e8db3b08e8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:11.911761 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 942/1887] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:11 2022] DELETE /identity/v3/users/6a8054bce6b44fcf829cc3fa5195fdab => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:11.912338 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:11.913264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72e98f-078c-46c1-b722-8e1ac8ea81d9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:11.913672 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:12.004070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1c72e98f-078c-46c1-b722-8e1ac8ea81d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b3b11c616f42089633b8e8db3b08e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:12.013711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d4acb-674c-48a2-8afe-b65cb9d0b7bc admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:12.019863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd64a56-bc38-4936-966b-abf62624839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:12.020549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd64a56-bc38-4936-966b-abf62624839b admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:12.020835 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd64a56-bc38-4936-966b-abf62624839b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:12.021115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd64a56-bc38-4936-966b-abf62624839b admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:12.021813 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd64a56-bc38-4936-966b-abf62624839b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:12.022745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1c72e98f-078c-46c1-b722-8e1ac8ea81d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b3b11c616f42089633b8e8db3b08e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:12.024041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd64a56-bc38-4936-966b-abf62624839b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:12.031939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1c72e98f-078c-46c1-b722-8e1ac8ea81d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b3b11c616f42089633b8e8db3b08e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:12.032898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1c72e98f-078c-46c1-b722-8e1ac8ea81d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b3b11c616f42089633b8e8db3b08e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:12.049811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1c72e98f-078c-46c1-b722-8e1ac8ea81d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b3b11c616f42089633b8e8db3b08e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:12.059781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 946/1888] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:11 2022] DELETE /identity/v3/users/26b3b11c616f42089633b8e8db3b08e8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:12.063329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c89f-5e76-4daf-a02e-e95255f92490 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:12.063329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c89f-5e76-4daf-a02e-e95255f92490 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:12.063329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c89f-5e76-4daf-a02e-e95255f92490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:12.069236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 943/1889] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:11 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:12.070937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05711685-a319-4b32-b8f6-4366d2a2c775 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:12.071308 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05711685-a319-4b32-b8f6-4366d2a2c775 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:12.071643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05711685-a319-4b32-b8f6-4366d2a2c775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:12.088868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-db45c89f-5e76-4daf-a02e-e95255f92490 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:12.090176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-db45c89f-5e76-4daf-a02e-e95255f92490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:12.092415 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-05711685-a319-4b32-b8f6-4366d2a2c775 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:12.093630 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-05711685-a319-4b32-b8f6-4366d2a2c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:12.105225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:12.190458 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 947/1890] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:12.191692 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45c89f-5e76-4daf-a02e-e95255f92490 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:12.193592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 944/1891] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:12.195093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-db45c89f-5e76-4daf-a02e-e95255f92490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:12.205787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05711685-a319-4b32-b8f6-4366d2a2c775 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:12.207353 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-05711685-a319-4b32-b8f6-4366d2a2c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:12.217417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45c89f-5e76-4daf-a02e-e95255f92490 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:12.224526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c2875-4bb0-4c42-b8b2-0e976c0869da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:12.226009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c2875-4bb0-4c42-b8b2-0e976c0869da admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:12.239286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c2875-4bb0-4c42-b8b2-0e976c0869da admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:12.239286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c2875-4bb0-4c42-b8b2-0e976c0869da admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:12.240212 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c2875-4bb0-4c42-b8b2-0e976c0869da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:12.242517 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c2875-4bb0-4c42-b8b2-0e976c0869da admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:12.265031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 948/1892] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:12.265987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c2875-4bb0-4c42-b8b2-0e976c0869da admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:12.269234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-096c2875-4bb0-4c42-b8b2-0e976c0869da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:12.313647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05711685-a319-4b32-b8f6-4366d2a2c775 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:12.318955 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf005646-d9ef-429e-a659-7085b118470b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:12.319915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf005646-d9ef-429e-a659-7085b118470b service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:12.320200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf005646-d9ef-429e-a659-7085b118470b service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:12.320613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf005646-d9ef-429e-a659-7085b118470b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:12.334789 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf005646-d9ef-429e-a659-7085b118470b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:12.336377 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf005646-d9ef-429e-a659-7085b118470b service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:12.350974 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c2875-4bb0-4c42-b8b2-0e976c0869da admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:12.353244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 945/1893] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:12.354424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf005646-d9ef-429e-a659-7085b118470b service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:12.356497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279e63b-6d55-43c9-825e-aec802895267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:12.357572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279e63b-6d55-43c9-825e-aec802895267 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:12.357942 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279e63b-6d55-43c9-825e-aec802895267 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:12.358287 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279e63b-6d55-43c9-825e-aec802895267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:12.371723 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279e63b-6d55-43c9-825e-aec802895267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:12.374928 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf005646-d9ef-429e-a659-7085b118470b service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:12.377141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279e63b-6d55-43c9-825e-aec802895267 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:12.390895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7a679-0dfd-4227-8965-b7b88dda08b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:12.392373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7a679-0dfd-4227-8965-b7b88dda08b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:12.394509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7a679-0dfd-4227-8965-b7b88dda08b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:12.394798 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7a679-0dfd-4227-8965-b7b88dda08b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:12.396900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7a679-0dfd-4227-8965-b7b88dda08b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:12.398451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 949/1894] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:12.401519 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7a679-0dfd-4227-8965-b7b88dda08b8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:12.404366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:12.422282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 946/1895] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:12.426447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279e63b-6d55-43c9-825e-aec802895267 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:12.441546 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279e63b-6d55-43c9-825e-aec802895267 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:12.456709 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8289-d09f-4ad8-bb38-b1158b430bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:12.458189 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8289-d09f-4ad8-bb38-b1158b430bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:12.458511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8289-d09f-4ad8-bb38-b1158b430bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:12.459205 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8289-d09f-4ad8-bb38-b1158b430bb5 admin admin] PATH_INFO: `/v3/projects/0051c3105e5d4962be3730e87d0f31ce/users/7d2be6b115184039965893057907227a/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:12.491546 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b8289-d09f-4ad8-bb38-b1158b430bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0051c3105e5d4962be3730e87d0f31ce, user_id=7d2be6b115184039965893057907227a, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:12.497881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b8289-d09f-4ad8-bb38-b1158b430bb5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:12.527868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 950/1896] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:12 2022] PUT /identity/v3/projects/0051c3105e5d4962be3730e87d0f31ce/users/7d2be6b115184039965893057907227a/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:12.540142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40305a84-9bba-403e-ba46-d705dc8b300a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:12.541561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40305a84-9bba-403e-ba46-d705dc8b300a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:12.541909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40305a84-9bba-403e-ba46-d705dc8b300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:12.581045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-40305a84-9bba-403e-ba46-d705dc8b300a None None] MFA Rules not processed for user `7d2be6b115184039965893057907227a`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:12.582286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-40305a84-9bba-403e-ba46-d705dc8b300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:12.667572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 947/1897] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:12.672324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8289-d09f-4ad8-bb38-b1158b430bb5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:12.758857 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8289-d09f-4ad8-bb38-b1158b430bb5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:12.763897 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c5cdf-5dd9-4366-bfc0-f3d0506be827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:12.764558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c5cdf-5dd9-4366-bfc0-f3d0506be827 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:12.764845 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c5cdf-5dd9-4366-bfc0-f3d0506be827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:12.765119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c5cdf-5dd9-4366-bfc0-f3d0506be827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:12.765801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c5cdf-5dd9-4366-bfc0-f3d0506be827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:12.768847 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c5cdf-5dd9-4366-bfc0-f3d0506be827 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:12.797271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 951/1898] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:12 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:12.801716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40305a84-9bba-403e-ba46-d705dc8b300a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:12.813365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40305a84-9bba-403e-ba46-d705dc8b300a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:12.882798 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55450669-4f53-4322-b402-d2e7e63712a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:12.883519 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55450669-4f53-4322-b402-d2e7e63712a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:12.883800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55450669-4f53-4322-b402-d2e7e63712a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:12.884078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55450669-4f53-4322-b402-d2e7e63712a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:12.884779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55450669-4f53-4322-b402-d2e7e63712a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:12.886861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55450669-4f53-4322-b402-d2e7e63712a7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:12.914126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 948/1899] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:12 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:12.917302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c5cdf-5dd9-4366-bfc0-f3d0506be827 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:12.929887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c5cdf-5dd9-4366-bfc0-f3d0506be827 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:12.935871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f622600-1fb8-42cf-acd3-35e6ac00404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:12.936573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f622600-1fb8-42cf-acd3-35e6ac00404c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:12.936861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f622600-1fb8-42cf-acd3-35e6ac00404c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:12.937272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f622600-1fb8-42cf-acd3-35e6ac00404c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:12.937992 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f622600-1fb8-42cf-acd3-35e6ac00404c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:12.940523 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f622600-1fb8-42cf-acd3-35e6ac00404c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:12.951791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 952/1900] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:12.957086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55450669-4f53-4322-b402-d2e7e63712a7 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:12.967793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55450669-4f53-4322-b402-d2e7e63712a7 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:12.968447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f622600-1fb8-42cf-acd3-35e6ac00404c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:12.970625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0f622600-1fb8-42cf-acd3-35e6ac00404c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:12.974061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea539e06-50d2-4d8b-99e7-ec073b2a00d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:12.975287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea539e06-50d2-4d8b-99e7-ec073b2a00d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:12.976369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea539e06-50d2-4d8b-99e7-ec073b2a00d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:12.976863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea539e06-50d2-4d8b-99e7-ec073b2a00d8 admin admin] PATH_INFO: `/v3/projects/e7d53566e7144c51b1815f9914894e92/users/146e5bdf524740e98a85f2c51b75f664/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:12.980369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:12.989355 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f622600-1fb8-42cf-acd3-35e6ac00404c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:12.999539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:12.999945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea539e06-50d2-4d8b-99e7-ec073b2a00d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d53566e7144c51b1815f9914894e92, user_id=146e5bdf524740e98a85f2c51b75f664, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:13.000433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:13.000724 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:13.001145 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] PATH_INFO: `/v3/projects/5646aa7bbde747b0b5679493a41ba963` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:13.003764 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] RBAC: Authorizing `identity:delete_project(project_id=5646aa7bbde747b0b5679493a41ba963)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:13.004674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea539e06-50d2-4d8b-99e7-ec073b2a00d8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:13.005803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:13.031990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 949/1901] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:12 2022] PUT /identity/v3/projects/e7d53566e7144c51b1815f9914894e92/users/146e5bdf524740e98a85f2c51b75f664/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:13.033486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea539e06-50d2-4d8b-99e7-ec073b2a00d8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:13.036357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ea539e06-50d2-4d8b-99e7-ec073b2a00d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:13.099933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5646aa7bbde747b0b5679493a41ba963', 'request_id': 'req-c4a2767a-e8be-4100-9fdd-72cbd743cdda'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.108199 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5646aa7bbde747b0b5679493a41ba963', 'request_id': 'req-c4a2767a-e8be-4100-9fdd-72cbd743cdda'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.118160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5646aa7bbde747b0b5679493a41ba963', 'request_id': 'req-c4a2767a-e8be-4100-9fdd-72cbd743cdda'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.123063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:13.133920 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] The token cache is being invalidate because project 5646aa7bbde747b0b5679493a41ba963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:13.133920 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.134727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.139204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 953/1902] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:12 2022] DELETE /identity/v3/projects/5646aa7bbde747b0b5679493a41ba963 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:13.139338 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea539e06-50d2-4d8b-99e7-ec073b2a00d8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:13.139421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:13.140675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:13.202942 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:13.204926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:13.205264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:13.206152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] PATH_INFO: `/v3/projects/12637fa1b1034406a06bcf4f19270928` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:13.207260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12637fa1b1034406a06bcf4f19270928)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:13.209597 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:13.231315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2767a-e8be-4100-9fdd-72cbd743cdda admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:13.237301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b251de6-b010-4e49-8d8c-63a8c0ae11f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:13.238059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b251de6-b010-4e49-8d8c-63a8c0ae11f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:13.238588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b251de6-b010-4e49-8d8c-63a8c0ae11f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:13.238943 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b251de6-b010-4e49-8d8c-63a8c0ae11f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:13.240188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b251de6-b010-4e49-8d8c-63a8c0ae11f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:13.242019 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b251de6-b010-4e49-8d8c-63a8c0ae11f8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:13.259370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 954/1903] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:13.259370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b251de6-b010-4e49-8d8c-63a8c0ae11f8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:13.261119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1b251de6-b010-4e49-8d8c-63a8c0ae11f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:13.278322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b251de6-b010-4e49-8d8c-63a8c0ae11f8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:13.284134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12637fa1b1034406a06bcf4f19270928', 'request_id': 'req-379640ac-3968-4305-a4f4-9802aecf2477'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.294915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12637fa1b1034406a06bcf4f19270928', 'request_id': 'req-379640ac-3968-4305-a4f4-9802aecf2477'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.304212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12637fa1b1034406a06bcf4f19270928', 'request_id': 'req-379640ac-3968-4305-a4f4-9802aecf2477'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.317160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] The token cache is being invalidate because project 12637fa1b1034406a06bcf4f19270928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:13.317468 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.325634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.328045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 950/1904] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:13 2022] DELETE /identity/v3/projects/12637fa1b1034406a06bcf4f19270928 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:13.330013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:13.331458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:13.411183 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255534c5-876a-439a-a46c-d9c4c6312874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:13.412874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255534c5-876a-439a-a46c-d9c4c6312874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:13.412874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255534c5-876a-439a-a46c-d9c4c6312874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:13.413171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255534c5-876a-439a-a46c-d9c4c6312874 admin admin] PATH_INFO: `/v3/users/3ab889a2788441a3b0ebc07327932749` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:13.420848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255534c5-876a-439a-a46c-d9c4c6312874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab889a2788441a3b0ebc07327932749)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:13.422985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255534c5-876a-439a-a46c-d9c4c6312874 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:13.459130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:13.462080 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379640ac-3968-4305-a4f4-9802aecf2477 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:13.469315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be81249-37ee-45fd-9c52-25105718df6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:13.470997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be81249-37ee-45fd-9c52-25105718df6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:13.471440 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be81249-37ee-45fd-9c52-25105718df6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:13.471832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be81249-37ee-45fd-9c52-25105718df6e admin admin] PATH_INFO: `/v3/projects/e7d53566e7144c51b1815f9914894e92/users/146e5bdf524740e98a85f2c51b75f664/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:13.476469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be81249-37ee-45fd-9c52-25105718df6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d53566e7144c51b1815f9914894e92, user_id=146e5bdf524740e98a85f2c51b75f664, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:13.479816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be81249-37ee-45fd-9c52-25105718df6e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:13.496017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-255534c5-876a-439a-a46c-d9c4c6312874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab889a2788441a3b0ebc07327932749'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.511332 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 951/1905] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:13 2022] PUT /identity/v3/projects/e7d53566e7144c51b1815f9914894e92/users/146e5bdf524740e98a85f2c51b75f664/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:13.512462 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be81249-37ee-45fd-9c52-25105718df6e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:13.514287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5be81249-37ee-45fd-9c52-25105718df6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:13.516580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-255534c5-876a-439a-a46c-d9c4c6312874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab889a2788441a3b0ebc07327932749'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.527070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-255534c5-876a-439a-a46c-d9c4c6312874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab889a2788441a3b0ebc07327932749'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.528269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-255534c5-876a-439a-a46c-d9c4c6312874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab889a2788441a3b0ebc07327932749'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.543358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-255534c5-876a-439a-a46c-d9c4c6312874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab889a2788441a3b0ebc07327932749'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.550900 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 955/1906] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:13 2022] DELETE /identity/v3/users/3ab889a2788441a3b0ebc07327932749 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:13.552796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61908b9d-05ea-46ed-bfe9-3c7fa20b43fa None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:13.553454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61908b9d-05ea-46ed-bfe9-3c7fa20b43fa None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:13.554338 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:13.564017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61908b9d-05ea-46ed-bfe9-3c7fa20b43fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:13.627355 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be81249-37ee-45fd-9c52-25105718df6e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:13.647829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-61908b9d-05ea-46ed-bfe9-3c7fa20b43fa None None] MFA Rules not processed for user `146e5bdf524740e98a85f2c51b75f664`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:13.650427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-61908b9d-05ea-46ed-bfe9-3c7fa20b43fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:13.717800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:13.718811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:13.719201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:13.719554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] PATH_INFO: `/v3/users/09dc3f0834354406a69888586c67e85b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:13.721514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09dc3f0834354406a69888586c67e85b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:13.724115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:13.787412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 956/1907] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:13.789757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61908b9d-05ea-46ed-bfe9-3c7fa20b43fa None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:13.791527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-61908b9d-05ea-46ed-bfe9-3c7fa20b43fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:13.808799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09dc3f0834354406a69888586c67e85b'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.809509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09dc3f0834354406a69888586c67e85b'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.812457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61908b9d-05ea-46ed-bfe9-3c7fa20b43fa None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:13.821992 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:13.823023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:13.823163 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09dc3f0834354406a69888586c67e85b'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.823347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:13.823615 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] PATH_INFO: `/v3/users/5eb10c5313554ebab5b3f99ed224e47b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:13.825039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb10c5313554ebab5b3f99ed224e47b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:13.828630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:13.832464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09dc3f0834354406a69888586c67e85b'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.840807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09dc3f0834354406a69888586c67e85b'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.848206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 952/1908] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:13 2022] DELETE /identity/v3/users/09dc3f0834354406a69888586c67e85b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:13.848805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:13.850261 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:13.899298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb10c5313554ebab5b3f99ed224e47b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.926559 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb10c5313554ebab5b3f99ed224e47b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.948539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb10c5313554ebab5b3f99ed224e47b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.949541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb10c5313554ebab5b3f99ed224e47b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.974743 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb10c5313554ebab5b3f99ed224e47b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:13.975556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24ef83-8b56-407a-8d76-1aefd3b58669 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:13.977117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:13.983343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b544e2a-1c8f-4b43-a560-d00efbc0ff68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:13.984527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b544e2a-1c8f-4b43-a560-d00efbc0ff68 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:13.985118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b544e2a-1c8f-4b43-a560-d00efbc0ff68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:13.985598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b544e2a-1c8f-4b43-a560-d00efbc0ff68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:13.987200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 957/1909] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:13 2022] DELETE /identity/v3/users/5eb10c5313554ebab5b3f99ed224e47b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:13.988582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:13.989496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4b544e2a-1c8f-4b43-a560-d00efbc0ff68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:13.992192 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:13.999344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:14.106273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6d351-ee66-4dee-861b-aaec5cc9d032 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:14.133060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:14.134148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b544e2a-1c8f-4b43-a560-d00efbc0ff68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:14.136014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:14.137622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b544e2a-1c8f-4b43-a560-d00efbc0ff68 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:14.138244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:14.138707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] PATH_INFO: `/v3/projects/9787582a8e1c42afa49c11b7119aa37a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:14.141471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9787582a8e1c42afa49c11b7119aa37a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:14.146237 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:14.165863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 953/1910] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:14.168033 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db98b2-2e91-4315-bc65-99e0cf7b0174 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:14.168400 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db98b2-2e91-4315-bc65-99e0cf7b0174 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:14.168749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db98b2-2e91-4315-bc65-99e0cf7b0174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:14.187642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c1db98b2-2e91-4315-bc65-99e0cf7b0174 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:14.190627 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c1db98b2-2e91-4315-bc65-99e0cf7b0174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:14.207295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 954/1911] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:14.229669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db98b2-2e91-4315-bc65-99e0cf7b0174 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:14.234657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c1db98b2-2e91-4315-bc65-99e0cf7b0174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:14.289582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9787582a8e1c42afa49c11b7119aa37a', 'request_id': 'req-90e9ad39-83da-4aee-bf17-b9215e50e6c1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:14.303562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9787582a8e1c42afa49c11b7119aa37a', 'request_id': 'req-90e9ad39-83da-4aee-bf17-b9215e50e6c1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:14.321483 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9787582a8e1c42afa49c11b7119aa37a', 'request_id': 'req-90e9ad39-83da-4aee-bf17-b9215e50e6c1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:14.329539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db98b2-2e91-4315-bc65-99e0cf7b0174 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:14.355906 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] The token cache is being invalidate because project 9787582a8e1c42afa49c11b7119aa37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:14.356540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:14.358410 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:14.361119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 958/1912] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:13 2022] DELETE /identity/v3/projects/9787582a8e1c42afa49c11b7119aa37a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:14.363093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:14.364611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:14.433788 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5137a-f6b3-4f5b-9eef-0ef91e04b8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:14.434457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5137a-f6b3-4f5b-9eef-0ef91e04b8df service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:14.434811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5137a-f6b3-4f5b-9eef-0ef91e04b8df service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:14.435010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9ad39-83da-4aee-bf17-b9215e50e6c1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:14.435151 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5137a-f6b3-4f5b-9eef-0ef91e04b8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:14.437077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e1a5137a-f6b3-4f5b-9eef-0ef91e04b8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:14.440907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f02651-14d1-41db-add6-1212efd14bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:14.441782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02651-14d1-41db-add6-1212efd14bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:14.442089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02651-14d1-41db-add6-1212efd14bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:14.442364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02651-14d1-41db-add6-1212efd14bb0 admin admin] PATH_INFO: `/v3/projects/de1d36d0651d4dd0b32b72f1600c5f7f` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:14.444010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f02651-14d1-41db-add6-1212efd14bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1d36d0651d4dd0b32b72f1600c5f7f)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:14.445949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f02651-14d1-41db-add6-1212efd14bb0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:14.451144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5137a-f6b3-4f5b-9eef-0ef91e04b8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:14.452801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5137a-f6b3-4f5b-9eef-0ef91e04b8df service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:14.464386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 955/1913] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:14.465783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb2ec4-c196-4023-8f0b-852c0154a760 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:14.466142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb2ec4-c196-4023-8f0b-852c0154a760 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:14.466539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb2ec4-c196-4023-8f0b-852c0154a760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:14.486291 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:14.491982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e3fb2ec4-c196-4023-8f0b-852c0154a760 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:14.493451 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e3fb2ec4-c196-4023-8f0b-852c0154a760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:14.507690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e7f02651-14d1-41db-add6-1212efd14bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1d36d0651d4dd0b32b72f1600c5f7f', 'request_id': 'req-e7f02651-14d1-41db-add6-1212efd14bb0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:14.514727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e7f02651-14d1-41db-add6-1212efd14bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1d36d0651d4dd0b32b72f1600c5f7f', 'request_id': 'req-e7f02651-14d1-41db-add6-1212efd14bb0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:14.532761 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e7f02651-14d1-41db-add6-1212efd14bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1d36d0651d4dd0b32b72f1600c5f7f', 'request_id': 'req-e7f02651-14d1-41db-add6-1212efd14bb0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:14.549858 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e7f02651-14d1-41db-add6-1212efd14bb0 admin admin] The token cache is being invalidate because project de1d36d0651d4dd0b32b72f1600c5f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:14.550209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e7f02651-14d1-41db-add6-1212efd14bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:14.551231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e7f02651-14d1-41db-add6-1212efd14bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:14.553449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 959/1914] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:14 2022] DELETE /identity/v3/projects/de1d36d0651d4dd0b32b72f1600c5f7f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:14.560975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92652ca-5fe8-4458-b4e1-6962bc83d4c0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:14.561297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92652ca-5fe8-4458-b4e1-6962bc83d4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:14.561590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92652ca-5fe8-4458-b4e1-6962bc83d4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:14.586782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b92652ca-5fe8-4458-b4e1-6962bc83d4c0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:14.588435 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b92652ca-5fe8-4458-b4e1-6962bc83d4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:14.622981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:14.640811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 956/1915] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:14.649548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc35208-9c41-4e18-834d-325b48c8d8b1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:14.649841 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc35208-9c41-4e18-834d-325b48c8d8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:14.650121 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc35208-9c41-4e18-834d-325b48c8d8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:14.672236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 960/1916] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:14.683526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce980de-7cb8-41e6-8b6a-f4136490beeb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:14.685538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce980de-7cb8-41e6-8b6a-f4136490beeb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:14.685959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce980de-7cb8-41e6-8b6a-f4136490beeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:14.696413 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ffc35208-9c41-4e18-834d-325b48c8d8b1 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:14.698334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ffc35208-9c41-4e18-834d-325b48c8d8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:14.713052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6ce980de-7cb8-41e6-8b6a-f4136490beeb None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:14.714254 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 957/1917] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:14.717575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6ce980de-7cb8-41e6-8b6a-f4136490beeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:14.718318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc35208-9c41-4e18-834d-325b48c8d8b1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:14.729219 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 961/1918] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:14.730278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc35208-9c41-4e18-834d-325b48c8d8b1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:14.732577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce980de-7cb8-41e6-8b6a-f4136490beeb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:14.734933 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe742b-5e3c-48d2-9647-0c9215fed556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:14.736479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe742b-5e3c-48d2-9647-0c9215fed556 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:14.736938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe742b-5e3c-48d2-9647-0c9215fed556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:14.737764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe742b-5e3c-48d2-9647-0c9215fed556 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:14.738996 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe742b-5e3c-48d2-9647-0c9215fed556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:14.739496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe742b-5e3c-48d2-9647-0c9215fed556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:14.741951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe742b-5e3c-48d2-9647-0c9215fed556 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:14.744782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce980de-7cb8-41e6-8b6a-f4136490beeb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:14.750169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3664bbb-4f0d-44e8-9d39-d8816e134874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:14.751592 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3664bbb-4f0d-44e8-9d39-d8816e134874 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:14.751877 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3664bbb-4f0d-44e8-9d39-d8816e134874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:14.752166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3664bbb-4f0d-44e8-9d39-d8816e134874 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:14.752879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3664bbb-4f0d-44e8-9d39-d8816e134874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:14.753190 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3664bbb-4f0d-44e8-9d39-d8816e134874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:14.756400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3664bbb-4f0d-44e8-9d39-d8816e134874 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:14.757412 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 958/1919] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:14.768763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe742b-5e3c-48d2-9647-0c9215fed556 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:14.783163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 962/1920] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:14.784112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe742b-5e3c-48d2-9647-0c9215fed556 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:14.785444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3664bbb-4f0d-44e8-9d39-d8816e134874 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:14.798349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3664bbb-4f0d-44e8-9d39-d8816e134874 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:14.800456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c50e96-ed12-4a2f-a715-04be18de3847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:14.803334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c50e96-ed12-4a2f-a715-04be18de3847 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:14.804834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c50e96-ed12-4a2f-a715-04be18de3847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:14.805834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c50e96-ed12-4a2f-a715-04be18de3847 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:14.807123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c50e96-ed12-4a2f-a715-04be18de3847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:14.811986 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c50e96-ed12-4a2f-a715-04be18de3847 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:14.812213 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fae7ca-a637-4ec7-98d1-2073470ce9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:14.813288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fae7ca-a637-4ec7-98d1-2073470ce9fe admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:14.813732 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fae7ca-a637-4ec7-98d1-2073470ce9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:14.815199 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fae7ca-a637-4ec7-98d1-2073470ce9fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:14.816024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fae7ca-a637-4ec7-98d1-2073470ce9fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:14.820681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fae7ca-a637-4ec7-98d1-2073470ce9fe admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:14.871904 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 959/1921] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:14 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:14.872545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c50e96-ed12-4a2f-a715-04be18de3847 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:14.884342 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 963/1922] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:14 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:14.885207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a6c50e96-ed12-4a2f-a715-04be18de3847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:14.888397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fae7ca-a637-4ec7-98d1-2073470ce9fe admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:14.989334 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fae7ca-a637-4ec7-98d1-2073470ce9fe admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:14.994541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6610d9b-ba0d-47cd-bbd0-5b1140064c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:14.996255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6610d9b-ba0d-47cd-bbd0-5b1140064c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:14.996602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6610d9b-ba0d-47cd-bbd0-5b1140064c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:14.996887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6610d9b-ba0d-47cd-bbd0-5b1140064c54 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:14.998433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6610d9b-ba0d-47cd-bbd0-5b1140064c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:15.001741 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6610d9b-ba0d-47cd-bbd0-5b1140064c54 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:15.002973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c50e96-ed12-4a2f-a715-04be18de3847 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:15.008441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:15.009438 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.009812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.010088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] PATH_INFO: `/v3/users/7044725f3be84ae7b646c75312913b81` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.011478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7044725f3be84ae7b646c75312913b81)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:15.014617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:15.031101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 964/1923] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:14 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:15.031101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6610d9b-ba0d-47cd-bbd0-5b1140064c54 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:15.047296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6610d9b-ba0d-47cd-bbd0-5b1140064c54 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:15.062264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f2a02-9678-499d-9c46-9cfb7c7d2f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:15.063098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f2a02-9678-499d-9c46-9cfb7c7d2f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.064135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f2a02-9678-499d-9c46-9cfb7c7d2f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.064599 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f2a02-9678-499d-9c46-9cfb7c7d2f64 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.065518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f2a02-9678-499d-9c46-9cfb7c7d2f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:15.067615 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f2a02-9678-499d-9c46-9cfb7c7d2f64 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:15.085756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:15.098748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7044725f3be84ae7b646c75312913b81'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.099781 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7044725f3be84ae7b646c75312913b81'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.118629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7044725f3be84ae7b646c75312913b81'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.128085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 965/1924] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:15 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:15.129398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f2a02-9678-499d-9c46-9cfb7c7d2f64 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:15.129524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7044725f3be84ae7b646c75312913b81'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.131415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bb9f2a02-9678-499d-9c46-9cfb7c7d2f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:15.140035 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7044725f3be84ae7b646c75312913b81'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.147059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f2a02-9678-499d-9c46-9cfb7c7d2f64 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:15.149411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 960/1925] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:14 2022] DELETE /identity/v3/users/7044725f3be84ae7b646c75312913b81 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:15.150337 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:15.152139 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:15.236113 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:15.243698 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9deb09-551d-4789-9ab0-a32e4d8e2819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:15.244312 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9deb09-551d-4789-9ab0-a32e4d8e2819 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.244929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9deb09-551d-4789-9ab0-a32e4d8e2819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.244929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9deb09-551d-4789-9ab0-a32e4d8e2819 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.245659 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9deb09-551d-4789-9ab0-a32e4d8e2819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:15.250486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9deb09-551d-4789-9ab0-a32e4d8e2819 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:15.283138 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036c9cf-337f-4c29-8114-3032aefe4005 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:15.289720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:15.290696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.291047 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.291448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] PATH_INFO: `/v3/projects/1e5c1b219017462683fc08690850d353` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.292881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 966/1926] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:15.296028 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9deb09-551d-4789-9ab0-a32e4d8e2819 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:15.296482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5c1b219017462683fc08690850d353)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:15.300666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6d9deb09-551d-4789-9ab0-a32e4d8e2819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:15.302513 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:15.330184 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9deb09-551d-4789-9ab0-a32e4d8e2819 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:15.337788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873790e-1c44-497b-9be5-97ebef2c3c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:15.338687 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873790e-1c44-497b-9be5-97ebef2c3c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.339083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873790e-1c44-497b-9be5-97ebef2c3c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.339316 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873790e-1c44-497b-9be5-97ebef2c3c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.340048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873790e-1c44-497b-9be5-97ebef2c3c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:15.342635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873790e-1c44-497b-9be5-97ebef2c3c8a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:15.356226 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 967/1927] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:15.357681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417866f3-a4f6-4319-b2df-259710df267c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.357981 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417866f3-a4f6-4319-b2df-259710df267c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.358261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417866f3-a4f6-4319-b2df-259710df267c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.378423 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-417866f3-a4f6-4319-b2df-259710df267c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:15.379939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-417866f3-a4f6-4319-b2df-259710df267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:15.391516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5c1b219017462683fc08690850d353', 'request_id': 'req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.409107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5c1b219017462683fc08690850d353', 'request_id': 'req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.416556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5c1b219017462683fc08690850d353', 'request_id': 'req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.445915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] The token cache is being invalidate because project 1e5c1b219017462683fc08690850d353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:15.446674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.448256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.450408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 968/1928] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:15.451397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417866f3-a4f6-4319-b2df-259710df267c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:15.454967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 961/1929] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:15 2022] DELETE /identity/v3/projects/1e5c1b219017462683fc08690850d353 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:15.455861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-417866f3-a4f6-4319-b2df-259710df267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:15.455974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:15.468394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417866f3-a4f6-4319-b2df-259710df267c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:15.469444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:15.474057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:15.474945 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.475264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.475608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] PATH_INFO: `/v3/users/7d2be6b115184039965893057907227a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.477011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d2be6b115184039965893057907227a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:15.479032 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:15.488857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee9e06-8de6-4a97-89bb-f52d3d9ff4f6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:15.496889 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21391ab3-0493-4856-9e2a-98767f39bf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:15.497583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21391ab3-0493-4856-9e2a-98767f39bf3d admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.497871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21391ab3-0493-4856-9e2a-98767f39bf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.498151 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21391ab3-0493-4856-9e2a-98767f39bf3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.498911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21391ab3-0493-4856-9e2a-98767f39bf3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:15.500693 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21391ab3-0493-4856-9e2a-98767f39bf3d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:15.523358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 962/1930] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:15.524374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21391ab3-0493-4856-9e2a-98767f39bf3d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:15.527502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-21391ab3-0493-4856-9e2a-98767f39bf3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:15.542157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d2be6b115184039965893057907227a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.542669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21391ab3-0493-4856-9e2a-98767f39bf3d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:15.548673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219edb8-4c62-4317-ae4c-475f74bb230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:15.549660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219edb8-4c62-4317-ae4c-475f74bb230e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.550118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219edb8-4c62-4317-ae4c-475f74bb230e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.550470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219edb8-4c62-4317-ae4c-475f74bb230e admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.551311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219edb8-4c62-4317-ae4c-475f74bb230e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:15.551881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d2be6b115184039965893057907227a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.553029 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219edb8-4c62-4317-ae4c-475f74bb230e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:15.559560 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d2be6b115184039965893057907227a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.560395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d2be6b115184039965893057907227a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.567387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 963/1931] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:15.567387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219edb8-4c62-4317-ae4c-475f74bb230e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:15.567661 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3219edb8-4c62-4317-ae4c-475f74bb230e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:15.576319 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:15.581615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219edb8-4c62-4317-ae4c-475f74bb230e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:15.586644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d2be6b115184039965893057907227a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.593266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 969/1932] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:15 2022] DELETE /identity/v3/users/7d2be6b115184039965893057907227a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:15.595665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:15.598749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:15.600437 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:15.601321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.601615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.601879 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] PATH_INFO: `/v3/users/115eac3243f24363ab59c63afb727a16` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.603081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=115eac3243f24363ab59c63afb727a16)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:15.605019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:15.653972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115eac3243f24363ab59c63afb727a16'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.654624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115eac3243f24363ab59c63afb727a16'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.658867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ccee0-22e8-4ca2-8976-436203710b43 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:15.662686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed88944-e806-4548-a90e-c45cdbeb6772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:15.663396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed88944-e806-4548-a90e-c45cdbeb6772 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.663683 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed88944-e806-4548-a90e-c45cdbeb6772 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.663986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed88944-e806-4548-a90e-c45cdbeb6772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.665802 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5ed88944-e806-4548-a90e-c45cdbeb6772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:15.666838 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115eac3243f24363ab59c63afb727a16'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.674545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115eac3243f24363ab59c63afb727a16'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.681844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115eac3243f24363ab59c63afb727a16'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:15.689876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 964/1933] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:15 2022] DELETE /identity/v3/users/115eac3243f24363ab59c63afb727a16 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:15.690857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:15.692285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:15.707588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:15.748377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed88944-e806-4548-a90e-c45cdbeb6772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:15.751602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed88944-e806-4548-a90e-c45cdbeb6772 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:15.772532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 970/1934] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:15.775530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed88944-e806-4548-a90e-c45cdbeb6772 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:15.781270 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3acbd-6e5e-4a96-b376-d36e6a1580ca admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:15.781608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5ed88944-e806-4548-a90e-c45cdbeb6772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:15.788665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9f438-ad3f-44fd-b3ac-6eddc8e277d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:15.798456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f438-ad3f-44fd-b3ac-6eddc8e277d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.798947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f438-ad3f-44fd-b3ac-6eddc8e277d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.799311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f438-ad3f-44fd-b3ac-6eddc8e277d3 admin admin] PATH_INFO: `/v3/projects/6ab5ff7e4f1c4af99d930c63e70c6780/users/c585cfa6020a4b11b903d3e8ad0e70ed/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.809684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed88944-e806-4548-a90e-c45cdbeb6772 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:15.818373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2a9d-6804-47b9-acd0-cdb37ded808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:15.819148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9f438-ad3f-44fd-b3ac-6eddc8e277d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab5ff7e4f1c4af99d930c63e70c6780, user_id=c585cfa6020a4b11b903d3e8ad0e70ed, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:15.819386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2a9d-6804-47b9-acd0-cdb37ded808d admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.819683 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2a9d-6804-47b9-acd0-cdb37ded808d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.820374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2a9d-6804-47b9-acd0-cdb37ded808d admin admin] PATH_INFO: `/v3/projects/9c2339f44b0b41bf98f17d2204c5d1d2/users/02ee78e684544b8586c79798310dae3f/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.822740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9f438-ad3f-44fd-b3ac-6eddc8e277d3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:15.848917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 965/1935] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:15 2022] PUT /identity/v3/projects/6ab5ff7e4f1c4af99d930c63e70c6780/users/c585cfa6020a4b11b903d3e8ad0e70ed/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:15.868334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0eb629-1914-4733-9743-17658e0793ad None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.868334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0eb629-1914-4733-9743-17658e0793ad None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.868334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0eb629-1914-4733-9743-17658e0793ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.896876 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce2a9d-6804-47b9-acd0-cdb37ded808d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2339f44b0b41bf98f17d2204c5d1d2, user_id=02ee78e684544b8586c79798310dae3f, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:15.899785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ab0eb629-1914-4733-9743-17658e0793ad None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:15.901236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce2a9d-6804-47b9-acd0-cdb37ded808d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:15.901367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ab0eb629-1914-4733-9743-17658e0793ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:15.923673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 971/1936] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:15 2022] PUT /identity/v3/projects/9c2339f44b0b41bf98f17d2204c5d1d2/users/02ee78e684544b8586c79798310dae3f/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:15.940277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320311b-462e-4917-88b2-6e1d7a20c0de None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:15.941130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320311b-462e-4917-88b2-6e1d7a20c0de None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:15.942127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320311b-462e-4917-88b2-6e1d7a20c0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:15.995161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d320311b-462e-4917-88b2-6e1d7a20c0de None None] MFA Rules not processed for user `c585cfa6020a4b11b903d3e8ad0e70ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:15.996879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d320311b-462e-4917-88b2-6e1d7a20c0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:16.007099 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 966/1937] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:16.009341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935abbc-1572-43e6-bbcf-2a0396af1d91 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:16.012634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935abbc-1572-43e6-bbcf-2a0396af1d91 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:16.012926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935abbc-1572-43e6-bbcf-2a0396af1d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:16.052790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3935abbc-1572-43e6-bbcf-2a0396af1d91 None None] MFA Rules not processed for user `02ee78e684544b8586c79798310dae3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:16.054033 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3935abbc-1572-43e6-bbcf-2a0396af1d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:16.092587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 972/1938] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:16.097081 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320311b-462e-4917-88b2-6e1d7a20c0de None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:16.098449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d320311b-462e-4917-88b2-6e1d7a20c0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:16.106982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:16.167324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 967/1939] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:16.169381 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935abbc-1572-43e6-bbcf-2a0396af1d91 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:16.189096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320311b-462e-4917-88b2-6e1d7a20c0de None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:16.194052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fdd8b-7165-403f-a2b7-125326d943ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:16.195236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fdd8b-7165-403f-a2b7-125326d943ba service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:16.195595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fdd8b-7165-403f-a2b7-125326d943ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:16.195944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fdd8b-7165-403f-a2b7-125326d943ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:16.210102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:16.253409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935abbc-1572-43e6-bbcf-2a0396af1d91 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:16.257959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9792f-f36b-4f4c-9172-93ba38002f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:16.258635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9792f-f36b-4f4c-9172-93ba38002f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:16.258921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9792f-f36b-4f4c-9172-93ba38002f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:16.259224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9792f-f36b-4f4c-9172-93ba38002f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:16.259976 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9792f-f36b-4f4c-9172-93ba38002f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:16.261839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9792f-f36b-4f4c-9172-93ba38002f03 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:16.289881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fdd8b-7165-403f-a2b7-125326d943ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:16.292069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fdd8b-7165-403f-a2b7-125326d943ba service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:16.304622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 973/1940] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:16.305604 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fdd8b-7165-403f-a2b7-125326d943ba service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:16.311051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 968/1941] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:16 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:16.312892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9792f-f36b-4f4c-9172-93ba38002f03 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:16.315817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e8d9792f-f36b-4f4c-9172-93ba38002f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:16.317057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fdd8b-7165-403f-a2b7-125326d943ba service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:16.389788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad6469-69dd-4433-a988-7dab833c80c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:16.390462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad6469-69dd-4433-a988-7dab833c80c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:16.390800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad6469-69dd-4433-a988-7dab833c80c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:16.391086 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad6469-69dd-4433-a988-7dab833c80c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:16.392591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad6469-69dd-4433-a988-7dab833c80c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:16.394654 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad6469-69dd-4433-a988-7dab833c80c0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:16.404986 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9792f-f36b-4f4c-9172-93ba38002f03 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:16.417157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:16.419128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:16.419365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:16.419700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] PATH_INFO: `/v3/projects/c1a994e931694bd8a4e6dea964525a5c` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:16.423265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a994e931694bd8a4e6dea964525a5c)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:16.425354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:16.444909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 974/1942] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:16 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:16.444909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad6469-69dd-4433-a988-7dab833c80c0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:16.487809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a994e931694bd8a4e6dea964525a5c', 'request_id': 'req-5f2a0840-9bd5-4eb3-8045-a270537092c4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.492739 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:16.506339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a994e931694bd8a4e6dea964525a5c', 'request_id': 'req-5f2a0840-9bd5-4eb3-8045-a270537092c4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.512812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a994e931694bd8a4e6dea964525a5c', 'request_id': 'req-5f2a0840-9bd5-4eb3-8045-a270537092c4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.525591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad6469-69dd-4433-a988-7dab833c80c0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:16.527135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] The token cache is being invalidate because project c1a994e931694bd8a4e6dea964525a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:16.527566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.528346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.530603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 969/1943] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:16 2022] DELETE /identity/v3/projects/c1a994e931694bd8a4e6dea964525a5c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:16.531674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:16.534588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:16.603817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:16.616349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33593881-86cf-49c9-b429-94b0ab275283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:16.618182 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33593881-86cf-49c9-b429-94b0ab275283 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:16.618706 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33593881-86cf-49c9-b429-94b0ab275283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:16.618994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33593881-86cf-49c9-b429-94b0ab275283 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:16.619828 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33593881-86cf-49c9-b429-94b0ab275283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:16.622074 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33593881-86cf-49c9-b429-94b0ab275283 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:16.635928 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a0840-9bd5-4eb3-8045-a270537092c4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:16.643444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:16.644527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:16.645099 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:16.645718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] PATH_INFO: `/v3/projects/f19976a6bea1421f93cebd6d2b491d42` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:16.647907 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19976a6bea1421f93cebd6d2b491d42)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:16.650022 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:16.662281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 975/1944] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:16 2022] POST /identity/v3/users => generated 302 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:16.663160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33593881-86cf-49c9-b429-94b0ab275283 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:16.667266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-33593881-86cf-49c9-b429-94b0ab275283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:16.680555 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33593881-86cf-49c9-b429-94b0ab275283 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:16.689447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2bae2-bbf0-44e1-b330-05bbc2ce4c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:16.690140 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2bae2-bbf0-44e1-b330-05bbc2ce4c22 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:16.690424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2bae2-bbf0-44e1-b330-05bbc2ce4c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:16.690699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2bae2-bbf0-44e1-b330-05bbc2ce4c22 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:16.691454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2bae2-bbf0-44e1-b330-05bbc2ce4c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:16.693341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2bae2-bbf0-44e1-b330-05bbc2ce4c22 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:16.727643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 976/1945] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:16 2022] POST /identity/v3/users => generated 298 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:16.729482 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3ec32-44ca-44d4-acdb-c0b298abd415 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:16.729482 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3ec32-44ca-44d4-acdb-c0b298abd415 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:16.729672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3ec32-44ca-44d4-acdb-c0b298abd415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:16.746773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19976a6bea1421f93cebd6d2b491d42', 'request_id': 'req-6146bca4-5292-4c7c-a182-9e9676ba2f9e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.752611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c0f3ec32-44ca-44d4-acdb-c0b298abd415 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:16.753885 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c0f3ec32-44ca-44d4-acdb-c0b298abd415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:16.760734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19976a6bea1421f93cebd6d2b491d42', 'request_id': 'req-6146bca4-5292-4c7c-a182-9e9676ba2f9e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.768232 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19976a6bea1421f93cebd6d2b491d42', 'request_id': 'req-6146bca4-5292-4c7c-a182-9e9676ba2f9e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.787628 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] The token cache is being invalidate because project f19976a6bea1421f93cebd6d2b491d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:16.788231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.789256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.794216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 970/1946] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:16 2022] DELETE /identity/v3/projects/f19976a6bea1421f93cebd6d2b491d42 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:16.802380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:16.806493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:16.829763 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 977/1947] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:16.830924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3ec32-44ca-44d4-acdb-c0b298abd415 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:16.832401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c0f3ec32-44ca-44d4-acdb-c0b298abd415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:16.845357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3ec32-44ca-44d4-acdb-c0b298abd415 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:16.850218 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:16.851104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:16.851947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:16.851947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] PATH_INFO: `/v3/projects/0051c3105e5d4962be3730e87d0f31ce` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:16.853084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0051c3105e5d4962be3730e87d0f31ce)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:16.854991 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:16.913108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0051c3105e5d4962be3730e87d0f31ce', 'request_id': 'req-f97326e3-c396-4cee-a7e9-daee8941f336'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.915456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:16.920851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146bca4-5292-4c7c-a182-9e9676ba2f9e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:16.921053 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0051c3105e5d4962be3730e87d0f31ce', 'request_id': 'req-f97326e3-c396-4cee-a7e9-daee8941f336'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.940540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0051c3105e5d4962be3730e87d0f31ce', 'request_id': 'req-f97326e3-c396-4cee-a7e9-daee8941f336'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.960509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] The token cache is being invalidate because project 0051c3105e5d4962be3730e87d0f31ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:16.961199 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.961957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:16.966117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 978/1948] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:16 2022] DELETE /identity/v3/projects/0051c3105e5d4962be3730e87d0f31ce => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:16.967720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:16.969291 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:17.014186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e56609-fd09-4430-82af-170cc69cf805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:17.015196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e56609-fd09-4430-82af-170cc69cf805 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:17.015612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e56609-fd09-4430-82af-170cc69cf805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:17.016051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e56609-fd09-4430-82af-170cc69cf805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:17.017156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e56609-fd09-4430-82af-170cc69cf805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:17.019130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e56609-fd09-4430-82af-170cc69cf805 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:17.049616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 971/1949] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:17.051702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e56609-fd09-4430-82af-170cc69cf805 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:17.054617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-60e56609-fd09-4430-82af-170cc69cf805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:17.066936 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97326e3-c396-4cee-a7e9-daee8941f336 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:17.079575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8e3f3-75fb-4358-b2c9-bd9754f562a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:17.080102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8e3f3-75fb-4358-b2c9-bd9754f562a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:17.080468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8e3f3-75fb-4358-b2c9-bd9754f562a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:17.080820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8e3f3-75fb-4358-b2c9-bd9754f562a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:17.081659 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8e3f3-75fb-4358-b2c9-bd9754f562a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:17.083539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8e3f3-75fb-4358-b2c9-bd9754f562a7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:17.084766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e56609-fd09-4430-82af-170cc69cf805 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:17.097094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:17.098928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 979/1950] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:17.099773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:17.100484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d630-5d94-4443-bea7-5f043e5053f2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:17.100792 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:17.100941 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d630-5d94-4443-bea7-5f043e5053f2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:17.101286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d630-5d94-4443-bea7-5f043e5053f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:17.101977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] PATH_INFO: `/v3/users/ef3663e5fde5416fb13e9688d8c91124` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:17.105067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3663e5fde5416fb13e9688d8c91124)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:17.111638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:17.123938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:17.124360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-da63d630-5d94-4443-bea7-5f043e5053f2 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:17.125597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-da63d630-5d94-4443-bea7-5f043e5053f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:17.147041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 980/1951] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:17.148441 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63d630-5d94-4443-bea7-5f043e5053f2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:17.152348 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-da63d630-5d94-4443-bea7-5f043e5053f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:17.167982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63d630-5d94-4443-bea7-5f043e5053f2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:17.174364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:17.175302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:17.175764 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:17.176091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] PATH_INFO: `/v3/users/146e5bdf524740e98a85f2c51b75f664` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:17.177298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] RBAC: Authorizing `identity:delete_user(user_id=146e5bdf524740e98a85f2c51b75f664)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:17.180091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:17.226388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3663e5fde5416fb13e9688d8c91124'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.228199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3663e5fde5416fb13e9688d8c91124'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.241352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3663e5fde5416fb13e9688d8c91124'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.250784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3663e5fde5416fb13e9688d8c91124'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.264245 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3663e5fde5416fb13e9688d8c91124'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.277115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 972/1952] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:17 2022] DELETE /identity/v3/users/ef3663e5fde5416fb13e9688d8c91124 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:17.278785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:17.284344 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '146e5bdf524740e98a85f2c51b75f664'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.288009 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:17.326286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '146e5bdf524740e98a85f2c51b75f664'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.335620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '146e5bdf524740e98a85f2c51b75f664'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.336539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '146e5bdf524740e98a85f2c51b75f664'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.354490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '146e5bdf524740e98a85f2c51b75f664'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.365285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 981/1953] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:17 2022] DELETE /identity/v3/users/146e5bdf524740e98a85f2c51b75f664 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:17.366245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:17.369497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:17.429560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905a3d2-8d3b-44ed-8d7d-85c87c387dea admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:17.433837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:17.468705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba6c9f-72d5-41f4-8928-7a328285833c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:17.476499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587199f-da77-4a68-9751-804ae5f304df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:17.478240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587199f-da77-4a68-9751-804ae5f304df admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:17.478622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587199f-da77-4a68-9751-804ae5f304df admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:17.478973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587199f-da77-4a68-9751-804ae5f304df admin admin] PATH_INFO: `/v3/projects/488f11ee7be94cabab29ecaf2681ef4f/users/275434a8acf641f88ecd247a5c55fe17/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:17.501849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587199f-da77-4a68-9751-804ae5f304df admin admin] RBAC: Authorizing `identity:create_grant(project_id=488f11ee7be94cabab29ecaf2681ef4f, user_id=275434a8acf641f88ecd247a5c55fe17, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:17.506847 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587199f-da77-4a68-9751-804ae5f304df admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:17.510919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2cb17-0992-4f70-ae62-8d5f0c34434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:17.512184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2cb17-0992-4f70-ae62-8d5f0c34434e admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:17.512678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2cb17-0992-4f70-ae62-8d5f0c34434e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:17.512980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2cb17-0992-4f70-ae62-8d5f0c34434e admin admin] PATH_INFO: `/v3/projects/92298ea9023b416c8b34a83111bb264e/users/6bce894b413147f1ae6ce69cecf6026f/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:17.528228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 982/1954] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:17 2022] PUT /identity/v3/projects/488f11ee7be94cabab29ecaf2681ef4f/users/275434a8acf641f88ecd247a5c55fe17/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:17.529571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587199f-da77-4a68-9751-804ae5f304df admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:17.533028 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d587199f-da77-4a68-9751-804ae5f304df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:17.538906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2cb17-0992-4f70-ae62-8d5f0c34434e admin admin] RBAC: Authorizing `identity:create_grant(project_id=92298ea9023b416c8b34a83111bb264e, user_id=6bce894b413147f1ae6ce69cecf6026f, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:17.541974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2cb17-0992-4f70-ae62-8d5f0c34434e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:17.564409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 973/1955] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:17 2022] PUT /identity/v3/projects/92298ea9023b416c8b34a83111bb264e/users/6bce894b413147f1ae6ce69cecf6026f/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:17.566277 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2cb17-0992-4f70-ae62-8d5f0c34434e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:17.607803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:17.658637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587199f-da77-4a68-9751-804ae5f304df admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:17.737518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2cb17-0992-4f70-ae62-8d5f0c34434e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:17.745826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f81eb-43aa-4dcd-ade7-2cc8b6c9dcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:17.746619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f81eb-43aa-4dcd-ade7-2cc8b6c9dcbd admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:17.747003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f81eb-43aa-4dcd-ade7-2cc8b6c9dcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:17.747594 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f81eb-43aa-4dcd-ade7-2cc8b6c9dcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:17.748651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f81eb-43aa-4dcd-ade7-2cc8b6c9dcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:17.753434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f81eb-43aa-4dcd-ade7-2cc8b6c9dcbd admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:17.760211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83f747-b8e8-429b-ab01-03a0278edada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:17.761103 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f747-b8e8-429b-ab01-03a0278edada admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:17.761447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f747-b8e8-429b-ab01-03a0278edada admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:17.761729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f747-b8e8-429b-ab01-03a0278edada admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:17.763041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83f747-b8e8-429b-ab01-03a0278edada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:17.763393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83f747-b8e8-429b-ab01-03a0278edada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:17.765806 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83f747-b8e8-429b-ab01-03a0278edada admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:17.796087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 974/1957] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:17.797603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f81eb-43aa-4dcd-ade7-2cc8b6c9dcbd admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:17.801322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cb6f81eb-43aa-4dcd-ade7-2cc8b6c9dcbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:17.805306 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 983/1956] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:17.806547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83f747-b8e8-429b-ab01-03a0278edada admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:17.808757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7e83f747-b8e8-429b-ab01-03a0278edada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:17.816822 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f81eb-43aa-4dcd-ade7-2cc8b6c9dcbd admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:17.823281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49466f4a-284c-4273-9096-e2435c0974f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:17.824193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49466f4a-284c-4273-9096-e2435c0974f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:17.824484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49466f4a-284c-4273-9096-e2435c0974f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:17.824847 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49466f4a-284c-4273-9096-e2435c0974f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:17.825519 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49466f4a-284c-4273-9096-e2435c0974f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:17.827224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49466f4a-284c-4273-9096-e2435c0974f5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:17.833585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83f747-b8e8-429b-ab01-03a0278edada admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:17.842525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 975/1958] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:17.842525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49466f4a-284c-4273-9096-e2435c0974f5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:17.843768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:17.844709 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:17.845715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:17.845715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] PATH_INFO: `/v3/projects/9378be51ca264bc6a209211604037184` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:17.846841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9378be51ca264bc6a209211604037184)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:17.848847 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:17.853962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49466f4a-284c-4273-9096-e2435c0974f5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:17.858705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a84d4-264d-48c0-95ae-9ec1f73c1bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:17.859743 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a84d4-264d-48c0-95ae-9ec1f73c1bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:17.859923 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a84d4-264d-48c0-95ae-9ec1f73c1bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:17.860192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a84d4-264d-48c0-95ae-9ec1f73c1bf5 admin admin] PATH_INFO: `/v3/projects/488f11ee7be94cabab29ecaf2681ef4f/users/275434a8acf641f88ecd247a5c55fe17/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:17.862266 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a84d4-264d-48c0-95ae-9ec1f73c1bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=488f11ee7be94cabab29ecaf2681ef4f, user_id=275434a8acf641f88ecd247a5c55fe17, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:17.875493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a84d4-264d-48c0-95ae-9ec1f73c1bf5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:17.910504 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9378be51ca264bc6a209211604037184', 'request_id': 'req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.917322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 976/1959] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:17 2022] PUT /identity/v3/projects/488f11ee7be94cabab29ecaf2681ef4f/users/275434a8acf641f88ecd247a5c55fe17/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:17.918145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a84d4-264d-48c0-95ae-9ec1f73c1bf5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:17.919638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9378be51ca264bc6a209211604037184', 'request_id': 'req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.930551 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9378be51ca264bc6a209211604037184', 'request_id': 'req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.932240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:17.948392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] The token cache is being invalidate because project 9378be51ca264bc6a209211604037184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:17.949011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.950372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:17.952608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 984/1960] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:17 2022] DELETE /identity/v3/projects/9378be51ca264bc6a209211604037184 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:17.956161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:17.958663 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.003336 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a84d4-264d-48c0-95ae-9ec1f73c1bf5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:18.047675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07770e6e-9e2d-41cc-a39c-440ef4e2bd4a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:18.054843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40787efb-08b1-470f-961b-2a893c151fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:18.056082 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40787efb-08b1-470f-961b-2a893c151fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.056563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40787efb-08b1-470f-961b-2a893c151fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.057043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40787efb-08b1-470f-961b-2a893c151fb0 admin admin] PATH_INFO: `/v3/projects/92298ea9023b416c8b34a83111bb264e/users/6bce894b413147f1ae6ce69cecf6026f/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.059444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40787efb-08b1-470f-961b-2a893c151fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92298ea9023b416c8b34a83111bb264e, user_id=6bce894b413147f1ae6ce69cecf6026f, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:18.062809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40787efb-08b1-470f-961b-2a893c151fb0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:18.070758 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b0ed5-3ac1-4a35-abcd-45575eba6dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:18.071675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0ed5-3ac1-4a35-abcd-45575eba6dda admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.072422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0ed5-3ac1-4a35-abcd-45575eba6dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.072723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0ed5-3ac1-4a35-abcd-45575eba6dda admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.073422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b0ed5-3ac1-4a35-abcd-45575eba6dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:18.075378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b0ed5-3ac1-4a35-abcd-45575eba6dda admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:18.078160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 985/1961] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:17 2022] PUT /identity/v3/projects/92298ea9023b416c8b34a83111bb264e/users/6bce894b413147f1ae6ce69cecf6026f/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:18.080331 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143ef34-5be3-42b3-8161-c0d68ee8258a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.080621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143ef34-5be3-42b3-8161-c0d68ee8258a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.080897 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143ef34-5be3-42b3-8161-c0d68ee8258a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.134605 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 977/1962] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:17 2022] POST /identity/v3/projects => generated 397 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:18.135994 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d4374-0245-49df-82d4-80c47c037e07 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.136285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d4374-0245-49df-82d4-80c47c037e07 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.136580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d4374-0245-49df-82d4-80c47c037e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.138841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c143ef34-5be3-42b3-8161-c0d68ee8258a None None] MFA Rules not processed for user `275434a8acf641f88ecd247a5c55fe17`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:18.140944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c143ef34-5be3-42b3-8161-c0d68ee8258a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.178441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-145d4374-0245-49df-82d4-80c47c037e07 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:18.180706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-145d4374-0245-49df-82d4-80c47c037e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.196792 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:18.259424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 986/1963] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:18.260873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e5f2-6674-440d-9d9d-e2ac4c7415c6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.261168 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e5f2-6674-440d-9d9d-e2ac4c7415c6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.261447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e5f2-6674-440d-9d9d-e2ac4c7415c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.291928 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 978/1964] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:18.292926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d4374-0245-49df-82d4-80c47c037e07 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:18.295014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-145d4374-0245-49df-82d4-80c47c037e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.303540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6597e5f2-6674-440d-9d9d-e2ac4c7415c6 None None] MFA Rules not processed for user `6bce894b413147f1ae6ce69cecf6026f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:18.304697 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6597e5f2-6674-440d-9d9d-e2ac4c7415c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.307048 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d4374-0245-49df-82d4-80c47c037e07 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:18.324833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbde92-09a0-48e5-bd30-4b2979dc13fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:18.325550 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbde92-09a0-48e5-bd30-4b2979dc13fa admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.325913 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbde92-09a0-48e5-bd30-4b2979dc13fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.326260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbde92-09a0-48e5-bd30-4b2979dc13fa admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.327093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbde92-09a0-48e5-bd30-4b2979dc13fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:18.331584 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbde92-09a0-48e5-bd30-4b2979dc13fa admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:18.369698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 979/1965] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:18 2022] POST /identity/v3/users => generated 299 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:18.370713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbde92-09a0-48e5-bd30-4b2979dc13fa admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:18.372650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0efbde92-09a0-48e5-bd30-4b2979dc13fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.390737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:18.405914 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 987/1966] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:18.407982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597e5f2-6674-440d-9d9d-e2ac4c7415c6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:18.411362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6597e5f2-6674-440d-9d9d-e2ac4c7415c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.428424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597e5f2-6674-440d-9d9d-e2ac4c7415c6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:18.433618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:18.434564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.434918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.435244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] PATH_INFO: `/v3/projects/e7d53566e7144c51b1815f9914894e92` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.436437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d53566e7144c51b1815f9914894e92)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:18.439862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:18.455546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbde92-09a0-48e5-bd30-4b2979dc13fa admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:18.459588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff06ea-be49-49b5-bf8b-376e330283bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:18.460233 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff06ea-be49-49b5-bf8b-376e330283bc service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.460643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff06ea-be49-49b5-bf8b-376e330283bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.460929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff06ea-be49-49b5-bf8b-376e330283bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.472023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff06ea-be49-49b5-bf8b-376e330283bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:18.473476 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff06ea-be49-49b5-bf8b-376e330283bc service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:18.484920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 980/1967] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:18.487401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b87e3-61e2-4942-b80f-102d26418b9f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.487401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b87e3-61e2-4942-b80f-102d26418b9f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.487684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b87e3-61e2-4942-b80f-102d26418b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.500160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d53566e7144c51b1815f9914894e92', 'request_id': 'req-f41d4bc4-5938-4be2-9a5c-fa13223050d2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:18.508925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d53566e7144c51b1815f9914894e92', 'request_id': 'req-f41d4bc4-5938-4be2-9a5c-fa13223050d2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:18.516799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-126b87e3-61e2-4942-b80f-102d26418b9f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:18.518201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-126b87e3-61e2-4942-b80f-102d26418b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.519212 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d53566e7144c51b1815f9914894e92', 'request_id': 'req-f41d4bc4-5938-4be2-9a5c-fa13223050d2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:18.533806 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] The token cache is being invalidate because project e7d53566e7144c51b1815f9914894e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:18.534700 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:18.535658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:18.541422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 988/1968] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:18 2022] DELETE /identity/v3/projects/e7d53566e7144c51b1815f9914894e92 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:18.541422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:18.541422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.618541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 981/1969] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:18.619350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b87e3-61e2-4942-b80f-102d26418b9f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:18.620808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-126b87e3-61e2-4942-b80f-102d26418b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.668788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4bc4-5938-4be2-9a5c-fa13223050d2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:18.676846 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19a167-ca15-4eed-b885-c2b3ba229b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:18.677853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19a167-ca15-4eed-b885-c2b3ba229b09 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.679021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19a167-ca15-4eed-b885-c2b3ba229b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.679557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19a167-ca15-4eed-b885-c2b3ba229b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.680510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19a167-ca15-4eed-b885-c2b3ba229b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:18.682935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19a167-ca15-4eed-b885-c2b3ba229b09 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:18.696300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 989/1970] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:18.697726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed018-3eea-4b79-b949-c88cf8b06248 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.698700 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed018-3eea-4b79-b949-c88cf8b06248 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.699053 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed018-3eea-4b79-b949-c88cf8b06248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.711777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:18.717229 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b87e3-61e2-4942-b80f-102d26418b9f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:18.718665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c1eed018-3eea-4b79-b949-c88cf8b06248 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:18.720532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c1eed018-3eea-4b79-b949-c88cf8b06248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.723594 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bbf8c-ba73-4209-a3ad-018e03f5735b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:18.724852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bbf8c-ba73-4209-a3ad-018e03f5735b service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.725145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bbf8c-ba73-4209-a3ad-018e03f5735b service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.725418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bbf8c-ba73-4209-a3ad-018e03f5735b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.727401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-df0bbf8c-ba73-4209-a3ad-018e03f5735b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.730447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 990/1971] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:18.731376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed018-3eea-4b79-b949-c88cf8b06248 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:18.741312 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed018-3eea-4b79-b949-c88cf8b06248 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:18.746096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246dc4f-96d3-4d32-ac1c-51c81a6bcf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:18.746859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246dc4f-96d3-4d32-ac1c-51c81a6bcf67 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.747246 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246dc4f-96d3-4d32-ac1c-51c81a6bcf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.747600 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246dc4f-96d3-4d32-ac1c-51c81a6bcf67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.748404 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246dc4f-96d3-4d32-ac1c-51c81a6bcf67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:18.748779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246dc4f-96d3-4d32-ac1c-51c81a6bcf67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:18.750454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246dc4f-96d3-4d32-ac1c-51c81a6bcf67 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:18.768393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 991/1972] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:18.769462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246dc4f-96d3-4d32-ac1c-51c81a6bcf67 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:18.771406 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d246dc4f-96d3-4d32-ac1c-51c81a6bcf67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.784706 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246dc4f-96d3-4d32-ac1c-51c81a6bcf67 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:18.789846 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c536b5-0c3b-49ea-b247-6f06fbd4156c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:18.790525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c536b5-0c3b-49ea-b247-6f06fbd4156c service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.790808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c536b5-0c3b-49ea-b247-6f06fbd4156c service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.791086 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c536b5-0c3b-49ea-b247-6f06fbd4156c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.793955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-39c536b5-0c3b-49ea-b247-6f06fbd4156c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.830267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bbf8c-ba73-4209-a3ad-018e03f5735b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:18.834207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bbf8c-ba73-4209-a3ad-018e03f5735b service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:18.851453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 982/1973] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:18.852452 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bbf8c-ba73-4209-a3ad-018e03f5735b service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:18.864498 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bbf8c-ba73-4209-a3ad-018e03f5735b service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:18.873058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e03ec-9734-4729-b5bc-e8374918211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:18.874179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e03ec-9734-4729-b5bc-e8374918211d admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.874650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e03ec-9734-4729-b5bc-e8374918211d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.875115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e03ec-9734-4729-b5bc-e8374918211d admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.885172 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e03ec-9734-4729-b5bc-e8374918211d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:18.888240 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e03ec-9734-4729-b5bc-e8374918211d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:18.913651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 983/1974] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:18.915242 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2982-eb90-4228-9a1c-6872d86d809d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.915790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2982-eb90-4228-9a1c-6872d86d809d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.916073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2982-eb90-4228-9a1c-6872d86d809d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.917266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:18.941188 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-048c2982-eb90-4228-9a1c-6872d86d809d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:18.942790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-048c2982-eb90-4228-9a1c-6872d86d809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:18.943872 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c536b5-0c3b-49ea-b247-6f06fbd4156c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:18.945415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c536b5-0c3b-49ea-b247-6f06fbd4156c service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:18.957297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 992/1975] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:18.958233 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c536b5-0c3b-49ea-b247-6f06fbd4156c service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:18.968762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 984/1976] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:18.972741 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c536b5-0c3b-49ea-b247-6f06fbd4156c service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:18.974783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c2982-eb90-4228-9a1c-6872d86d809d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:18.977265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86d5ab-021c-4ca4-bf64-4f48f0625f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:18.978108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86d5ab-021c-4ca4-bf64-4f48f0625f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:18.978512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86d5ab-021c-4ca4-bf64-4f48f0625f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:18.978856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86d5ab-021c-4ca4-bf64-4f48f0625f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:18.979983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86d5ab-021c-4ca4-bf64-4f48f0625f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:18.982701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86d5ab-021c-4ca4-bf64-4f48f0625f19 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:18.996040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c2982-eb90-4228-9a1c-6872d86d809d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:19.029510 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a3082-02f5-4859-ba5e-074cd20f8ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:19.034601 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 993/1977] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:18 2022] POST /identity/v3/projects => generated 409 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:19.035646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a3082-02f5-4859-ba5e-074cd20f8ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:19.036100 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a3082-02f5-4859-ba5e-074cd20f8ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:19.037069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86d5ab-021c-4ca4-bf64-4f48f0625f19 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:19.038608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a3082-02f5-4859-ba5e-074cd20f8ba7 admin admin] PATH_INFO: `/v3/projects/9adda9f1d83d4fd2a7f47fd8ea7cb7b1/users/50f86431c38047dcaa317274109db12a/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:19.079905 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a3082-02f5-4859-ba5e-074cd20f8ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9adda9f1d83d4fd2a7f47fd8ea7cb7b1, user_id=50f86431c38047dcaa317274109db12a, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:19.084179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a3082-02f5-4859-ba5e-074cd20f8ba7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:19.106448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 985/1978] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:18 2022] PUT /identity/v3/projects/9adda9f1d83d4fd2a7f47fd8ea7cb7b1/users/50f86431c38047dcaa317274109db12a/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:19.106448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a3082-02f5-4859-ba5e-074cd20f8ba7 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:19.173767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86d5ab-021c-4ca4-bf64-4f48f0625f19 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:19.285809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a3082-02f5-4859-ba5e-074cd20f8ba7 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:19.302517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14dfba-4627-4770-8c0f-81256235727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:19.305376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14dfba-4627-4770-8c0f-81256235727e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:19.305809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14dfba-4627-4770-8c0f-81256235727e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:19.306154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14dfba-4627-4770-8c0f-81256235727e admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:19.307057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14dfba-4627-4770-8c0f-81256235727e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:19.309050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14dfba-4627-4770-8c0f-81256235727e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:19.311260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14dfba-4627-4770-8c0f-81256235727e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:19.328849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691461c-c44e-4db8-a47b-61f1b785f2b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:19.330696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691461c-c44e-4db8-a47b-61f1b785f2b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:19.330963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691461c-c44e-4db8-a47b-61f1b785f2b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:19.331245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691461c-c44e-4db8-a47b-61f1b785f2b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:19.334092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9691461c-c44e-4db8-a47b-61f1b785f2b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:19.337857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 986/1979] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:19.338764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14dfba-4627-4770-8c0f-81256235727e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:19.362031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14dfba-4627-4770-8c0f-81256235727e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:19.379912 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7103fc-05eb-40b8-9ebc-6440bced9ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:19.381243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7103fc-05eb-40b8-9ebc-6440bced9ddf admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:19.381635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7103fc-05eb-40b8-9ebc-6440bced9ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:19.382021 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7103fc-05eb-40b8-9ebc-6440bced9ddf admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:19.382826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7103fc-05eb-40b8-9ebc-6440bced9ddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:19.384944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7103fc-05eb-40b8-9ebc-6440bced9ddf admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:19.431704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 987/1980] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:19 2022] POST /identity/v3/users => generated 305 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:19.436042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d54ac-a0a0-4bf4-ba97-b85626e0de26 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:19.436554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d54ac-a0a0-4bf4-ba97-b85626e0de26 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:19.437305 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d54ac-a0a0-4bf4-ba97-b85626e0de26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:19.473137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691461c-c44e-4db8-a47b-61f1b785f2b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:19.474947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691461c-c44e-4db8-a47b-61f1b785f2b2 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:19.487237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8d3d54ac-a0a0-4bf4-ba97-b85626e0de26 None None] MFA Rules not processed for user `50f86431c38047dcaa317274109db12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:19.488876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8d3d54ac-a0a0-4bf4-ba97-b85626e0de26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:19.510687 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 994/1981] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:19.511800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691461c-c44e-4db8-a47b-61f1b785f2b2 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:19.528111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691461c-c44e-4db8-a47b-61f1b785f2b2 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:19.534835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c948838-01d0-4f2e-ba4f-e2b9fe0783ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:19.535977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c948838-01d0-4f2e-ba4f-e2b9fe0783ee admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:19.536468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c948838-01d0-4f2e-ba4f-e2b9fe0783ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:19.536865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c948838-01d0-4f2e-ba4f-e2b9fe0783ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:19.537639 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c948838-01d0-4f2e-ba4f-e2b9fe0783ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:19.540391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c948838-01d0-4f2e-ba4f-e2b9fe0783ee admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:19.560706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:19.587953 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 995/1982] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:19 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:19.590858 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c948838-01d0-4f2e-ba4f-e2b9fe0783ee admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:19.640679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:19.682937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 988/1983] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:19.686809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d54ac-a0a0-4bf4-ba97-b85626e0de26 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:19.706210 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d54ac-a0a0-4bf4-ba97-b85626e0de26 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:19.747782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c948838-01d0-4f2e-ba4f-e2b9fe0783ee admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:19.774694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54526bb9-b540-456d-8fad-5d0f68492805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:19.775472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54526bb9-b540-456d-8fad-5d0f68492805 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:19.775759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54526bb9-b540-456d-8fad-5d0f68492805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:19.776039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54526bb9-b540-456d-8fad-5d0f68492805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:19.776780 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54526bb9-b540-456d-8fad-5d0f68492805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:19.778417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54526bb9-b540-456d-8fad-5d0f68492805 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:19.817358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 996/1984] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:19.821390 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54526bb9-b540-456d-8fad-5d0f68492805 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:19.859162 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54526bb9-b540-456d-8fad-5d0f68492805 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:19.881630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681d303-56c9-4a97-bb48-2f043783ef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:19.882313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d303-56c9-4a97-bb48-2f043783ef05 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:19.882597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d303-56c9-4a97-bb48-2f043783ef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:19.882869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d303-56c9-4a97-bb48-2f043783ef05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:19.883622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681d303-56c9-4a97-bb48-2f043783ef05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:19.885547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681d303-56c9-4a97-bb48-2f043783ef05 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:19.916252 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d35f8d-8f30-4a29-8c8b-9cdf51140da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:19.917732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d35f8d-8f30-4a29-8c8b-9cdf51140da8 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:19.917732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d35f8d-8f30-4a29-8c8b-9cdf51140da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:19.917732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d35f8d-8f30-4a29-8c8b-9cdf51140da8 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:19.918411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d35f8d-8f30-4a29-8c8b-9cdf51140da8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:19.920428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d35f8d-8f30-4a29-8c8b-9cdf51140da8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:19.943095 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 997/1985] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:19 2022] POST /identity/v3/projects => generated 401 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:19.947443 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681d303-56c9-4a97-bb48-2f043783ef05 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:19.967130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 989/1986] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:19 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:19.968091 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d35f8d-8f30-4a29-8c8b-9cdf51140da8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:19.980160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-07d35f8d-8f30-4a29-8c8b-9cdf51140da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:19.997779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d35f8d-8f30-4a29-8c8b-9cdf51140da8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:20.129046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681d303-56c9-4a97-bb48-2f043783ef05 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:20.134344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:20.135268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.135555 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.135828 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] PATH_INFO: `/v3/users/02ee78e684544b8586c79798310dae3f` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.140945 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c1eb0-5ff1-48ec-bd43-ce4a0b4a5200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:20.142230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c1eb0-5ff1-48ec-bd43-ce4a0b4a5200 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.142718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c1eb0-5ff1-48ec-bd43-ce4a0b4a5200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.143441 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c1eb0-5ff1-48ec-bd43-ce4a0b4a5200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.144036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ee78e684544b8586c79798310dae3f)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:20.144753 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c1eb0-5ff1-48ec-bd43-ce4a0b4a5200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:20.145997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:20.147128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c1eb0-5ff1-48ec-bd43-ce4a0b4a5200 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:20.181506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 998/1987] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:20.182527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c1eb0-5ff1-48ec-bd43-ce4a0b4a5200 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:20.199053 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c1eb0-5ff1-48ec-bd43-ce4a0b4a5200 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:20.215437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decd45b-71b6-460c-8228-5c13173377bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:20.217309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decd45b-71b6-460c-8228-5c13173377bc admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.218699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decd45b-71b6-460c-8228-5c13173377bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.220811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decd45b-71b6-460c-8228-5c13173377bc admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.223387 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decd45b-71b6-460c-8228-5c13173377bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:20.231005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decd45b-71b6-460c-8228-5c13173377bc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:20.263495 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ee78e684544b8586c79798310dae3f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:20.264346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ee78e684544b8586c79798310dae3f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:20.274169 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:20.280149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 999/1988] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:20 2022] POST /identity/v3/users => generated 307 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:20.280149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decd45b-71b6-460c-8228-5c13173377bc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:20.284050 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5decd45b-71b6-460c-8228-5c13173377bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:20.300949 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ee78e684544b8586c79798310dae3f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:20.309895 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decd45b-71b6-460c-8228-5c13173377bc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:20.313050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ee78e684544b8586c79798310dae3f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:20.316011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5f495-d21f-4723-982e-fdebd0f22f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:20.317309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5f495-d21f-4723-982e-fdebd0f22f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.317309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5f495-d21f-4723-982e-fdebd0f22f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.317497 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5f495-d21f-4723-982e-fdebd0f22f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.318236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5f495-d21f-4723-982e-fdebd0f22f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:20.319894 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5f495-d21f-4723-982e-fdebd0f22f09 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:20.325776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ee78e684544b8586c79798310dae3f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:20.334241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 990/1989] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:19 2022] DELETE /identity/v3/users/02ee78e684544b8586c79798310dae3f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:20.335317 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:20.336903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:20.338178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1000/1990] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:20.339475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5f495-d21f-4723-982e-fdebd0f22f09 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:20.342020 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-72a5f495-d21f-4723-982e-fdebd0f22f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:20.361234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5f495-d21f-4723-982e-fdebd0f22f09 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:20.420617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a285997-d40d-4d74-80c7-be1fbaf53a9e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:20.426992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7b396-63b3-4e2a-8ad2-ebe2394f7c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:20.428632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7b396-63b3-4e2a-8ad2-ebe2394f7c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.430618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7b396-63b3-4e2a-8ad2-ebe2394f7c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.431109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7b396-63b3-4e2a-8ad2-ebe2394f7c0b admin admin] PATH_INFO: `/v3/projects/a1866d0e79ab46a6925a636a50ca0dc5/users/52a78b70e83f4fe4a319cd96a312c3ae/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.449215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7b396-63b3-4e2a-8ad2-ebe2394f7c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1866d0e79ab46a6925a636a50ca0dc5, user_id=52a78b70e83f4fe4a319cd96a312c3ae, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:20.451868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5eee-7049-4982-ba5c-3b5334e9409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:20.452585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5eee-7049-4982-ba5c-3b5334e9409d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.452876 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5eee-7049-4982-ba5c-3b5334e9409d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.453153 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5eee-7049-4982-ba5c-3b5334e9409d admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.453263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7b396-63b3-4e2a-8ad2-ebe2394f7c0b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:20.453886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb5eee-7049-4982-ba5c-3b5334e9409d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:20.456529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb5eee-7049-4982-ba5c-3b5334e9409d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:20.459249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:20.475469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 991/1991] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:20 2022] PUT /identity/v3/projects/a1866d0e79ab46a6925a636a50ca0dc5/users/52a78b70e83f4fe4a319cd96a312c3ae/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:20.477000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b38ae-12fd-43d1-b383-1845a5017f22 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.477444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b38ae-12fd-43d1-b383-1845a5017f22 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.477816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b38ae-12fd-43d1-b383-1845a5017f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.486513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1001/1992] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:20.487655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5eee-7049-4982-ba5c-3b5334e9409d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:20.499936 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5eee-7049-4982-ba5c-3b5334e9409d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:20.503133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-be3b38ae-12fd-43d1-b383-1845a5017f22 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:20.504748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-be3b38ae-12fd-43d1-b383-1845a5017f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:20.579550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d6e6f-34a9-4487-a078-4054cfc3cc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:20.581003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d6e6f-34a9-4487-a078-4054cfc3cc24 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.581292 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d6e6f-34a9-4487-a078-4054cfc3cc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.581660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d6e6f-34a9-4487-a078-4054cfc3cc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.582833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d6e6f-34a9-4487-a078-4054cfc3cc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:20.588774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d6e6f-34a9-4487-a078-4054cfc3cc24 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:20.597367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 992/1993] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:20.597367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb705ae-cf8d-4391-adf0-5a623d242c52 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.597367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb705ae-cf8d-4391-adf0-5a623d242c52 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.597367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb705ae-cf8d-4391-adf0-5a623d242c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.601097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1002/1994] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:20.601893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d6e6f-34a9-4487-a078-4054cfc3cc24 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:20.613836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d6e6f-34a9-4487-a078-4054cfc3cc24 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:20.619839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9769c-5c74-4aa5-8640-5620db0af01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:20.620861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9769c-5c74-4aa5-8640-5620db0af01b admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.621332 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9769c-5c74-4aa5-8640-5620db0af01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.621810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9769c-5c74-4aa5-8640-5620db0af01b admin admin] PATH_INFO: `/v3/projects/432630c8db8c4b0cbe8ee69e997adb7f/users/7ce256eb7af44e248fe474e7ba475cda/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.634454 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2fb705ae-cf8d-4391-adf0-5a623d242c52 None None] MFA Rules not processed for user `52a78b70e83f4fe4a319cd96a312c3ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:20.635815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2fb705ae-cf8d-4391-adf0-5a623d242c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:20.640759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9769c-5c74-4aa5-8640-5620db0af01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=432630c8db8c4b0cbe8ee69e997adb7f, user_id=7ce256eb7af44e248fe474e7ba475cda, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:20.644020 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9769c-5c74-4aa5-8640-5620db0af01b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:20.661343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1003/1995] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:20 2022] PUT /identity/v3/projects/432630c8db8c4b0cbe8ee69e997adb7f/users/7ce256eb7af44e248fe474e7ba475cda/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:20.664526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9769c-5c74-4aa5-8640-5620db0af01b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:20.682526 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:20.721494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 993/1996] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:20.722758 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb705ae-cf8d-4391-adf0-5a623d242c52 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:20.724829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2fb705ae-cf8d-4391-adf0-5a623d242c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:20.772813 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9769c-5c74-4aa5-8640-5620db0af01b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:20.779869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e499ac-c46e-45d6-832d-3f2db9db8d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:20.780999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e499ac-c46e-45d6-832d-3f2db9db8d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.781351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e499ac-c46e-45d6-832d-3f2db9db8d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.781562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e499ac-c46e-45d6-832d-3f2db9db8d19 admin admin] PATH_INFO: `/v3/projects/45db959671644e35b6e10494458a1164/users/e0aac8baf12d49b792b70dc342b5d768/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.799978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb705ae-cf8d-4391-adf0-5a623d242c52 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:20.803078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e499ac-c46e-45d6-832d-3f2db9db8d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45db959671644e35b6e10494458a1164, user_id=e0aac8baf12d49b792b70dc342b5d768, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:20.806157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e499ac-c46e-45d6-832d-3f2db9db8d19 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:20.826841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1004/1997] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:20 2022] PUT /identity/v3/projects/45db959671644e35b6e10494458a1164/users/e0aac8baf12d49b792b70dc342b5d768/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:20.828003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e499ac-c46e-45d6-832d-3f2db9db8d19 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:20.855697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125278a-4301-43a3-9df0-64ea445be98e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:20.856324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125278a-4301-43a3-9df0-64ea445be98e service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.856609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125278a-4301-43a3-9df0-64ea445be98e service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.856891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125278a-4301-43a3-9df0-64ea445be98e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.867216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125278a-4301-43a3-9df0-64ea445be98e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:20.868414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125278a-4301-43a3-9df0-64ea445be98e service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:20.879126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 994/1998] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:20.879827 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125278a-4301-43a3-9df0-64ea445be98e service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:20.891091 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125278a-4301-43a3-9df0-64ea445be98e service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:20.910611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:20.931570 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e499ac-c46e-45d6-832d-3f2db9db8d19 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:20.937251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a209c25-87ed-4103-8113-357e489ace28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:20.938880 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a209c25-87ed-4103-8113-357e489ace28 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.939475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a209c25-87ed-4103-8113-357e489ace28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.939974 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a209c25-87ed-4103-8113-357e489ace28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.940771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a209c25-87ed-4103-8113-357e489ace28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:20.942541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a209c25-87ed-4103-8113-357e489ace28 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:20.957419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1005/1999] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:20.958924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109ef1a-edd9-4242-b317-1bea7076ce8d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.959396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109ef1a-edd9-4242-b317-1bea7076ce8d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.959688 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109ef1a-edd9-4242-b317-1bea7076ce8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.987465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3da6e-0e5e-4db4-91cf-78cc068f81bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:20.988447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3da6e-0e5e-4db4-91cf-78cc068f81bc admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:20.988575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3da6e-0e5e-4db4-91cf-78cc068f81bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:20.988938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3da6e-0e5e-4db4-91cf-78cc068f81bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:20.989796 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3da6e-0e5e-4db4-91cf-78cc068f81bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:20.991860 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3da6e-0e5e-4db4-91cf-78cc068f81bc admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:20.993887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e109ef1a-edd9-4242-b317-1bea7076ce8d None None] MFA Rules not processed for user `e0aac8baf12d49b792b70dc342b5d768`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:20.995571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e109ef1a-edd9-4242-b317-1bea7076ce8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:21.030175 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 995/2000] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:20 2022] POST /identity/v3/projects => generated 407 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:21.031331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3da6e-0e5e-4db4-91cf-78cc068f81bc admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:21.080039 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:21.083882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1006/2001] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:21.085798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109ef1a-edd9-4242-b317-1bea7076ce8d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:21.101523 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109ef1a-edd9-4242-b317-1bea7076ce8d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:21.132135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3da6e-0e5e-4db4-91cf-78cc068f81bc admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:21.137642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78c033-e118-47d9-8d08-4fca3c5126cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:21.140757 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78c033-e118-47d9-8d08-4fca3c5126cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:21.141165 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78c033-e118-47d9-8d08-4fca3c5126cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:21.142764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78c033-e118-47d9-8d08-4fca3c5126cd admin admin] PATH_INFO: `/v3/projects/432630c8db8c4b0cbe8ee69e997adb7f/users/7ce256eb7af44e248fe474e7ba475cda/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:21.148202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78c033-e118-47d9-8d08-4fca3c5126cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=432630c8db8c4b0cbe8ee69e997adb7f, user_id=7ce256eb7af44e248fe474e7ba475cda, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:21.151903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78c033-e118-47d9-8d08-4fca3c5126cd admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:21.180330 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 996/2002] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:21 2022] PUT /identity/v3/projects/432630c8db8c4b0cbe8ee69e997adb7f/users/7ce256eb7af44e248fe474e7ba475cda/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:21.180330 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78c033-e118-47d9-8d08-4fca3c5126cd admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:21.180519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb7ac2-aa5a-4255-ba2e-3dcef90b65c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:21.180519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb7ac2-aa5a-4255-ba2e-3dcef90b65c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:21.180776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb7ac2-aa5a-4255-ba2e-3dcef90b65c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:21.181327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb7ac2-aa5a-4255-ba2e-3dcef90b65c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:21.182122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb7ac2-aa5a-4255-ba2e-3dcef90b65c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:21.184203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb7ac2-aa5a-4255-ba2e-3dcef90b65c7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:21.218801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1007/2003] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:21 2022] POST /identity/v3/users => generated 310 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:21.218801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d26477-04b1-4202-8507-66f5f2e50133 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:21.218801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d26477-04b1-4202-8507-66f5f2e50133 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:21.218801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d26477-04b1-4202-8507-66f5f2e50133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:21.250366 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-57d26477-04b1-4202-8507-66f5f2e50133 None None] MFA Rules not processed for user `7ce256eb7af44e248fe474e7ba475cda`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:21.252310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-57d26477-04b1-4202-8507-66f5f2e50133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:21.275655 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78c033-e118-47d9-8d08-4fca3c5126cd admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:21.286082 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a45673-d4cf-42dd-ba8d-8ad126ed5860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:21.286985 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a45673-d4cf-42dd-ba8d-8ad126ed5860 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:21.287530 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a45673-d4cf-42dd-ba8d-8ad126ed5860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:21.287912 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a45673-d4cf-42dd-ba8d-8ad126ed5860 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:21.289012 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a45673-d4cf-42dd-ba8d-8ad126ed5860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:21.292311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a45673-d4cf-42dd-ba8d-8ad126ed5860 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:21.331085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:21.349570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 997/2004] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:21 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:21.350692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a45673-d4cf-42dd-ba8d-8ad126ed5860 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:21.412127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1008/2005] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:21.413246 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d26477-04b1-4202-8507-66f5f2e50133 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:21.415118 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-57d26477-04b1-4202-8507-66f5f2e50133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:21.451131 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d26477-04b1-4202-8507-66f5f2e50133 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:21.474186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a45673-d4cf-42dd-ba8d-8ad126ed5860 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:21.479467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a49bcd-7bc9-499a-a36a-64d51c44168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:21.480158 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a49bcd-7bc9-499a-a36a-64d51c44168e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:21.480475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a49bcd-7bc9-499a-a36a-64d51c44168e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:21.480756 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a49bcd-7bc9-499a-a36a-64d51c44168e admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:21.481941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a49bcd-7bc9-499a-a36a-64d51c44168e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:21.483956 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a49bcd-7bc9-499a-a36a-64d51c44168e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:21.499706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 998/2006] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:21.500892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a49bcd-7bc9-499a-a36a-64d51c44168e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:21.519236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a49bcd-7bc9-499a-a36a-64d51c44168e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:21.525130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f9a58-cf96-4151-aec5-108f6819b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:21.526034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f9a58-cf96-4151-aec5-108f6819b5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:21.526480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f9a58-cf96-4151-aec5-108f6819b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:21.526899 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f9a58-cf96-4151-aec5-108f6819b5d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:21.527975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f9a58-cf96-4151-aec5-108f6819b5d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:21.530320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f9a58-cf96-4151-aec5-108f6819b5d1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:21.565042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 999/2007] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:21 2022] POST /identity/v3/users => generated 296 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:21.566061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f9a58-cf96-4151-aec5-108f6819b5d1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:21.568011 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e56f9a58-cf96-4151-aec5-108f6819b5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:21.605083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:21.637284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:21.640220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:21.642025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:21.642337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] PATH_INFO: `/v3/projects/9c2339f44b0b41bf98f17d2204c5d1d2` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:21.644399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2339f44b0b41bf98f17d2204c5d1d2)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:21.648678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f9a58-cf96-4151-aec5-108f6819b5d1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:21.649690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:21.654421 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26b551-1092-4d0a-b206-82fd9c1613b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:21.655515 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26b551-1092-4d0a-b206-82fd9c1613b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:21.655855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26b551-1092-4d0a-b206-82fd9c1613b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:21.656137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26b551-1092-4d0a-b206-82fd9c1613b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:21.748037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26b551-1092-4d0a-b206-82fd9c1613b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:21.749392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2339f44b0b41bf98f17d2204c5d1d2', 'request_id': 'req-d4cc0d23-722e-441b-b934-cc79efbe9bbf'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:21.751806 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26b551-1092-4d0a-b206-82fd9c1613b7 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:21.759351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2339f44b0b41bf98f17d2204c5d1d2', 'request_id': 'req-d4cc0d23-722e-441b-b934-cc79efbe9bbf'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:21.770431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2339f44b0b41bf98f17d2204c5d1d2', 'request_id': 'req-d4cc0d23-722e-441b-b934-cc79efbe9bbf'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:21.785624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1000/2008] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:21.803667 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26b551-1092-4d0a-b206-82fd9c1613b7 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:21.821320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] The token cache is being invalidate because project 9c2339f44b0b41bf98f17d2204c5d1d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:21.822685 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:21.823662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:21.827538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1009/2009] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:21 2022] DELETE /identity/v3/projects/9c2339f44b0b41bf98f17d2204c5d1d2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:21.829495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:21.833422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:21.833934 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26b551-1092-4d0a-b206-82fd9c1613b7 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:21.959506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc0d23-722e-441b-b934-cc79efbe9bbf admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:21.963497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a0f4c-9adc-4d11-a59f-c508517e92ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:21.964490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0f4c-9adc-4d11-a59f-c508517e92ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:21.964945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0f4c-9adc-4d11-a59f-c508517e92ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:21.965402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0f4c-9adc-4d11-a59f-c508517e92ee admin admin] PATH_INFO: `/v3/projects/f982c793383349b58b12ade91da260e6/users/9560e67b0a684553b5e2292f25cf05b6/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:21.972218 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8eeed-b44a-459c-bacb-22559f843686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:21.974389 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8eeed-b44a-459c-bacb-22559f843686 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:21.974689 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8eeed-b44a-459c-bacb-22559f843686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:21.974976 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8eeed-b44a-459c-bacb-22559f843686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:21.976707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8eeed-b44a-459c-bacb-22559f843686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:21.980329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8eeed-b44a-459c-bacb-22559f843686 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:21.991468 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a0f4c-9adc-4d11-a59f-c508517e92ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f982c793383349b58b12ade91da260e6, user_id=9560e67b0a684553b5e2292f25cf05b6, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:21.994309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a0f4c-9adc-4d11-a59f-c508517e92ee admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:22.008351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1010/2010] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:22.009309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8eeed-b44a-459c-bacb-22559f843686 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:22.011369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2ea8eeed-b44a-459c-bacb-22559f843686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:22.017283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1001/2011] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:21 2022] PUT /identity/v3/projects/f982c793383349b58b12ade91da260e6/users/9560e67b0a684553b5e2292f25cf05b6/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:22.017283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a0f4c-9adc-4d11-a59f-c508517e92ee admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:22.019558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-948a0f4c-9adc-4d11-a59f-c508517e92ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:22.025921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8eeed-b44a-459c-bacb-22559f843686 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:22.042889 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:22.105787 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:22.107259 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:22.107623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:22.108628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] PATH_INFO: `/v3/users/275434a8acf641f88ecd247a5c55fe17` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:22.109975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=275434a8acf641f88ecd247a5c55fe17)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:22.113976 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:22.115362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a0f4c-9adc-4d11-a59f-c508517e92ee admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:22.124225 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698674be-ede9-46d3-81b4-6681a3a0c735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:22.125152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698674be-ede9-46d3-81b4-6681a3a0c735 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:22.125646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698674be-ede9-46d3-81b4-6681a3a0c735 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:22.126183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698674be-ede9-46d3-81b4-6681a3a0c735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:22.132269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-698674be-ede9-46d3-81b4-6681a3a0c735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:22.149479 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:22.218143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275434a8acf641f88ecd247a5c55fe17'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:22.244476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275434a8acf641f88ecd247a5c55fe17'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:22.256188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275434a8acf641f88ecd247a5c55fe17'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:22.257324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275434a8acf641f88ecd247a5c55fe17'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:22.265796 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698674be-ede9-46d3-81b4-6681a3a0c735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:22.270463 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698674be-ede9-46d3-81b4-6681a3a0c735 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:22.292523 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1002/2012] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:22.295747 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698674be-ede9-46d3-81b4-6681a3a0c735 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:22.310064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275434a8acf641f88ecd247a5c55fe17'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:22.322552 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698674be-ede9-46d3-81b4-6681a3a0c735 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:22.326721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1011/2013] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:22 2022] DELETE /identity/v3/users/275434a8acf641f88ecd247a5c55fe17 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:22.328215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:22.334048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:22.481185 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44011-2451-46a7-b864-d402cd687cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:22.481768 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44011-2451-46a7-b864-d402cd687cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:22.486187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44011-2451-46a7-b864-d402cd687cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:22.486537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44011-2451-46a7-b864-d402cd687cb0 admin admin] PATH_INFO: `/v3/projects/16cc495d5ae54d41a485a9c10964c482/users/f6c466639d6f44eca722fbcfbc49fbbc/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:22.503360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1356d5-74db-4a5d-9395-d8e870d1bd87 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:22.514444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8997a-9a4f-4658-9467-e2eaad64a6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:22.517434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8997a-9a4f-4658-9467-e2eaad64a6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:22.518917 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8997a-9a4f-4658-9467-e2eaad64a6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:22.520467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8997a-9a4f-4658-9467-e2eaad64a6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:22.521379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8997a-9a4f-4658-9467-e2eaad64a6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:22.524583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8997a-9a4f-4658-9467-e2eaad64a6b9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:22.533743 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb44011-2451-46a7-b864-d402cd687cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cc495d5ae54d41a485a9c10964c482, user_id=f6c466639d6f44eca722fbcfbc49fbbc, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:22.540269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb44011-2451-46a7-b864-d402cd687cb0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:22.557677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1012/2014] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:22.560876 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8997a-9a4f-4658-9467-e2eaad64a6b9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:22.574977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1003/2015] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:22 2022] PUT /identity/v3/projects/16cc495d5ae54d41a485a9c10964c482/users/f6c466639d6f44eca722fbcfbc49fbbc/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:22.576679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44011-2451-46a7-b864-d402cd687cb0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:22.579889 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0bb44011-2451-46a7-b864-d402cd687cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:22.611580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8997a-9a4f-4658-9467-e2eaad64a6b9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:22.723084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:22.784350 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5d3c3-4ce8-4f82-85e3-319b8ec8234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:22.785684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5d3c3-4ce8-4f82-85e3-319b8ec8234a admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:22.786084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5d3c3-4ce8-4f82-85e3-319b8ec8234a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:22.786563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5d3c3-4ce8-4f82-85e3-319b8ec8234a admin admin] PATH_INFO: `/v3/projects/f982c793383349b58b12ade91da260e6/users/9560e67b0a684553b5e2292f25cf05b6/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:22.792029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5d3c3-4ce8-4f82-85e3-319b8ec8234a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f982c793383349b58b12ade91da260e6, user_id=9560e67b0a684553b5e2292f25cf05b6, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:22.795193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44011-2451-46a7-b864-d402cd687cb0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:22.798160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5d3c3-4ce8-4f82-85e3-319b8ec8234a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:22.807402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f25d0-17ac-45ac-86dc-5ab7937782c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:22.808361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f25d0-17ac-45ac-86dc-5ab7937782c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:22.808751 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f25d0-17ac-45ac-86dc-5ab7937782c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:22.809085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f25d0-17ac-45ac-86dc-5ab7937782c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:22.810025 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f25d0-17ac-45ac-86dc-5ab7937782c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:22.820202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f25d0-17ac-45ac-86dc-5ab7937782c4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:22.831662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1013/2016] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:22 2022] PUT /identity/v3/projects/f982c793383349b58b12ade91da260e6/users/9560e67b0a684553b5e2292f25cf05b6/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:22.856086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1004/2017] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:42:22.856347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dbf9f-675f-46af-aa64-8fa301d25aba None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:22.856715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dbf9f-675f-46af-aa64-8fa301d25aba None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:22.857943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f25d0-17ac-45ac-86dc-5ab7937782c4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:22.858427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dbf9f-675f-46af-aa64-8fa301d25aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:22.895084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f25d0-17ac-45ac-86dc-5ab7937782c4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:22.937006 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:22.948226 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d25dbf9f-675f-46af-aa64-8fa301d25aba None None] MFA Rules not processed for user `9560e67b0a684553b5e2292f25cf05b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:22.949468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d25dbf9f-675f-46af-aa64-8fa301d25aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:22.997264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f530e3-f5ad-4dc3-84a2-7c676ad7308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:23.000560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f530e3-f5ad-4dc3-84a2-7c676ad7308b admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:23.001073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f530e3-f5ad-4dc3-84a2-7c676ad7308b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:23.001774 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f530e3-f5ad-4dc3-84a2-7c676ad7308b admin admin] PATH_INFO: `/v3/projects/16cc495d5ae54d41a485a9c10964c482/users/f6c466639d6f44eca722fbcfbc49fbbc/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:23.007103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f530e3-f5ad-4dc3-84a2-7c676ad7308b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cc495d5ae54d41a485a9c10964c482, user_id=f6c466639d6f44eca722fbcfbc49fbbc, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:23.016284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f530e3-f5ad-4dc3-84a2-7c676ad7308b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:23.043521 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1005/2018] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:22 2022] PUT /identity/v3/projects/16cc495d5ae54d41a485a9c10964c482/users/f6c466639d6f44eca722fbcfbc49fbbc/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:23.046274 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85f9b1-b5fe-449f-8230-aada389a23b6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:23.046820 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85f9b1-b5fe-449f-8230-aada389a23b6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:23.048389 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85f9b1-b5fe-449f-8230-aada389a23b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:23.075354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1014/2019] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:22 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:23.084353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dbf9f-675f-46af-aa64-8fa301d25aba None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:23.085856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d25dbf9f-675f-46af-aa64-8fa301d25aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:23.131009 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2c85f9b1-b5fe-449f-8230-aada389a23b6 None None] MFA Rules not processed for user `f6c466639d6f44eca722fbcfbc49fbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:23.132605 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2c85f9b1-b5fe-449f-8230-aada389a23b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:23.162115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dbf9f-675f-46af-aa64-8fa301d25aba None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:23.241739 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba634f4b-4890-49d9-89e5-86a5c2043a91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:23.242479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba634f4b-4890-49d9-89e5-86a5c2043a91 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:23.242943 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba634f4b-4890-49d9-89e5-86a5c2043a91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:23.243364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba634f4b-4890-49d9-89e5-86a5c2043a91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:23.248653 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1006/2020] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:23.262452 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85f9b1-b5fe-449f-8230-aada389a23b6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:23.263926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2c85f9b1-b5fe-449f-8230-aada389a23b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:23.284720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85f9b1-b5fe-449f-8230-aada389a23b6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:23.288310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:23.294940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262725e5-3d3e-4a4f-9cd6-b20a1c4c151d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:23.295342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262725e5-3d3e-4a4f-9cd6-b20a1c4c151d service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:23.296912 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262725e5-3d3e-4a4f-9cd6-b20a1c4c151d service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:23.296912 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262725e5-3d3e-4a4f-9cd6-b20a1c4c151d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:23.323111 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262725e5-3d3e-4a4f-9cd6-b20a1c4c151d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:23.326008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262725e5-3d3e-4a4f-9cd6-b20a1c4c151d service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:23.361915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1007/2021] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:23.377788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba634f4b-4890-49d9-89e5-86a5c2043a91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:23.394729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba634f4b-4890-49d9-89e5-86a5c2043a91 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:23.427662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1015/2022] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:23 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:23.480903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262725e5-3d3e-4a4f-9cd6-b20a1c4c151d service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:23.482423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-262725e5-3d3e-4a4f-9cd6-b20a1c4c151d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:23.562695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262725e5-3d3e-4a4f-9cd6-b20a1c4c151d service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:23.567450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65901663-2986-4502-b6c4-6271cc80d043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:23.568315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901663-2986-4502-b6c4-6271cc80d043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:23.568597 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901663-2986-4502-b6c4-6271cc80d043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:23.568870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901663-2986-4502-b6c4-6271cc80d043 admin admin] PATH_INFO: `/v3/projects/488f11ee7be94cabab29ecaf2681ef4f` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:23.570075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65901663-2986-4502-b6c4-6271cc80d043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488f11ee7be94cabab29ecaf2681ef4f)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:23.572034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65901663-2986-4502-b6c4-6271cc80d043 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:23.633215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:23.636499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba634f4b-4890-49d9-89e5-86a5c2043a91 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:23.640947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-65901663-2986-4502-b6c4-6271cc80d043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488f11ee7be94cabab29ecaf2681ef4f', 'request_id': 'req-65901663-2986-4502-b6c4-6271cc80d043'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:23.647960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba634f4b-4890-49d9-89e5-86a5c2043a91 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:23.651829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-65901663-2986-4502-b6c4-6271cc80d043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488f11ee7be94cabab29ecaf2681ef4f', 'request_id': 'req-65901663-2986-4502-b6c4-6271cc80d043'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:23.659692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-65901663-2986-4502-b6c4-6271cc80d043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488f11ee7be94cabab29ecaf2681ef4f', 'request_id': 'req-65901663-2986-4502-b6c4-6271cc80d043'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:23.673219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-65901663-2986-4502-b6c4-6271cc80d043 admin admin] The token cache is being invalidate because project 488f11ee7be94cabab29ecaf2681ef4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:23.673586 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-65901663-2986-4502-b6c4-6271cc80d043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:23.675157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-65901663-2986-4502-b6c4-6271cc80d043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:23.679367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1008/2023] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:23 2022] DELETE /identity/v3/projects/488f11ee7be94cabab29ecaf2681ef4f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:23.681939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe5044-4c55-4c3b-849a-8c413beff14c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:23.682294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe5044-4c55-4c3b-849a-8c413beff14c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:23.683199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe5044-4c55-4c3b-849a-8c413beff14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:23.705947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ccbe5044-4c55-4c3b-849a-8c413beff14c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:23.710798 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ccbe5044-4c55-4c3b-849a-8c413beff14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:23.734162 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dbe67-fd05-4b64-b887-d1708b636446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:23.735854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dbe67-fd05-4b64-b887-d1708b636446 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:23.736368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dbe67-fd05-4b64-b887-d1708b636446 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:23.736648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dbe67-fd05-4b64-b887-d1708b636446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:23.742346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e74dbe67-fd05-4b64-b887-d1708b636446 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:23.791670 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1009/2024] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:23.800218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18865-c35d-4fec-868e-cbabb2571753 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:23.800598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18865-c35d-4fec-868e-cbabb2571753 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:23.800784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18865-c35d-4fec-868e-cbabb2571753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:23.833955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dbe67-fd05-4b64-b887-d1708b636446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:23.834701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a0a18865-c35d-4fec-868e-cbabb2571753 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:23.835428 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dbe67-fd05-4b64-b887-d1708b636446 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:23.836094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a0a18865-c35d-4fec-868e-cbabb2571753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:23.847322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1010/2025] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:23.850194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a18865-c35d-4fec-868e-cbabb2571753 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:23.851329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1016/2026] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:23.864435 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a18865-c35d-4fec-868e-cbabb2571753 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:23.872529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066942f-d682-416e-ae97-ba054d7871c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:23.873204 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066942f-d682-416e-ae97-ba054d7871c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:23.873488 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066942f-d682-416e-ae97-ba054d7871c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:23.874378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066942f-d682-416e-ae97-ba054d7871c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:23.875261 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066942f-d682-416e-ae97-ba054d7871c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:23.875631 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066942f-d682-416e-ae97-ba054d7871c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:23.877904 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066942f-d682-416e-ae97-ba054d7871c7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:23.894183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1011/2027] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:23.898720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dbe67-fd05-4b64-b887-d1708b636446 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:23.912567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dbe67-fd05-4b64-b887-d1708b636446 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:23.917720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061f5f6-8104-42d8-8f43-9e476670b7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:23.919304 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061f5f6-8104-42d8-8f43-9e476670b7fa admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:23.919304 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061f5f6-8104-42d8-8f43-9e476670b7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:23.919304 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061f5f6-8104-42d8-8f43-9e476670b7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:23.919649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061f5f6-8104-42d8-8f43-9e476670b7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:23.921827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061f5f6-8104-42d8-8f43-9e476670b7fa admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:23.952788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1017/2028] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:23 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:42:23.957484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066942f-d682-416e-ae97-ba054d7871c7 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:23.967862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066942f-d682-416e-ae97-ba054d7871c7 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:24.041927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0c7a2-2b07-4d71-b275-e346faefb6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:24.042544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c7a2-2b07-4d71-b275-e346faefb6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:24.042981 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c7a2-2b07-4d71-b275-e346faefb6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:24.043344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c7a2-2b07-4d71-b275-e346faefb6f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:24.044213 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0c7a2-2b07-4d71-b275-e346faefb6f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:24.046483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0c7a2-2b07-4d71-b275-e346faefb6f2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:24.075596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1012/2029] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:23 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:42:24.077472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061f5f6-8104-42d8-8f43-9e476670b7fa admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:24.092368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061f5f6-8104-42d8-8f43-9e476670b7fa admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:24.106678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0c7a2-2b07-4d71-b275-e346faefb6f2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:24.107524 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f77a4d-c543-4efd-a421-955dfd94a41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:24.108303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f77a4d-c543-4efd-a421-955dfd94a41f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:24.108616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-25c0c7a2-2b07-4d71-b275-e346faefb6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:24.108744 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f77a4d-c543-4efd-a421-955dfd94a41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:24.108923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f77a4d-c543-4efd-a421-955dfd94a41f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:24.109578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f77a4d-c543-4efd-a421-955dfd94a41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:24.112139 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f77a4d-c543-4efd-a421-955dfd94a41f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:24.135234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1018/2030] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:24.137959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f77a4d-c543-4efd-a421-955dfd94a41f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:24.161960 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0c7a2-2b07-4d71-b275-e346faefb6f2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:24.167694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f77a4d-c543-4efd-a421-955dfd94a41f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:24.180144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cfe9a-0a0b-4e51-ad0e-5f865ce32a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:24.181964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cfe9a-0a0b-4e51-ad0e-5f865ce32a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:24.183112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cfe9a-0a0b-4e51-ad0e-5f865ce32a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:24.185415 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cfe9a-0a0b-4e51-ad0e-5f865ce32a59 admin admin] PATH_INFO: `/v3/users/c585cfa6020a4b11b903d3e8ad0e70ed` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:24.187317 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cfe9a-0a0b-4e51-ad0e-5f865ce32a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c585cfa6020a4b11b903d3e8ad0e70ed)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:24.187457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3295e-bffe-4b11-bee9-b01d7e6db94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:24.188036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3295e-bffe-4b11-bee9-b01d7e6db94f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:24.188955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3295e-bffe-4b11-bee9-b01d7e6db94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:24.189581 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3295e-bffe-4b11-bee9-b01d7e6db94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:24.190732 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3295e-bffe-4b11-bee9-b01d7e6db94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:24.192482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cfe9a-0a0b-4e51-ad0e-5f865ce32a59 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:24.208146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3295e-bffe-4b11-bee9-b01d7e6db94f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:24.234515 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1019/2031] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:24.236330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3295e-bffe-4b11-bee9-b01d7e6db94f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:24.255229 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:24.261838 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3295e-bffe-4b11-bee9-b01d7e6db94f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:24.279096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7e7df-d008-4e81-bff2-8f1b7b4c6826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:24.280064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7e7df-d008-4e81-bff2-8f1b7b4c6826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:24.280358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7e7df-d008-4e81-bff2-8f1b7b4c6826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:24.280687 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7e7df-d008-4e81-bff2-8f1b7b4c6826 admin admin] PATH_INFO: `/v3/projects/0ce933817afb43d09e65d15a8ae3bf1a/users/95888f930f9b4b8aa3b81c905a207a0a/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:24.297694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-267cfe9a-0a0b-4e51-ad0e-5f865ce32a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c585cfa6020a4b11b903d3e8ad0e70ed'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:24.299769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-267cfe9a-0a0b-4e51-ad0e-5f865ce32a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c585cfa6020a4b11b903d3e8ad0e70ed'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:24.315723 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7e7df-d008-4e81-bff2-8f1b7b4c6826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce933817afb43d09e65d15a8ae3bf1a, user_id=95888f930f9b4b8aa3b81c905a207a0a, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:24.319396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7e7df-d008-4e81-bff2-8f1b7b4c6826 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:24.321588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-267cfe9a-0a0b-4e51-ad0e-5f865ce32a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c585cfa6020a4b11b903d3e8ad0e70ed'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:24.338782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-267cfe9a-0a0b-4e51-ad0e-5f865ce32a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c585cfa6020a4b11b903d3e8ad0e70ed'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:24.355234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1020/2032] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:24 2022] PUT /identity/v3/projects/0ce933817afb43d09e65d15a8ae3bf1a/users/95888f930f9b4b8aa3b81c905a207a0a/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:24.355234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7e7df-d008-4e81-bff2-8f1b7b4c6826 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:24.359922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2eb7e7df-d008-4e81-bff2-8f1b7b4c6826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:24.364538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-267cfe9a-0a0b-4e51-ad0e-5f865ce32a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c585cfa6020a4b11b903d3e8ad0e70ed'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:24.371707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:24.375792 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1013/2033] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:24 2022] DELETE /identity/v3/users/c585cfa6020a4b11b903d3e8ad0e70ed => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:24.378803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95862d5-b05e-473e-8372-3fb8a4dbe9fc None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:24.378803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95862d5-b05e-473e-8372-3fb8a4dbe9fc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:24.379218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95862d5-b05e-473e-8372-3fb8a4dbe9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:24.414425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d95862d5-b05e-473e-8372-3fb8a4dbe9fc None None] MFA Rules not processed for user `95888f930f9b4b8aa3b81c905a207a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:24.415931 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d95862d5-b05e-473e-8372-3fb8a4dbe9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:24.449929 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7e7df-d008-4e81-bff2-8f1b7b4c6826 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:24.512014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1014/2034] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:24.513663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b3235-e0d0-41e1-854a-8cf93bb2ed59 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:24.514062 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b3235-e0d0-41e1-854a-8cf93bb2ed59 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:24.514350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b3235-e0d0-41e1-854a-8cf93bb2ed59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:24.531707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:24.533079 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:24.533412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:24.533745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] PATH_INFO: `/v3/users/e0aac8baf12d49b792b70dc342b5d768` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:24.535393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0aac8baf12d49b792b70dc342b5d768)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:24.537356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:24.570293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c54b3235-e0d0-41e1-854a-8cf93bb2ed59 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:24.571724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c54b3235-e0d0-41e1-854a-8cf93bb2ed59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:24.585906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1015/2035] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:24.587253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b3235-e0d0-41e1-854a-8cf93bb2ed59 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:24.588296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c54b3235-e0d0-41e1-854a-8cf93bb2ed59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:24.638059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0aac8baf12d49b792b70dc342b5d768'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:24.650775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0aac8baf12d49b792b70dc342b5d768'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:24.662911 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0aac8baf12d49b792b70dc342b5d768'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:24.664467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0aac8baf12d49b792b70dc342b5d768'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:24.685687 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0aac8baf12d49b792b70dc342b5d768'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:24.694949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1021/2036] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:24 2022] DELETE /identity/v3/users/e0aac8baf12d49b792b70dc342b5d768 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:24.695593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:24.696918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:24.701302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b3235-e0d0-41e1-854a-8cf93bb2ed59 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:24.741361 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:24.761000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:24.765762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cd325-6ed5-4611-ac02-e4ee7a8eb5f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f892e618b01a46aaaab4f79aa0c3daa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:24.767525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cd325-6ed5-4611-ac02-e4ee7a8eb5f6 service glance] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:24.767827 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cd325-6ed5-4611-ac02-e4ee7a8eb5f6 service glance] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:24.768697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cd325-6ed5-4611-ac02-e4ee7a8eb5f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:24.771098 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-065cd325-6ed5-4611-ac02-e4ee7a8eb5f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:24.778941 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be67b40-d054-48f2-83c0-088c9805ff43 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:24.781660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfdd55-cc85-4e61-a902-d44b11bfec17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:24.782805 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfdd55-cc85-4e61-a902-d44b11bfec17 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:24.783068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfdd55-cc85-4e61-a902-d44b11bfec17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:24.783734 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfdd55-cc85-4e61-a902-d44b11bfec17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:24.785859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cfbfdd55-cc85-4e61-a902-d44b11bfec17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:24.864290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cd325-6ed5-4611-ac02-e4ee7a8eb5f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:24.866033 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cd325-6ed5-4611-ac02-e4ee7a8eb5f6 service glance] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:24.874430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfdd55-cc85-4e61-a902-d44b11bfec17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:24.876464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfdd55-cc85-4e61-a902-d44b11bfec17 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:24.878937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1016/2037] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:24.880388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac6253-2bf7-4368-8807-d8385ca9d2fd None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:24.881164 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac6253-2bf7-4368-8807-d8385ca9d2fd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:24.881449 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac6253-2bf7-4368-8807-d8385ca9d2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:24.887852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1022/2038] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:24.905682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-66ac6253-2bf7-4368-8807-d8385ca9d2fd None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:24.907925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-66ac6253-2bf7-4368-8807-d8385ca9d2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:24.916863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1017/2039] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:24.939719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfdd55-cc85-4e61-a902-d44b11bfec17 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:24.941870 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cfbfdd55-cc85-4e61-a902-d44b11bfec17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:24.955294 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfdd55-cc85-4e61-a902-d44b11bfec17 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:24.960399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429bc2a-7a98-4779-8025-d5589a63af25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:24.961493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429bc2a-7a98-4779-8025-d5589a63af25 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:24.961683 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429bc2a-7a98-4779-8025-d5589a63af25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:24.961967 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429bc2a-7a98-4779-8025-d5589a63af25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:24.974912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429bc2a-7a98-4779-8025-d5589a63af25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:24.976518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429bc2a-7a98-4779-8025-d5589a63af25 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:24.996898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1023/2040] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:25.257005 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac6253-2bf7-4368-8807-d8385ca9d2fd None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:25.262857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-66ac6253-2bf7-4368-8807-d8385ca9d2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:25.307099 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac6253-2bf7-4368-8807-d8385ca9d2fd None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:25.319891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:25.320898 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:25.321128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:25.321429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] PATH_INFO: `/v3/projects/6ab5ff7e4f1c4af99d930c63e70c6780` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:25.322925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ab5ff7e4f1c4af99d930c63e70c6780)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:25.336024 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:25.368083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429bc2a-7a98-4779-8025-d5589a63af25 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:25.370585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9429bc2a-7a98-4779-8025-d5589a63af25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:25.392419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429bc2a-7a98-4779-8025-d5589a63af25 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:25.404760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:25.407364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:25.407662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:25.407949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] PATH_INFO: `/v3/projects/45db959671644e35b6e10494458a1164` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:25.410886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45db959671644e35b6e10494458a1164)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:25.414226 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:25.434753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ab5ff7e4f1c4af99d930c63e70c6780', 'request_id': 'req-4db36db8-dbf1-431a-b75c-9eb95737aadb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.445632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ab5ff7e4f1c4af99d930c63e70c6780', 'request_id': 'req-4db36db8-dbf1-431a-b75c-9eb95737aadb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.466851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ab5ff7e4f1c4af99d930c63e70c6780', 'request_id': 'req-4db36db8-dbf1-431a-b75c-9eb95737aadb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.496644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] The token cache is being invalidate because project 6ab5ff7e4f1c4af99d930c63e70c6780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:25.496947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.498353 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.502559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1018/2041] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:25 2022] DELETE /identity/v3/projects/6ab5ff7e4f1c4af99d930c63e70c6780 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:25.506421 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:25.507567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45db959671644e35b6e10494458a1164', 'request_id': 'req-c32e0776-95a5-4244-a054-0b0a43486135'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.510387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:25.525295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45db959671644e35b6e10494458a1164', 'request_id': 'req-c32e0776-95a5-4244-a054-0b0a43486135'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.536602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45db959671644e35b6e10494458a1164', 'request_id': 'req-c32e0776-95a5-4244-a054-0b0a43486135'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.561140 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] The token cache is being invalidate because project 45db959671644e35b6e10494458a1164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:25.561649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.562363 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.565445 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1024/2042] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:25 2022] DELETE /identity/v3/projects/45db959671644e35b6e10494458a1164 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:25.569236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:25.570790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:25.630782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:25.634695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db36db8-dbf1-431a-b75c-9eb95737aadb admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:25.639304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:25.640173 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:25.640669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:25.641034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] PATH_INFO: `/v3/users/6bce894b413147f1ae6ce69cecf6026f` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:25.642490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bce894b413147f1ae6ce69cecf6026f)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:25.644471 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:25.646672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e0776-95a5-4244-a054-0b0a43486135 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:25.652142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:25.653029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:25.653313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:25.653642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] PATH_INFO: `/v3/users/f6c466639d6f44eca722fbcfbc49fbbc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:25.654853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c466639d6f44eca722fbcfbc49fbbc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:25.656822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:25.667849 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:25.697579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bce894b413147f1ae6ce69cecf6026f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.698482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bce894b413147f1ae6ce69cecf6026f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.710814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c466639d6f44eca722fbcfbc49fbbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.713927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bce894b413147f1ae6ce69cecf6026f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.720258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c466639d6f44eca722fbcfbc49fbbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.723134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bce894b413147f1ae6ce69cecf6026f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.729614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c466639d6f44eca722fbcfbc49fbbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.730315 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c466639d6f44eca722fbcfbc49fbbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.731959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bce894b413147f1ae6ce69cecf6026f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.738992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1019/2043] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:25 2022] DELETE /identity/v3/users/6bce894b413147f1ae6ce69cecf6026f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:25.748913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c466639d6f44eca722fbcfbc49fbbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:25.757416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1025/2044] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:25 2022] DELETE /identity/v3/users/f6c466639d6f44eca722fbcfbc49fbbc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:26.097684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:26.099548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:26.161214 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:26.162844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:26.251991 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb869c-7cc1-4469-802c-8635aa60a208 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:26.259305 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34042963-2ebc-4cd0-92f5-37f348880744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:26.261013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34042963-2ebc-4cd0-92f5-37f348880744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.261485 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34042963-2ebc-4cd0-92f5-37f348880744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.262074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34042963-2ebc-4cd0-92f5-37f348880744 admin admin] PATH_INFO: `/v3/projects/92298ea9023b416c8b34a83111bb264e` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.265878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a278855-eaf2-4231-a046-0be29c0520c0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:26.267767 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34042963-2ebc-4cd0-92f5-37f348880744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92298ea9023b416c8b34a83111bb264e)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:26.273972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34042963-2ebc-4cd0-92f5-37f348880744 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:26.276407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12aa84-107e-4026-96a7-f67c3bd0c939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:26.277842 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12aa84-107e-4026-96a7-f67c3bd0c939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.277988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12aa84-107e-4026-96a7-f67c3bd0c939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.278368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12aa84-107e-4026-96a7-f67c3bd0c939 admin admin] PATH_INFO: `/v3/projects/16cc495d5ae54d41a485a9c10964c482` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.280985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12aa84-107e-4026-96a7-f67c3bd0c939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16cc495d5ae54d41a485a9c10964c482)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:26.283127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12aa84-107e-4026-96a7-f67c3bd0c939 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:26.335404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-34042963-2ebc-4cd0-92f5-37f348880744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92298ea9023b416c8b34a83111bb264e', 'request_id': 'req-34042963-2ebc-4cd0-92f5-37f348880744'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:26.341724 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4e12aa84-107e-4026-96a7-f67c3bd0c939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16cc495d5ae54d41a485a9c10964c482', 'request_id': 'req-4e12aa84-107e-4026-96a7-f67c3bd0c939'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:26.351010 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-34042963-2ebc-4cd0-92f5-37f348880744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92298ea9023b416c8b34a83111bb264e', 'request_id': 'req-34042963-2ebc-4cd0-92f5-37f348880744'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:26.352068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4e12aa84-107e-4026-96a7-f67c3bd0c939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16cc495d5ae54d41a485a9c10964c482', 'request_id': 'req-4e12aa84-107e-4026-96a7-f67c3bd0c939'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:26.362504 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-34042963-2ebc-4cd0-92f5-37f348880744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92298ea9023b416c8b34a83111bb264e', 'request_id': 'req-34042963-2ebc-4cd0-92f5-37f348880744'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:26.367314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4e12aa84-107e-4026-96a7-f67c3bd0c939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16cc495d5ae54d41a485a9c10964c482', 'request_id': 'req-4e12aa84-107e-4026-96a7-f67c3bd0c939'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:26.374800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-34042963-2ebc-4cd0-92f5-37f348880744 admin admin] The token cache is being invalidate because project 92298ea9023b416c8b34a83111bb264e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:26.375347 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-34042963-2ebc-4cd0-92f5-37f348880744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:26.376716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-34042963-2ebc-4cd0-92f5-37f348880744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:26.376860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:26.382709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1020/2045] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:26 2022] DELETE /identity/v3/projects/92298ea9023b416c8b34a83111bb264e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:26.384291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16dd55-8f40-4328-a9b4-08ea9e0feaf0 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.384540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4e12aa84-107e-4026-96a7-f67c3bd0c939 admin admin] The token cache is being invalidate because project 16cc495d5ae54d41a485a9c10964c482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:26.384927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16dd55-8f40-4328-a9b4-08ea9e0feaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.385076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4e12aa84-107e-4026-96a7-f67c3bd0c939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:26.385465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16dd55-8f40-4328-a9b4-08ea9e0feaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.387608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4e12aa84-107e-4026-96a7-f67c3bd0c939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:26.389695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1026/2046] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:26 2022] DELETE /identity/v3/projects/16cc495d5ae54d41a485a9c10964c482 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:26.395752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f54d66-cf3b-4b55-9dde-213911e3c2ea None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.396116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f54d66-cf3b-4b55-9dde-213911e3c2ea None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.396916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f54d66-cf3b-4b55-9dde-213911e3c2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.408128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1e16dd55-8f40-4328-a9b4-08ea9e0feaf0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:26.409435 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1e16dd55-8f40-4328-a9b4-08ea9e0feaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:26.416678 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d4f54d66-cf3b-4b55-9dde-213911e3c2ea None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:26.418100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d4f54d66-cf3b-4b55-9dde-213911e3c2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:26.435646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:26.485832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1021/2047] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:26.494507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2c4e8-608f-4552-878f-5fb86e0c3c79 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.494805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2c4e8-608f-4552-878f-5fb86e0c3c79 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.495086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2c4e8-608f-4552-878f-5fb86e0c3c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.496955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1027/2048] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:26.506694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a14ec-50d1-4667-a189-5f6d001452ef None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.507072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a14ec-50d1-4667-a189-5f6d001452ef None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.507462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a14ec-50d1-4667-a189-5f6d001452ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.520593 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-65c2c4e8-608f-4552-878f-5fb86e0c3c79 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:26.522087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-65c2c4e8-608f-4552-878f-5fb86e0c3c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:26.537736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-394a14ec-50d1-4667-a189-5f6d001452ef None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:26.540008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-394a14ec-50d1-4667-a189-5f6d001452ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:26.541205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1022/2049] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:26.546176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2c4e8-608f-4552-878f-5fb86e0c3c79 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:26.562442 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1028/2050] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:26.563001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2c4e8-608f-4552-878f-5fb86e0c3c79 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:26.564093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a14ec-50d1-4667-a189-5f6d001452ef None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:26.570745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2df60a-2f88-4007-8087-26a64e3dc3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:26.571755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2df60a-2f88-4007-8087-26a64e3dc3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.574378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a14ec-50d1-4667-a189-5f6d001452ef None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:26.576272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2df60a-2f88-4007-8087-26a64e3dc3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.576678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2df60a-2f88-4007-8087-26a64e3dc3b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.579339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2df60a-2f88-4007-8087-26a64e3dc3b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:26.579842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2df60a-2f88-4007-8087-26a64e3dc3b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:26.582576 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2df60a-2f88-4007-8087-26a64e3dc3b0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:26.583748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13d3b2-2db2-4aaa-ab1e-cb97147776e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:26.584747 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13d3b2-2db2-4aaa-ab1e-cb97147776e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.585137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13d3b2-2db2-4aaa-ab1e-cb97147776e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.586134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13d3b2-2db2-4aaa-ab1e-cb97147776e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.587631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13d3b2-2db2-4aaa-ab1e-cb97147776e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:26.588067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13d3b2-2db2-4aaa-ab1e-cb97147776e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:26.590196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13d3b2-2db2-4aaa-ab1e-cb97147776e0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:26.601768 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1023/2051] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:26.605541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2df60a-2f88-4007-8087-26a64e3dc3b0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:26.614709 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1029/2052] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:42:26.615820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13d3b2-2db2-4aaa-ab1e-cb97147776e0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:26.619419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2df60a-2f88-4007-8087-26a64e3dc3b0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:26.624776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70a684-3e5a-4355-8da4-e00dd1e83d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:26.625743 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70a684-3e5a-4355-8da4-e00dd1e83d4f admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.627054 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13d3b2-2db2-4aaa-ab1e-cb97147776e0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:26.629003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70a684-3e5a-4355-8da4-e00dd1e83d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.629736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70a684-3e5a-4355-8da4-e00dd1e83d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.631967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70a684-3e5a-4355-8da4-e00dd1e83d4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:26.636988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70a684-3e5a-4355-8da4-e00dd1e83d4f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:26.645078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17345a72-f5ae-41b2-838e-e542735cae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:26.646080 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17345a72-f5ae-41b2-838e-e542735cae23 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.646436 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17345a72-f5ae-41b2-838e-e542735cae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.646781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17345a72-f5ae-41b2-838e-e542735cae23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.647857 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17345a72-f5ae-41b2-838e-e542735cae23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:26.653097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17345a72-f5ae-41b2-838e-e542735cae23 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:26.686538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1024/2053] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:26 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:26.691577 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70a684-3e5a-4355-8da4-e00dd1e83d4f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:26.696211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1030/2054] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:26 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:26.700163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17345a72-f5ae-41b2-838e-e542735cae23 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:26.781383 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70a684-3e5a-4355-8da4-e00dd1e83d4f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:26.837616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17345a72-f5ae-41b2-838e-e542735cae23 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:26.845258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2cddc-ae7c-47a4-b02f-3264b0ce2a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:26.846260 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cddc-ae7c-47a4-b02f-3264b0ce2a4c admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.846884 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cddc-ae7c-47a4-b02f-3264b0ce2a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.847280 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cddc-ae7c-47a4-b02f-3264b0ce2a4c admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.848202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2cddc-ae7c-47a4-b02f-3264b0ce2a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:26.850913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2cddc-ae7c-47a4-b02f-3264b0ce2a4c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:26.869197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aab61a-f0c4-410d-a815-17e680d206f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:26.870115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aab61a-f0c4-410d-a815-17e680d206f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.870545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aab61a-f0c4-410d-a815-17e680d206f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.870923 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aab61a-f0c4-410d-a815-17e680d206f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.871958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aab61a-f0c4-410d-a815-17e680d206f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:26.874957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aab61a-f0c4-410d-a815-17e680d206f8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:26.883321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1031/2055] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:26 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:42:26.884837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2cddc-ae7c-47a4-b02f-3264b0ce2a4c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:26.896867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2cddc-ae7c-47a4-b02f-3264b0ce2a4c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:26.912227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddf586-09da-4c4f-8a2d-652a666379d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:26.913825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddf586-09da-4c4f-8a2d-652a666379d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.914410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1025/2056] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:26 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:26.915309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddf586-09da-4c4f-8a2d-652a666379d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.915773 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddf586-09da-4c4f-8a2d-652a666379d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.916879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddf586-09da-4c4f-8a2d-652a666379d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:26.919083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aab61a-f0c4-410d-a815-17e680d206f8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:26.919759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddf586-09da-4c4f-8a2d-652a666379d3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:26.941310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aab61a-f0c4-410d-a815-17e680d206f8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:26.944883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1032/2057] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:26.948584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddf586-09da-4c4f-8a2d-652a666379d3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:26.949331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3293-a685-4dbc-89ea-639e8eb1eba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:26.950014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3293-a685-4dbc-89ea-639e8eb1eba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.950303 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3293-a685-4dbc-89ea-639e8eb1eba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.950582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3293-a685-4dbc-89ea-639e8eb1eba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.951343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df3293-a685-4dbc-89ea-639e8eb1eba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:26.952955 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df3293-a685-4dbc-89ea-639e8eb1eba7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:26.963278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddf586-09da-4c4f-8a2d-652a666379d3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:26.969070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1026/2058] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:42:26.970660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3293-a685-4dbc-89ea-639e8eb1eba7 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:26.975842 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa88a4f-e248-4804-8fff-4a4c9dd6a238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:26.977251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88a4f-e248-4804-8fff-4a4c9dd6a238 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.977564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88a4f-e248-4804-8fff-4a4c9dd6a238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.977849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88a4f-e248-4804-8fff-4a4c9dd6a238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.978598 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa88a4f-e248-4804-8fff-4a4c9dd6a238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:26.982220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa88a4f-e248-4804-8fff-4a4c9dd6a238 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:26.989429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3293-a685-4dbc-89ea-639e8eb1eba7 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:26.994270 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58243d-3c37-4164-b283-6e2057b88be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:26.995042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58243d-3c37-4164-b283-6e2057b88be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:26.995375 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58243d-3c37-4164-b283-6e2057b88be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:26.995668 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58243d-3c37-4164-b283-6e2057b88be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:26.996398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58243d-3c37-4164-b283-6e2057b88be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:26.998001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58243d-3c37-4164-b283-6e2057b88be2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:27.005023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1033/2059] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:27.012667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa88a4f-e248-4804-8fff-4a4c9dd6a238 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:27.019223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1027/2060] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:27.022647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58243d-3c37-4164-b283-6e2057b88be2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:27.026772 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa88a4f-e248-4804-8fff-4a4c9dd6a238 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:27.029644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:27.043005 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58243d-3c37-4164-b283-6e2057b88be2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:27.056290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde7eb3-3559-4271-95ae-7d92d52d632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:27.060233 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9b71a-259c-442a-a8e4-cd1331fbe06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:27.060618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde7eb3-3559-4271-95ae-7d92d52d632c admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:27.061014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde7eb3-3559-4271-95ae-7d92d52d632c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:27.061949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9b71a-259c-442a-a8e4-cd1331fbe06f admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:27.062625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde7eb3-3559-4271-95ae-7d92d52d632c admin admin] PATH_INFO: `/v3/projects/d9cd0eed1a6b4d10a67990637ab432f7/users/41834f77da294423959346d8bded8eb9/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:27.063797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9b71a-259c-442a-a8e4-cd1331fbe06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:27.064469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9b71a-259c-442a-a8e4-cd1331fbe06f admin admin] PATH_INFO: `/v3/projects/a2b7103282b349e2a6ff4a6e9f1bb605/users/4bd7c473c28b48129b15e19b30ffe97f/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:27.089772 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9b71a-259c-442a-a8e4-cd1331fbe06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b7103282b349e2a6ff4a6e9f1bb605, user_id=4bd7c473c28b48129b15e19b30ffe97f, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:27.099343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9b71a-259c-442a-a8e4-cd1331fbe06f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:27.107405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde7eb3-3559-4271-95ae-7d92d52d632c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cd0eed1a6b4d10a67990637ab432f7, user_id=41834f77da294423959346d8bded8eb9, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:27.111116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde7eb3-3559-4271-95ae-7d92d52d632c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:27.124003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1034/2061] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:27 2022] PUT /identity/v3/projects/a2b7103282b349e2a6ff4a6e9f1bb605/users/4bd7c473c28b48129b15e19b30ffe97f/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:27.136503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256af8e-8670-42d6-8966-72b35e4a24a6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:27.136964 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256af8e-8670-42d6-8966-72b35e4a24a6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:27.137212 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256af8e-8670-42d6-8966-72b35e4a24a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:27.152949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:27.173502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1028/2062] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:27 2022] PUT /identity/v3/projects/d9cd0eed1a6b4d10a67990637ab432f7/users/41834f77da294423959346d8bded8eb9/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:27.186972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f311705-5322-4480-becc-3019ee72eda5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:27.187464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f311705-5322-4480-becc-3019ee72eda5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:27.188883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f311705-5322-4480-becc-3019ee72eda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:27.214411 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a256af8e-8670-42d6-8966-72b35e4a24a6 None None] MFA Rules not processed for user `4bd7c473c28b48129b15e19b30ffe97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:27.215758 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a256af8e-8670-42d6-8966-72b35e4a24a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:27.236505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4f311705-5322-4480-becc-3019ee72eda5 None None] MFA Rules not processed for user `41834f77da294423959346d8bded8eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:27.239289 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4f311705-5322-4480-becc-3019ee72eda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:27.341415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1035/2063] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:27.342358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256af8e-8670-42d6-8966-72b35e4a24a6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:27.344068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a256af8e-8670-42d6-8966-72b35e4a24a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:27.371615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1029/2064] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:27.371615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f311705-5322-4480-becc-3019ee72eda5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:27.431007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256af8e-8670-42d6-8966-72b35e4a24a6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:27.436014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:27.437131 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:27.437431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:27.437822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] PATH_INFO: `/v3/users/50f86431c38047dcaa317274109db12a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:27.439129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f86431c38047dcaa317274109db12a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:27.441102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:27.457061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f311705-5322-4480-becc-3019ee72eda5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:27.463465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3856-a53c-4f05-af5b-8ae0e872318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:27.465198 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3856-a53c-4f05-af5b-8ae0e872318c admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:27.465655 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3856-a53c-4f05-af5b-8ae0e872318c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:27.466118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3856-a53c-4f05-af5b-8ae0e872318c admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:27.466967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a3856-a53c-4f05-af5b-8ae0e872318c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:27.469082 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a3856-a53c-4f05-af5b-8ae0e872318c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:27.505550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f86431c38047dcaa317274109db12a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:27.509107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1030/2065] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:27 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:27.512204 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3856-a53c-4f05-af5b-8ae0e872318c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:27.515644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f86431c38047dcaa317274109db12a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:27.525393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f86431c38047dcaa317274109db12a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:27.526101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f86431c38047dcaa317274109db12a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:27.540175 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f86431c38047dcaa317274109db12a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:27.548116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1036/2066] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:27 2022] DELETE /identity/v3/users/50f86431c38047dcaa317274109db12a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:27.549029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:27.550563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:27.565502 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:27.581164 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:27.621441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3856-a53c-4f05-af5b-8ae0e872318c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:27.682579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede20af4-de2c-40b0-96a3-b4236b9f368f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:27.691064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7df747-c029-4f62-8faa-b442deaefdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:27.691810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7df747-c029-4f62-8faa-b442deaefdb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:27.692097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7df747-c029-4f62-8faa-b442deaefdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:27.692378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7df747-c029-4f62-8faa-b442deaefdb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:27.693186 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7df747-c029-4f62-8faa-b442deaefdb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:27.695645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7df747-c029-4f62-8faa-b442deaefdb3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:27.703701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0fca0-e301-4d6c-abd3-91ed1cd7271d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:27.705343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0fca0-e301-4d6c-abd3-91ed1cd7271d admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:27.705915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0fca0-e301-4d6c-abd3-91ed1cd7271d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:27.706354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0fca0-e301-4d6c-abd3-91ed1cd7271d admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:27.707375 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0fca0-e301-4d6c-abd3-91ed1cd7271d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:27.709620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0fca0-e301-4d6c-abd3-91ed1cd7271d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:27.736621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1037/2067] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:27 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:27.737476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9c01c-dba3-49de-8a4a-ea1939ff2e34 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:27.737990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9c01c-dba3-49de-8a4a-ea1939ff2e34 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:27.738282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9c01c-dba3-49de-8a4a-ea1939ff2e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:27.751922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1031/2068] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:27 2022] POST /identity/v3/projects => generated 389 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:27.752547 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0fca0-e301-4d6c-abd3-91ed1cd7271d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:27.764157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-20a9c01c-dba3-49de-8a4a-ea1939ff2e34 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:27.765469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-20a9c01c-dba3-49de-8a4a-ea1939ff2e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:27.840092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1038/2069] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:27.841328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9c01c-dba3-49de-8a4a-ea1939ff2e34 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:27.842950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-20a9c01c-dba3-49de-8a4a-ea1939ff2e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:27.853298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0fca0-e301-4d6c-abd3-91ed1cd7271d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:27.857248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9c01c-dba3-49de-8a4a-ea1939ff2e34 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:27.858393 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe58d4-3aa2-4450-94fc-c697ff86cbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:27.863537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe58d4-3aa2-4450-94fc-c697ff86cbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:27.863537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe58d4-3aa2-4450-94fc-c697ff86cbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:27.863537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe58d4-3aa2-4450-94fc-c697ff86cbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:27.863537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe58d4-3aa2-4450-94fc-c697ff86cbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:27.863537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe58d4-3aa2-4450-94fc-c697ff86cbb9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:27.866241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5b232-44dc-4638-82a9-8aa964005f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:27.866940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5b232-44dc-4638-82a9-8aa964005f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:27.867300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5b232-44dc-4638-82a9-8aa964005f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:27.867583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5b232-44dc-4638-82a9-8aa964005f1a admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:27.868284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5b232-44dc-4638-82a9-8aa964005f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:27.870768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5b232-44dc-4638-82a9-8aa964005f1a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:27.883302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1032/2070] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:27.884740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe58d4-3aa2-4450-94fc-c697ff86cbb9 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:27.887285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9dbe58d4-3aa2-4450-94fc-c697ff86cbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:27.904389 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1039/2071] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:27 2022] POST /identity/v3/users => generated 301 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:27.904389 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5b232-44dc-4638-82a9-8aa964005f1a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:27.915339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5b232-44dc-4638-82a9-8aa964005f1a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:27.920141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836daf13-cd2b-4635-a390-9f5c40133001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:27.921056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836daf13-cd2b-4635-a390-9f5c40133001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:27.921391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836daf13-cd2b-4635-a390-9f5c40133001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:27.921672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836daf13-cd2b-4635-a390-9f5c40133001 admin admin] PATH_INFO: `/v3/projects/c63ff77f731a405d869bfffe9cbe10cd/users/6061540c68034c058b36ad48f5a9c44b/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:27.937596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836daf13-cd2b-4635-a390-9f5c40133001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63ff77f731a405d869bfffe9cbe10cd, user_id=6061540c68034c058b36ad48f5a9c44b, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:27.941443 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836daf13-cd2b-4635-a390-9f5c40133001 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:27.962631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1040/2072] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:27 2022] PUT /identity/v3/projects/c63ff77f731a405d869bfffe9cbe10cd/users/6061540c68034c058b36ad48f5a9c44b/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:27.964018 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836daf13-cd2b-4635-a390-9f5c40133001 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:27.969706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe58d4-3aa2-4450-94fc-c697ff86cbb9 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:28.011787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:28.036294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a14f7-cb7e-411d-8683-73601a200dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:28.037253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a14f7-cb7e-411d-8683-73601a200dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:28.037581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a14f7-cb7e-411d-8683-73601a200dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:28.037891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a14f7-cb7e-411d-8683-73601a200dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:28.040712 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836daf13-cd2b-4635-a390-9f5c40133001 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:28.046127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e70ea-2836-424c-a040-a9f78943cf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:28.046868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e70ea-2836-424c-a040-a9f78943cf44 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:28.047329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e70ea-2836-424c-a040-a9f78943cf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:28.048232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e70ea-2836-424c-a040-a9f78943cf44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:28.048945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a14f7-cb7e-411d-8683-73601a200dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:28.049069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e70ea-2836-424c-a040-a9f78943cf44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:28.050507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a14f7-cb7e-411d-8683-73601a200dc3 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:28.050829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e70ea-2836-424c-a040-a9f78943cf44 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:28.052459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:28.065587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1033/2073] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:28.066821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a14f7-cb7e-411d-8683-73601a200dc3 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:28.076687 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1041/2074] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:28.076687 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e70ea-2836-424c-a040-a9f78943cf44 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:28.083712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a14f7-cb7e-411d-8683-73601a200dc3 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:28.089750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d1d32-a835-45fd-b8ca-7c60f6c39b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:28.090665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d1d32-a835-45fd-b8ca-7c60f6c39b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:28.090961 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d1d32-a835-45fd-b8ca-7c60f6c39b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:28.091142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e70ea-2836-424c-a040-a9f78943cf44 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:28.091517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d1d32-a835-45fd-b8ca-7c60f6c39b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:28.092656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d1d32-a835-45fd-b8ca-7c60f6c39b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:28.096374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d1d32-a835-45fd-b8ca-7c60f6c39b41 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:28.097457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc55001-d2bd-4a7a-8b9d-078ec8d6e5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:28.098592 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55001-d2bd-4a7a-8b9d-078ec8d6e5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:28.098988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55001-d2bd-4a7a-8b9d-078ec8d6e5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:28.099526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55001-d2bd-4a7a-8b9d-078ec8d6e5b9 admin admin] PATH_INFO: `/v3/projects/b803519f003e4dc09e816ccb3472fd46/users/973b83e9eb70415abb23cf6a2d552aa7/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:28.116230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1034/2075] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:28.120649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d1d32-a835-45fd-b8ca-7c60f6c39b41 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:28.124883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc55001-d2bd-4a7a-8b9d-078ec8d6e5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b803519f003e4dc09e816ccb3472fd46, user_id=973b83e9eb70415abb23cf6a2d552aa7, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:28.129733 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc55001-d2bd-4a7a-8b9d-078ec8d6e5b9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:28.137852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d1d32-a835-45fd-b8ca-7c60f6c39b41 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:28.148420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dd52f-3449-487b-847e-6d3d77ed107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:28.150141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dd52f-3449-487b-847e-6d3d77ed107a admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:28.150663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dd52f-3449-487b-847e-6d3d77ed107a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:28.152406 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1042/2076] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:28 2022] PUT /identity/v3/projects/b803519f003e4dc09e816ccb3472fd46/users/973b83e9eb70415abb23cf6a2d552aa7/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:28.157157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc55001-d2bd-4a7a-8b9d-078ec8d6e5b9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:28.160754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dd52f-3449-487b-847e-6d3d77ed107a admin admin] PATH_INFO: `/v3/projects/c63ff77f731a405d869bfffe9cbe10cd/users/6061540c68034c058b36ad48f5a9c44b/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:28.163669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dd52f-3449-487b-847e-6d3d77ed107a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63ff77f731a405d869bfffe9cbe10cd, user_id=6061540c68034c058b36ad48f5a9c44b, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:28.168197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dd52f-3449-487b-847e-6d3d77ed107a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:28.185616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1035/2077] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:28 2022] PUT /identity/v3/projects/c63ff77f731a405d869bfffe9cbe10cd/users/6061540c68034c058b36ad48f5a9c44b/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:28.198929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc511ba-3db8-4376-afc8-b98385486278 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:28.199396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc511ba-3db8-4376-afc8-b98385486278 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:28.199750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc511ba-3db8-4376-afc8-b98385486278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:28.249388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4dc511ba-3db8-4376-afc8-b98385486278 None None] MFA Rules not processed for user `6061540c68034c058b36ad48f5a9c44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:28.252246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4dc511ba-3db8-4376-afc8-b98385486278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:28.278675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc55001-d2bd-4a7a-8b9d-078ec8d6e5b9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:28.379931 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1036/2078] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:28.388271 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc511ba-3db8-4376-afc8-b98385486278 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:28.390322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4dc511ba-3db8-4376-afc8-b98385486278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:28.391954 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429ff9e-63c6-450f-98c6-6521dc6f5855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:28.392832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429ff9e-63c6-450f-98c6-6521dc6f5855 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:28.393320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429ff9e-63c6-450f-98c6-6521dc6f5855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:28.393741 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429ff9e-63c6-450f-98c6-6521dc6f5855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:28.394851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429ff9e-63c6-450f-98c6-6521dc6f5855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:28.397088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429ff9e-63c6-450f-98c6-6521dc6f5855 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:28.413236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1043/2079] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:42:28.418935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429ff9e-63c6-450f-98c6-6521dc6f5855 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:28.446211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429ff9e-63c6-450f-98c6-6521dc6f5855 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:28.454319 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14cfa9-a495-45fc-95cf-191407d8647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:28.455634 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14cfa9-a495-45fc-95cf-191407d8647f admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:28.455993 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14cfa9-a495-45fc-95cf-191407d8647f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:28.456349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14cfa9-a495-45fc-95cf-191407d8647f admin admin] PATH_INFO: `/v3/projects/b803519f003e4dc09e816ccb3472fd46/users/973b83e9eb70415abb23cf6a2d552aa7/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:28.458853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14cfa9-a495-45fc-95cf-191407d8647f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b803519f003e4dc09e816ccb3472fd46, user_id=973b83e9eb70415abb23cf6a2d552aa7, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:28.462105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14cfa9-a495-45fc-95cf-191407d8647f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:28.521016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1044/2080] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:28 2022] PUT /identity/v3/projects/b803519f003e4dc09e816ccb3472fd46/users/973b83e9eb70415abb23cf6a2d552aa7/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:28.523214 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae7d0-5e93-4fe1-9c3e-bdd2a4a44306 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:28.525152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae7d0-5e93-4fe1-9c3e-bdd2a4a44306 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:28.525621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae7d0-5e93-4fe1-9c3e-bdd2a4a44306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:28.528850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc511ba-3db8-4376-afc8-b98385486278 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:28.608919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-efcae7d0-5e93-4fe1-9c3e-bdd2a4a44306 None None] MFA Rules not processed for user `973b83e9eb70415abb23cf6a2d552aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:28.610808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-efcae7d0-5e93-4fe1-9c3e-bdd2a4a44306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:28.654114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281cda-0dea-4a3e-aa5c-88ce8b1546f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:28.654332 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281cda-0dea-4a3e-aa5c-88ce8b1546f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:28.654637 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281cda-0dea-4a3e-aa5c-88ce8b1546f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:28.654874 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281cda-0dea-4a3e-aa5c-88ce8b1546f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:28.659721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-39281cda-0dea-4a3e-aa5c-88ce8b1546f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:28.683159 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:28.712922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:28.779363 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1045/2081] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:28.780120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcae7d0-5e93-4fe1-9c3e-bdd2a4a44306 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:28.784313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-efcae7d0-5e93-4fe1-9c3e-bdd2a4a44306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:28.789390 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281cda-0dea-4a3e-aa5c-88ce8b1546f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:28.791148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281cda-0dea-4a3e-aa5c-88ce8b1546f3 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:28.815515 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1037/2082] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:28.816737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281cda-0dea-4a3e-aa5c-88ce8b1546f3 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:28.819638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-39281cda-0dea-4a3e-aa5c-88ce8b1546f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:28.837513 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281cda-0dea-4a3e-aa5c-88ce8b1546f3 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:28.844016 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee596044-b5c9-468c-83c6-5189bace9875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:28.845071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee596044-b5c9-468c-83c6-5189bace9875 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:28.845430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee596044-b5c9-468c-83c6-5189bace9875 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:28.845961 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee596044-b5c9-468c-83c6-5189bace9875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:28.862165 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee596044-b5c9-468c-83c6-5189bace9875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:28.865190 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee596044-b5c9-468c-83c6-5189bace9875 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:28.881878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1038/2083] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:28.936582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcae7d0-5e93-4fe1-9c3e-bdd2a4a44306 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:28.952959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:28.954897 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:28.955904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:28.955904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] PATH_INFO: `/v3/projects/9adda9f1d83d4fd2a7f47fd8ea7cb7b1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:28.958280 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9adda9f1d83d4fd2a7f47fd8ea7cb7b1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:28.964632 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:29.053871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9adda9f1d83d4fd2a7f47fd8ea7cb7b1', 'request_id': 'req-29adf358-ec2c-4a38-aebb-c8d27b5222a0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.062270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9adda9f1d83d4fd2a7f47fd8ea7cb7b1', 'request_id': 'req-29adf358-ec2c-4a38-aebb-c8d27b5222a0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.076894 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9adda9f1d83d4fd2a7f47fd8ea7cb7b1', 'request_id': 'req-29adf358-ec2c-4a38-aebb-c8d27b5222a0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.092589 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] The token cache is being invalidate because project 9adda9f1d83d4fd2a7f47fd8ea7cb7b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:29.093176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.095933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.098473 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1046/2084] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:28 2022] DELETE /identity/v3/projects/9adda9f1d83d4fd2a7f47fd8ea7cb7b1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:29.102429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee596044-b5c9-468c-83c6-5189bace9875 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:29.115658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee596044-b5c9-468c-83c6-5189bace9875 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:29.136006 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:29.139123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:29.272651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adf358-ec2c-4a38-aebb-c8d27b5222a0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:29.304104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:29.305028 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:29.305536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:29.305681 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] PATH_INFO: `/v3/users/41834f77da294423959346d8bded8eb9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:29.306776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57b405-3ed9-4542-952b-d81b52388ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:29.310400 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b405-3ed9-4542-952b-d81b52388ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:29.311010 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b405-3ed9-4542-952b-d81b52388ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:29.311362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b405-3ed9-4542-952b-d81b52388ddd admin admin] PATH_INFO: `/v3/users/7ce256eb7af44e248fe474e7ba475cda` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:29.318288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41834f77da294423959346d8bded8eb9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:29.328078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:29.328938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57b405-3ed9-4542-952b-d81b52388ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce256eb7af44e248fe474e7ba475cda)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:29.331797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57b405-3ed9-4542-952b-d81b52388ddd admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:29.404156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:29.464302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fb57b405-3ed9-4542-952b-d81b52388ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce256eb7af44e248fe474e7ba475cda'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.465140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fb57b405-3ed9-4542-952b-d81b52388ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce256eb7af44e248fe474e7ba475cda'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.472605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41834f77da294423959346d8bded8eb9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.482040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fb57b405-3ed9-4542-952b-d81b52388ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce256eb7af44e248fe474e7ba475cda'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.487261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41834f77da294423959346d8bded8eb9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.499617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41834f77da294423959346d8bded8eb9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.501477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41834f77da294423959346d8bded8eb9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.505273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fb57b405-3ed9-4542-952b-d81b52388ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce256eb7af44e248fe474e7ba475cda'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.517039 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fb57b405-3ed9-4542-952b-d81b52388ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce256eb7af44e248fe474e7ba475cda'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.527111 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1039/2085] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:29 2022] DELETE /identity/v3/users/7ce256eb7af44e248fe474e7ba475cda => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:29.536590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41834f77da294423959346d8bded8eb9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:29.544122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1047/2086] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:29 2022] DELETE /identity/v3/users/41834f77da294423959346d8bded8eb9 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:29.551221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710d758-91ec-436d-ba2a-05d6f3bca1bd None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:29.551221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710d758-91ec-436d-ba2a-05d6f3bca1bd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:29.551221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710d758-91ec-436d-ba2a-05d6f3bca1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:29.571828 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8710d758-91ec-436d-ba2a-05d6f3bca1bd None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:29.573134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8710d758-91ec-436d-ba2a-05d6f3bca1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:29.590134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:29.656086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1040/2087] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:29.698571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:29.700243 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:29.850894 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c493409-15da-4a2e-b62a-62fc4883a6d8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:29.855545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434ca10-b4a5-4184-939b-d69da7efd2aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:29.856406 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434ca10-b4a5-4184-939b-d69da7efd2aa service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:29.856771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434ca10-b4a5-4184-939b-d69da7efd2aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:29.857175 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434ca10-b4a5-4184-939b-d69da7efd2aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:29.873287 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434ca10-b4a5-4184-939b-d69da7efd2aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:29.876769 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434ca10-b4a5-4184-939b-d69da7efd2aa service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:29.890323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1048/2088] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:29.967313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710d758-91ec-436d-ba2a-05d6f3bca1bd None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:29.973289 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8710d758-91ec-436d-ba2a-05d6f3bca1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:29.986894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710d758-91ec-436d-ba2a-05d6f3bca1bd None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:29.994952 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:29.996694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:29.997087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:29.997488 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79 admin admin] PATH_INFO: `/v3/projects/432630c8db8c4b0cbe8ee69e997adb7f` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:29.998945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432630c8db8c4b0cbe8ee69e997adb7f)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:30.001591 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:30.009775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434ca10-b4a5-4184-939b-d69da7efd2aa service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:30.012321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4434ca10-b4a5-4184-939b-d69da7efd2aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:30.044976 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434ca10-b4a5-4184-939b-d69da7efd2aa service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:30.052624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9082f-4d0b-4d84-8f85-dafe20fb3acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:30.053475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9082f-4d0b-4d84-8f85-dafe20fb3acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:30.053475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9082f-4d0b-4d84-8f85-dafe20fb3acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:30.053758 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9082f-4d0b-4d84-8f85-dafe20fb3acd admin admin] PATH_INFO: `/v3/users/52a78b70e83f4fe4a319cd96a312c3ae` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:30.054910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9082f-4d0b-4d84-8f85-dafe20fb3acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a78b70e83f4fe4a319cd96a312c3ae)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:30.058967 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9082f-4d0b-4d84-8f85-dafe20fb3acd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:30.083184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432630c8db8c4b0cbe8ee69e997adb7f', 'request_id': 'req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.100309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432630c8db8c4b0cbe8ee69e997adb7f', 'request_id': 'req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.108344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432630c8db8c4b0cbe8ee69e997adb7f', 'request_id': 'req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.138415 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79 admin admin] The token cache is being invalidate because project 432630c8db8c4b0cbe8ee69e997adb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:30.138737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.140120 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27181d2f-c58b-40d8-bec5-6cf6c82dcc79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.150685 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1041/2089] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:29 2022] DELETE /identity/v3/projects/432630c8db8c4b0cbe8ee69e997adb7f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:30.154059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950542d-7056-4463-b895-30cade072623 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:30.155585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950542d-7056-4463-b895-30cade072623 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:30.155885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950542d-7056-4463-b895-30cade072623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:30.181078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6bd9082f-4d0b-4d84-8f85-dafe20fb3acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a78b70e83f4fe4a319cd96a312c3ae'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.194031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6bd9082f-4d0b-4d84-8f85-dafe20fb3acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a78b70e83f4fe4a319cd96a312c3ae'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.205357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5950542d-7056-4463-b895-30cade072623 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:30.206731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5950542d-7056-4463-b895-30cade072623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:30.208729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6bd9082f-4d0b-4d84-8f85-dafe20fb3acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a78b70e83f4fe4a319cd96a312c3ae'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.210392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6bd9082f-4d0b-4d84-8f85-dafe20fb3acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a78b70e83f4fe4a319cd96a312c3ae'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.241106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6bd9082f-4d0b-4d84-8f85-dafe20fb3acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a78b70e83f4fe4a319cd96a312c3ae'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.257655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1049/2090] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:30 2022] DELETE /identity/v3/users/52a78b70e83f4fe4a319cd96a312c3ae => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:30.261693 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edd9c5-bce3-41e9-9c21-9090b4725756 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:30.262098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edd9c5-bce3-41e9-9c21-9090b4725756 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:30.262252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edd9c5-bce3-41e9-9c21-9090b4725756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:30.301312 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-25edd9c5-bce3-41e9-9c21-9090b4725756 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:30.302602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-25edd9c5-bce3-41e9-9c21-9090b4725756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:30.317951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:30.361867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1042/2091] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:30.370793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87682fa-e2c2-4f56-8fde-a7d2e3562e2f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:30.371275 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87682fa-e2c2-4f56-8fde-a7d2e3562e2f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:30.390226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87682fa-e2c2-4f56-8fde-a7d2e3562e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:30.423268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f87682fa-e2c2-4f56-8fde-a7d2e3562e2f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:30.424684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f87682fa-e2c2-4f56-8fde-a7d2e3562e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:30.452642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1050/2092] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:30.461845 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edd9c5-bce3-41e9-9c21-9090b4725756 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:30.465682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-25edd9c5-bce3-41e9-9c21-9090b4725756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:30.501376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edd9c5-bce3-41e9-9c21-9090b4725756 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:30.510144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:30.512265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:30.512620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:30.513754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:30.514579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] PATH_INFO: `/v3/projects/d9cd0eed1a6b4d10a67990637ab432f7` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:30.518231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9cd0eed1a6b4d10a67990637ab432f7)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:30.528203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:30.590452 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1043/2093] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:30.590452 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87682fa-e2c2-4f56-8fde-a7d2e3562e2f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:30.590452 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f87682fa-e2c2-4f56-8fde-a7d2e3562e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:30.630752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9cd0eed1a6b4d10a67990637ab432f7', 'request_id': 'req-eb37f74d-3875-48f5-bb74-b83f6eb844c1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.641573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9cd0eed1a6b4d10a67990637ab432f7', 'request_id': 'req-eb37f74d-3875-48f5-bb74-b83f6eb844c1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.654957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9cd0eed1a6b4d10a67990637ab432f7', 'request_id': 'req-eb37f74d-3875-48f5-bb74-b83f6eb844c1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.682741 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] The token cache is being invalidate because project d9cd0eed1a6b4d10a67990637ab432f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:30.683033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.683750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:30.685646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1051/2094] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:30 2022] DELETE /identity/v3/projects/d9cd0eed1a6b4d10a67990637ab432f7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:30.686467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:30.704454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:30.741594 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87682fa-e2c2-4f56-8fde-a7d2e3562e2f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:30.853754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37f74d-3875-48f5-bb74-b83f6eb844c1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:30.866584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad480f1-8b5f-4e3d-8f74-d492f60174e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:30.867313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad480f1-8b5f-4e3d-8f74-d492f60174e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:30.867584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad480f1-8b5f-4e3d-8f74-d492f60174e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:30.867861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad480f1-8b5f-4e3d-8f74-d492f60174e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:30.868874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad480f1-8b5f-4e3d-8f74-d492f60174e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:30.868874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad480f1-8b5f-4e3d-8f74-d492f60174e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:30.869875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec1773-d5b0-40d2-a91c-096a8ef83131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:30.870495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad480f1-8b5f-4e3d-8f74-d492f60174e1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:30.871530 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec1773-d5b0-40d2-a91c-096a8ef83131 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:30.871823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec1773-d5b0-40d2-a91c-096a8ef83131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:30.872167 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec1773-d5b0-40d2-a91c-096a8ef83131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:30.874237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-73ec1773-d5b0-40d2-a91c-096a8ef83131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:30.891883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec1773-d5b0-40d2-a91c-096a8ef83131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:30.893697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec1773-d5b0-40d2-a91c-096a8ef83131 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:30.896500 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1052/2095] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:30.896500 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad480f1-8b5f-4e3d-8f74-d492f60174e1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:30.900799 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aad480f1-8b5f-4e3d-8f74-d492f60174e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:30.910930 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1044/2096] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:30.912417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec1773-d5b0-40d2-a91c-096a8ef83131 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:30.923149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec1773-d5b0-40d2-a91c-096a8ef83131 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:30.925362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad480f1-8b5f-4e3d-8f74-d492f60174e1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:30.928191 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28abc0-4060-4fc4-8bbd-5bee5718d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:30.928860 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28abc0-4060-4fc4-8bbd-5bee5718d2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:30.929122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28abc0-4060-4fc4-8bbd-5bee5718d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:30.929842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28abc0-4060-4fc4-8bbd-5bee5718d2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:30.930547 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28abc0-4060-4fc4-8bbd-5bee5718d2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:30.931702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:30.932490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28abc0-4060-4fc4-8bbd-5bee5718d2f3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:30.933049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:30.933493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:30.934029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] PATH_INFO: `/v3/users/973b83e9eb70415abb23cf6a2d552aa7` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:30.935510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] RBAC: Authorizing `identity:delete_user(user_id=973b83e9eb70415abb23cf6a2d552aa7)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:30.941465 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:30.975475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1045/2097] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:30 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:30.979864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28abc0-4060-4fc4-8bbd-5bee5718d2f3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:30.990552 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:31.037474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973b83e9eb70415abb23cf6a2d552aa7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.049222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973b83e9eb70415abb23cf6a2d552aa7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.060791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973b83e9eb70415abb23cf6a2d552aa7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.062431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973b83e9eb70415abb23cf6a2d552aa7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.082724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28abc0-4060-4fc4-8bbd-5bee5718d2f3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:31.090820 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920c72c-f42f-4d6d-9ece-0eee8dbb58ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:31.091397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973b83e9eb70415abb23cf6a2d552aa7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.092545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c72c-f42f-4d6d-9ece-0eee8dbb58ce admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:31.092545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c72c-f42f-4d6d-9ece-0eee8dbb58ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:31.097203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c72c-f42f-4d6d-9ece-0eee8dbb58ce admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:31.097916 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920c72c-f42f-4d6d-9ece-0eee8dbb58ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:31.103099 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920c72c-f42f-4d6d-9ece-0eee8dbb58ce admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:31.125163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1053/2098] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:30 2022] DELETE /identity/v3/users/973b83e9eb70415abb23cf6a2d552aa7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:31.164772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1046/2099] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:30 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:31.168272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:31.169848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:31.286869 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29f5a-bb23-4abe-b9f6-89ba5d9a1c4d None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:31.287285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29f5a-bb23-4abe-b9f6-89ba5d9a1c4d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:31.287635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29f5a-bb23-4abe-b9f6-89ba5d9a1c4d None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:31.289296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1047/2100] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 20:42:31.326939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf03daa-ba2b-4eb5-b7a2-d3234466039c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:31.327523 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf03daa-ba2b-4eb5-b7a2-d3234466039c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:31.327687 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf03daa-ba2b-4eb5-b7a2-d3234466039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:31.329114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442288f-7998-4e4a-ab46-fd7be1ad306a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:31.337005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf84261-3435-46a7-8c3a-f9fe4f42ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:31.337804 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf84261-3435-46a7-8c3a-f9fe4f42ac71 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:31.338295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf84261-3435-46a7-8c3a-f9fe4f42ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:31.338621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf84261-3435-46a7-8c3a-f9fe4f42ac71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:31.342555 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf84261-3435-46a7-8c3a-f9fe4f42ac71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:31.347761 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf84261-3435-46a7-8c3a-f9fe4f42ac71 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:31.378344 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1054/2101] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:31.379916 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cdf03daa-ba2b-4eb5-b7a2-d3234466039c None None] MFA Rules not processed for user `b98059ebef5d470db684fb78d19a8839`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:31.380747 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf84261-3435-46a7-8c3a-f9fe4f42ac71 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:31.382549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cdf03daa-ba2b-4eb5-b7a2-d3234466039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:31.385631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cdf84261-3435-46a7-8c3a-f9fe4f42ac71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:31.394698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:31.405361 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf84261-3435-46a7-8c3a-f9fe4f42ac71 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:31.412583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:31.413671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:31.414118 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:31.414377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] PATH_INFO: `/v3/projects/a1866d0e79ab46a6925a636a50ca0dc5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:31.416365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1866d0e79ab46a6925a636a50ca0dc5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:31.418926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:31.484638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1866d0e79ab46a6925a636a50ca0dc5', 'request_id': 'req-780881cc-f979-4551-9f58-acec207b58b2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.486900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1048/2102] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:42:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:31.487936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf03daa-ba2b-4eb5-b7a2-d3234466039c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:31.495121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1866d0e79ab46a6925a636a50ca0dc5', 'request_id': 'req-780881cc-f979-4551-9f58-acec207b58b2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.504414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf03daa-ba2b-4eb5-b7a2-d3234466039c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:31.506994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1866d0e79ab46a6925a636a50ca0dc5', 'request_id': 'req-780881cc-f979-4551-9f58-acec207b58b2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.523928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] The token cache is being invalidate because project a1866d0e79ab46a6925a636a50ca0dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:31.524223 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.524903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.526688 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1055/2103] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:31 2022] DELETE /identity/v3/projects/a1866d0e79ab46a6925a636a50ca0dc5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:31.527447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:31.528923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:31.555815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:31.580193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44661afd-4502-43f8-ad30-fc63fffa82a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:31.582460 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44661afd-4502-43f8-ad30-fc63fffa82a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:31.582878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44661afd-4502-43f8-ad30-fc63fffa82a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:31.583186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44661afd-4502-43f8-ad30-fc63fffa82a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:31.586691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44661afd-4502-43f8-ad30-fc63fffa82a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:31.591641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44661afd-4502-43f8-ad30-fc63fffa82a5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:31.606639 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1049/2104] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:31.611501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44661afd-4502-43f8-ad30-fc63fffa82a5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:31.613494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-44661afd-4502-43f8-ad30-fc63fffa82a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:31.613642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780881cc-f979-4551-9f58-acec207b58b2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:31.618888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:31.620082 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:31.620962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:31.621254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] PATH_INFO: `/v3/users/5330fbd804c44634b682d0a865dd8b13` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:31.622653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5330fbd804c44634b682d0a865dd8b13)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:31.624763 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:31.682897 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5330fbd804c44634b682d0a865dd8b13'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.692205 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5330fbd804c44634b682d0a865dd8b13'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.698941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44661afd-4502-43f8-ad30-fc63fffa82a5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:31.706719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81238a15-3535-43d1-8428-2dfe667b9f51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98059ebef5d470db684fb78d19a8839', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:31.706719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81238a15-3535-43d1-8428-2dfe667b9f51 service placement] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:31.706719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81238a15-3535-43d1-8428-2dfe667b9f51 service placement] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:31.706719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81238a15-3535-43d1-8428-2dfe667b9f51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:31.707131 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5330fbd804c44634b682d0a865dd8b13'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.708108 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-81238a15-3535-43d1-8428-2dfe667b9f51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:31.708915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5330fbd804c44634b682d0a865dd8b13'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.724974 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5330fbd804c44634b682d0a865dd8b13'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.726384 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81238a15-3535-43d1-8428-2dfe667b9f51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:31.728934 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81238a15-3535-43d1-8428-2dfe667b9f51 service placement] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:31.737109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1056/2105] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:31 2022] DELETE /identity/v3/users/5330fbd804c44634b682d0a865dd8b13 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:31.737754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:31.739771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:31.754449 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1050/2106] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:31.755260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81238a15-3535-43d1-8428-2dfe667b9f51 service placement] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:31.756842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-81238a15-3535-43d1-8428-2dfe667b9f51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:31.772018 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81238a15-3535-43d1-8428-2dfe667b9f51 service placement] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:31.823534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:31.843965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adc9eb-88c2-4e9a-927c-177339c1c72e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:31.850066 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d94c19-e8a7-4b27-8cd7-be89a5213abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:31.851154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d94c19-e8a7-4b27-8cd7-be89a5213abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:31.851609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d94c19-e8a7-4b27-8cd7-be89a5213abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:31.851967 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d94c19-e8a7-4b27-8cd7-be89a5213abe admin admin] PATH_INFO: `/v3/users/9560e67b0a684553b5e2292f25cf05b6` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:31.853419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d94c19-e8a7-4b27-8cd7-be89a5213abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9560e67b0a684553b5e2292f25cf05b6)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:31.856205 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d94c19-e8a7-4b27-8cd7-be89a5213abe admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:31.870468 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b178f-c2e6-40bd-8cb4-63d9e9a54d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:31.871640 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b178f-c2e6-40bd-8cb4-63d9e9a54d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:31.872150 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b178f-c2e6-40bd-8cb4-63d9e9a54d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:31.876871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b178f-c2e6-40bd-8cb4-63d9e9a54d58 admin admin] PATH_INFO: `/v3/projects/ad58d29752594ce28ef6493eddaf1506/users/2b53dba8ca6b42728e03282f1a612e18/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:31.900635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b178f-c2e6-40bd-8cb4-63d9e9a54d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad58d29752594ce28ef6493eddaf1506, user_id=2b53dba8ca6b42728e03282f1a612e18, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:31.904021 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b178f-c2e6-40bd-8cb4-63d9e9a54d58 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:31.925678 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:31.933533 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1051/2107] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:31 2022] PUT /identity/v3/projects/ad58d29752594ce28ef6493eddaf1506/users/2b53dba8ca6b42728e03282f1a612e18/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:31.934298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b178f-c2e6-40bd-8cb4-63d9e9a54d58 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:31.936494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b83b178f-c2e6-40bd-8cb4-63d9e9a54d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:31.946445 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-11d94c19-e8a7-4b27-8cd7-be89a5213abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9560e67b0a684553b5e2292f25cf05b6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.965736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-11d94c19-e8a7-4b27-8cd7-be89a5213abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9560e67b0a684553b5e2292f25cf05b6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.979156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-11d94c19-e8a7-4b27-8cd7-be89a5213abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9560e67b0a684553b5e2292f25cf05b6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.980282 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-11d94c19-e8a7-4b27-8cd7-be89a5213abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9560e67b0a684553b5e2292f25cf05b6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:31.994613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-11d94c19-e8a7-4b27-8cd7-be89a5213abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9560e67b0a684553b5e2292f25cf05b6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.002865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1057/2108] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:31 2022] DELETE /identity/v3/users/9560e67b0a684553b5e2292f25cf05b6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:32.004283 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd89453-68e2-4cd9-bb64-4383de097d5f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.004576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd89453-68e2-4cd9-bb64-4383de097d5f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.004860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd89453-68e2-4cd9-bb64-4383de097d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.042872 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ccd89453-68e2-4cd9-bb64-4383de097d5f None None] MFA Rules not processed for user `2b53dba8ca6b42728e03282f1a612e18`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:32.044398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ccd89453-68e2-4cd9-bb64-4383de097d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:32.059741 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b178f-c2e6-40bd-8cb4-63d9e9a54d58 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:32.125990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:32.127001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.127310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.127594 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] PATH_INFO: `/v3/projects/b803519f003e4dc09e816ccb3472fd46` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.128891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b803519f003e4dc09e816ccb3472fd46)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:32.130825 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:32.134714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1058/2109] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:32.141192 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd89453-68e2-4cd9-bb64-4383de097d5f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:32.142833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ccd89453-68e2-4cd9-bb64-4383de097d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:32.159507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd89453-68e2-4cd9-bb64-4383de097d5f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:32.165005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef058d-7340-46cb-bb49-73e6efdbee09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:32.165801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef058d-7340-46cb-bb49-73e6efdbee09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.166088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef058d-7340-46cb-bb49-73e6efdbee09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.166368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef058d-7340-46cb-bb49-73e6efdbee09 admin admin] PATH_INFO: `/v3/projects/972f49dc40404f239e6d6d941c411354` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.168400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef058d-7340-46cb-bb49-73e6efdbee09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=972f49dc40404f239e6d6d941c411354)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:32.174201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef058d-7340-46cb-bb49-73e6efdbee09 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:32.207931 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b803519f003e4dc09e816ccb3472fd46', 'request_id': 'req-06dc4a16-2d71-4152-abd6-ed95f0aff53a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.216418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b803519f003e4dc09e816ccb3472fd46', 'request_id': 'req-06dc4a16-2d71-4152-abd6-ed95f0aff53a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.223884 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:32.229816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b803519f003e4dc09e816ccb3472fd46', 'request_id': 'req-06dc4a16-2d71-4152-abd6-ed95f0aff53a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.237882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3fef058d-7340-46cb-bb49-73e6efdbee09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972f49dc40404f239e6d6d941c411354', 'request_id': 'req-3fef058d-7340-46cb-bb49-73e6efdbee09'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.246068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] The token cache is being invalidate because project b803519f003e4dc09e816ccb3472fd46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:32.246339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.246951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3fef058d-7340-46cb-bb49-73e6efdbee09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972f49dc40404f239e6d6d941c411354', 'request_id': 'req-3fef058d-7340-46cb-bb49-73e6efdbee09'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.247116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.249103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1052/2110] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:31 2022] DELETE /identity/v3/projects/b803519f003e4dc09e816ccb3472fd46 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:32.253750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:32.256223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:32.260545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3fef058d-7340-46cb-bb49-73e6efdbee09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972f49dc40404f239e6d6d941c411354', 'request_id': 'req-3fef058d-7340-46cb-bb49-73e6efdbee09'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.287396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3fef058d-7340-46cb-bb49-73e6efdbee09 admin admin] The token cache is being invalidate because project 972f49dc40404f239e6d6d941c411354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:32.294387 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3fef058d-7340-46cb-bb49-73e6efdbee09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.295126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3fef058d-7340-46cb-bb49-73e6efdbee09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.297240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1059/2111] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:32 2022] DELETE /identity/v3/projects/972f49dc40404f239e6d6d941c411354 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:32.299033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb3018-1cd6-4f2e-a7ac-7d2b3469bfc4 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.299481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb3018-1cd6-4f2e-a7ac-7d2b3469bfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.299774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb3018-1cd6-4f2e-a7ac-7d2b3469bfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.333179 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9ecb3018-1cd6-4f2e-a7ac-7d2b3469bfc4 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:32.334918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9ecb3018-1cd6-4f2e-a7ac-7d2b3469bfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:32.358635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4a16-2d71-4152-abd6-ed95f0aff53a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:32.383390 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:32.431328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1060/2112] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:32.433427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397fb36-cf91-44c1-a0b9-760b4d4b6a28 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.433864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397fb36-cf91-44c1-a0b9-760b4d4b6a28 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.434211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397fb36-cf91-44c1-a0b9-760b4d4b6a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.446125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bae43-e873-40ae-ba95-320cd47c2c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:32.446982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bae43-e873-40ae-ba95-320cd47c2c49 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.447317 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bae43-e873-40ae-ba95-320cd47c2c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.447754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bae43-e873-40ae-ba95-320cd47c2c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.452269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ca3bae43-e873-40ae-ba95-320cd47c2c49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:32.456647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b397fb36-cf91-44c1-a0b9-760b4d4b6a28 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:32.457851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b397fb36-cf91-44c1-a0b9-760b4d4b6a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:32.467532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1061/2113] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:32.468109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397fb36-cf91-44c1-a0b9-760b4d4b6a28 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:32.469995 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b397fb36-cf91-44c1-a0b9-760b4d4b6a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:32.482808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397fb36-cf91-44c1-a0b9-760b4d4b6a28 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:32.489225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:32.490105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.490394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.490675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f admin admin] PATH_INFO: `/v3/projects/f982c793383349b58b12ade91da260e6` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.491888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f982c793383349b58b12ade91da260e6)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:32.493822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:32.541594 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bae43-e873-40ae-ba95-320cd47c2c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:32.544241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bae43-e873-40ae-ba95-320cd47c2c49 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:32.555872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1053/2114] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:32.557318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e99ee-eea2-4173-86b8-ff72261eaaf3 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.557585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e99ee-eea2-4173-86b8-ff72261eaaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.557985 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e99ee-eea2-4173-86b8-ff72261eaaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.558228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f982c793383349b58b12ade91da260e6', 'request_id': 'req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.568477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f982c793383349b58b12ade91da260e6', 'request_id': 'req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.578323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f982c793383349b58b12ade91da260e6', 'request_id': 'req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.588148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c81e99ee-eea2-4173-86b8-ff72261eaaf3 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:32.589384 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c81e99ee-eea2-4173-86b8-ff72261eaaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:32.592324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f admin admin] The token cache is being invalidate because project f982c793383349b58b12ade91da260e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:32.592682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.593443 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-191dc7f3-2d90-4792-acb0-b710a0e1bc7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:32.596946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1062/2115] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:32 2022] DELETE /identity/v3/projects/f982c793383349b58b12ade91da260e6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:32.607707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77c9d9-dd1a-4817-8250-846f19e4bf17 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.608043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77c9d9-dd1a-4817-8250-846f19e4bf17 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.608943 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77c9d9-dd1a-4817-8250-846f19e4bf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.634897 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1b77c9d9-dd1a-4817-8250-846f19e4bf17 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:32.636550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1b77c9d9-dd1a-4817-8250-846f19e4bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:32.701648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1054/2116] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:32.703230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747275e-ab51-44f8-96c4-68d8d3039df5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.705365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747275e-ab51-44f8-96c4-68d8d3039df5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.705828 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747275e-ab51-44f8-96c4-68d8d3039df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.712931 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:32.729883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d747275e-ab51-44f8-96c4-68d8d3039df5 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:32.731372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d747275e-ab51-44f8-96c4-68d8d3039df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:32.752890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1063/2117] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:32.756246 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77c9d9-dd1a-4817-8250-846f19e4bf17 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:32.762178 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1055/2118] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:32.763341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747275e-ab51-44f8-96c4-68d8d3039df5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:32.768550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77c9d9-dd1a-4817-8250-846f19e4bf17 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:32.774504 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747275e-ab51-44f8-96c4-68d8d3039df5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:32.780697 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aa522-550c-4d4f-8d30-9cbf67eb4ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:32.781397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa522-550c-4d4f-8d30-9cbf67eb4ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.781828 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa522-550c-4d4f-8d30-9cbf67eb4ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.782303 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa522-550c-4d4f-8d30-9cbf67eb4ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.783227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43aa522-550c-4d4f-8d30-9cbf67eb4ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:32.783553 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43aa522-550c-4d4f-8d30-9cbf67eb4ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:32.784256 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fda996-ac36-4cd8-81d7-86f75b13a4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:32.785244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43aa522-550c-4d4f-8d30-9cbf67eb4ef3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:32.786074 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda996-ac36-4cd8-81d7-86f75b13a4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.787611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda996-ac36-4cd8-81d7-86f75b13a4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.788059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda996-ac36-4cd8-81d7-86f75b13a4f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.788798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fda996-ac36-4cd8-81d7-86f75b13a4f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:32.791508 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fda996-ac36-4cd8-81d7-86f75b13a4f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:32.793552 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fda996-ac36-4cd8-81d7-86f75b13a4f6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:32.800433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1056/2119] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:32.802124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89942502-fbd9-4263-8caf-8d91d875337a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.802124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89942502-fbd9-4263-8caf-8d91d875337a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.802314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89942502-fbd9-4263-8caf-8d91d875337a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.811454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1064/2120] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:32.812256 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fda996-ac36-4cd8-81d7-86f75b13a4f6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:32.826115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fda996-ac36-4cd8-81d7-86f75b13a4f6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:32.827417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-89942502-fbd9-4263-8caf-8d91d875337a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:32.829319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-89942502-fbd9-4263-8caf-8d91d875337a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:32.831701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05ff3f-d5c6-4954-be98-136e215056aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:32.832437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ff3f-d5c6-4954-be98-136e215056aa admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.832796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ff3f-d5c6-4954-be98-136e215056aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.833157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ff3f-d5c6-4954-be98-136e215056aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.833933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05ff3f-d5c6-4954-be98-136e215056aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:32.835921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05ff3f-d5c6-4954-be98-136e215056aa admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:32.840710 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1057/2121] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:32.841596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89942502-fbd9-4263-8caf-8d91d875337a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:32.852616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89942502-fbd9-4263-8caf-8d91d875337a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:32.857588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd082c-aecf-4329-ba14-039ffe3d6821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:32.858222 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd082c-aecf-4329-ba14-039ffe3d6821 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.858501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd082c-aecf-4329-ba14-039ffe3d6821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.858785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd082c-aecf-4329-ba14-039ffe3d6821 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.859518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd082c-aecf-4329-ba14-039ffe3d6821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:32.861812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd082c-aecf-4329-ba14-039ffe3d6821 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:32.867906 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1065/2122] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:32 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:32.868810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05ff3f-d5c6-4954-be98-136e215056aa admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:32.886627 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:32.897964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1058/2123] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:32 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:32.902337 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd082c-aecf-4329-ba14-039ffe3d6821 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:32.958994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05ff3f-d5c6-4954-be98-136e215056aa admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:32.989938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd082c-aecf-4329-ba14-039ffe3d6821 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:32.995012 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b261c-8c9d-43ef-a9cb-4cc947dc7196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:32.995799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b261c-8c9d-43ef-a9cb-4cc947dc7196 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:32.996929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b261c-8c9d-43ef-a9cb-4cc947dc7196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:32.997219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b261c-8c9d-43ef-a9cb-4cc947dc7196 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:32.997922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b261c-8c9d-43ef-a9cb-4cc947dc7196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.000290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b261c-8c9d-43ef-a9cb-4cc947dc7196 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.029060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1059/2124] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:32 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:33.029993 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b261c-8c9d-43ef-a9cb-4cc947dc7196 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.041088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b261c-8c9d-43ef-a9cb-4cc947dc7196 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.046459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda94e4-9094-40df-8be4-354b77821d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.047241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda94e4-9094-40df-8be4-354b77821d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.047921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda94e4-9094-40df-8be4-354b77821d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.048275 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda94e4-9094-40df-8be4-354b77821d02 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.049045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda94e4-9094-40df-8be4-354b77821d02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.051041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda94e4-9094-40df-8be4-354b77821d02 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.051440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1766-f93b-4361-9304-f56e5515780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.052114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1766-f93b-4361-9304-f56e5515780c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.052401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1766-f93b-4361-9304-f56e5515780c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.052682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1766-f93b-4361-9304-f56e5515780c admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.053477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f1766-f93b-4361-9304-f56e5515780c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:33.053785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f1766-f93b-4361-9304-f56e5515780c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.055417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f1766-f93b-4361-9304-f56e5515780c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.069009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1066/2125] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:33.070168 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1766-f93b-4361-9304-f56e5515780c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.074580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1060/2126] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:33 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:33.075397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda94e4-9094-40df-8be4-354b77821d02 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.081003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1766-f93b-4361-9304-f56e5515780c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.084974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda94e4-9094-40df-8be4-354b77821d02 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.085904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d1c20-5845-4c3a-bb90-ca46144569fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.086558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d1c20-5845-4c3a-bb90-ca46144569fc admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.086844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d1c20-5845-4c3a-bb90-ca46144569fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.087119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d1c20-5845-4c3a-bb90-ca46144569fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.087884 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d1c20-5845-4c3a-bb90-ca46144569fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.089481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d1c20-5845-4c3a-bb90-ca46144569fc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.089642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab68745-fe76-4063-b54c-e207dcb8b290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.090276 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab68745-fe76-4063-b54c-e207dcb8b290 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.090565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab68745-fe76-4063-b54c-e207dcb8b290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.090846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab68745-fe76-4063-b54c-e207dcb8b290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.091564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab68745-fe76-4063-b54c-e207dcb8b290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.093445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab68745-fe76-4063-b54c-e207dcb8b290 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.100807 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1067/2127] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:33.101805 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d1c20-5845-4c3a-bb90-ca46144569fc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.114520 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d1c20-5845-4c3a-bb90-ca46144569fc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.120088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda2ec0-f281-44ca-9ae0-223e4cf380e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.120770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda2ec0-f281-44ca-9ae0-223e4cf380e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.121260 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda2ec0-f281-44ca-9ae0-223e4cf380e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.121545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda2ec0-f281-44ca-9ae0-223e4cf380e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.122358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda2ec0-f281-44ca-9ae0-223e4cf380e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.124018 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda2ec0-f281-44ca-9ae0-223e4cf380e5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.131149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1061/2128] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:33 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:33.131149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab68745-fe76-4063-b54c-e207dcb8b290 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.137795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1068/2129] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:33.137795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda2ec0-f281-44ca-9ae0-223e4cf380e5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.146127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda2ec0-f281-44ca-9ae0-223e4cf380e5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.194867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab68745-fe76-4063-b54c-e207dcb8b290 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.199690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d737d8-75f6-4458-bec7-e802fbeb54f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.200285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d737d8-75f6-4458-bec7-e802fbeb54f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.200807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d737d8-75f6-4458-bec7-e802fbeb54f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.201086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d737d8-75f6-4458-bec7-e802fbeb54f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.201807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d737d8-75f6-4458-bec7-e802fbeb54f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.204061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d737d8-75f6-4458-bec7-e802fbeb54f0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.204181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8141862-346d-4c54-a5b3-734b0f75bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.204818 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8141862-346d-4c54-a5b3-734b0f75bc06 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.205100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8141862-346d-4c54-a5b3-734b0f75bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.205505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8141862-346d-4c54-a5b3-734b0f75bc06 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.206308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8141862-346d-4c54-a5b3-734b0f75bc06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.208254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8141862-346d-4c54-a5b3-734b0f75bc06 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.209442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:33.217331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1062/2130] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:33.218380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d737d8-75f6-4458-bec7-e802fbeb54f0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.233236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d737d8-75f6-4458-bec7-e802fbeb54f0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.239298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1069/2131] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:33 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:33.239298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8141862-346d-4c54-a5b3-734b0f75bc06 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.242628 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda8895-0504-4254-8f11-967ac1a2425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.243355 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8895-0504-4254-8f11-967ac1a2425a admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.243633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8895-0504-4254-8f11-967ac1a2425a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.243911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8895-0504-4254-8f11-967ac1a2425a admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.244630 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda8895-0504-4254-8f11-967ac1a2425a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.246296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda8895-0504-4254-8f11-967ac1a2425a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.249327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8141862-346d-4c54-a5b3-734b0f75bc06 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.254088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db409bd9-a361-400e-9ab7-1c89b670e914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.254978 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db409bd9-a361-400e-9ab7-1c89b670e914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.255297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db409bd9-a361-400e-9ab7-1c89b670e914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.255577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db409bd9-a361-400e-9ab7-1c89b670e914 admin admin] PATH_INFO: `/v3/projects/b00a05b54ba74f18b1773f28d01fb02c/users/be198c485fde404095bb2db07a06d5fa/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.257049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1063/2132] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:33.257841 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda8895-0504-4254-8f11-967ac1a2425a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.268743 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda8895-0504-4254-8f11-967ac1a2425a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.274156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18e010-3fca-44ca-8ad2-b0c779ec4086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.274833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18e010-3fca-44ca-8ad2-b0c779ec4086 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.275119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18e010-3fca-44ca-8ad2-b0c779ec4086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.275427 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18e010-3fca-44ca-8ad2-b0c779ec4086 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.275834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db409bd9-a361-400e-9ab7-1c89b670e914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00a05b54ba74f18b1773f28d01fb02c, user_id=be198c485fde404095bb2db07a06d5fa, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.276141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18e010-3fca-44ca-8ad2-b0c779ec4086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.277727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18e010-3fca-44ca-8ad2-b0c779ec4086 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.280817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db409bd9-a361-400e-9ab7-1c89b670e914 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.290811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1064/2133] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:33.291446 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18e010-3fca-44ca-8ad2-b0c779ec4086 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.292392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:33.298717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1070/2134] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:33 2022] PUT /identity/v3/projects/b00a05b54ba74f18b1773f28d01fb02c/users/be198c485fde404095bb2db07a06d5fa/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:33.300572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db409bd9-a361-400e-9ab7-1c89b670e914 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.301545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18e010-3fca-44ca-8ad2-b0c779ec4086 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.366307 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed4981-6ebf-4ece-a4cf-7de785571a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.367222 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed4981-6ebf-4ece-a4cf-7de785571a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.367562 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed4981-6ebf-4ece-a4cf-7de785571a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.367843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed4981-6ebf-4ece-a4cf-7de785571a03 admin admin] PATH_INFO: `/v3/projects/19fe24c464ff46ae943bba272919d451/users/d385c6fe26024adcb64885981bf70f35/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.378610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db409bd9-a361-400e-9ab7-1c89b670e914 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.385008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b4617-530b-4aad-a37b-0f917dfd42e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.385764 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4617-530b-4aad-a37b-0f917dfd42e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.386054 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4617-530b-4aad-a37b-0f917dfd42e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.386327 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed4981-6ebf-4ece-a4cf-7de785571a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fe24c464ff46ae943bba272919d451, user_id=d385c6fe26024adcb64885981bf70f35, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.386427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4617-530b-4aad-a37b-0f917dfd42e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.387060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b4617-530b-4aad-a37b-0f917dfd42e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.388740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b4617-530b-4aad-a37b-0f917dfd42e4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.390656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed4981-6ebf-4ece-a4cf-7de785571a03 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.405170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1071/2135] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:33.405170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd4c3f-bc4e-4240-b5f4-6eecc968290b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.405170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd4c3f-bc4e-4240-b5f4-6eecc968290b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.405170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd4c3f-bc4e-4240-b5f4-6eecc968290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.414636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1065/2136] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:33 2022] PUT /identity/v3/projects/19fe24c464ff46ae943bba272919d451/users/d385c6fe26024adcb64885981bf70f35/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:33.414636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed4981-6ebf-4ece-a4cf-7de785571a03 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.423163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9acd4c3f-bc4e-4240-b5f4-6eecc968290b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:33.424720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9acd4c3f-bc4e-4240-b5f4-6eecc968290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:33.482608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed4981-6ebf-4ece-a4cf-7de785571a03 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.489343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4720a-6b7c-44f1-a779-18eee5ee0dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.490252 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4720a-6b7c-44f1-a779-18eee5ee0dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.490539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4720a-6b7c-44f1-a779-18eee5ee0dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.490819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4720a-6b7c-44f1-a779-18eee5ee0dcc admin admin] PATH_INFO: `/v3/projects/dde49b7293cb4ed7b86a8f0e729201bd/users/37625f8541e548258aaa24f21aeca902/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.497029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1072/2137] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:33.498433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef47ed4-8657-4b6b-9c6b-9dd920a9fbe5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.498778 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef47ed4-8657-4b6b-9c6b-9dd920a9fbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.499058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef47ed4-8657-4b6b-9c6b-9dd920a9fbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.507916 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4720a-6b7c-44f1-a779-18eee5ee0dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde49b7293cb4ed7b86a8f0e729201bd, user_id=37625f8541e548258aaa24f21aeca902, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.511046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4720a-6b7c-44f1-a779-18eee5ee0dcc admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.538556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1066/2138] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:33 2022] PUT /identity/v3/projects/dde49b7293cb4ed7b86a8f0e729201bd/users/37625f8541e548258aaa24f21aeca902/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:33.538556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4720a-6b7c-44f1-a779-18eee5ee0dcc admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.541220 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cba4720a-6b7c-44f1-a779-18eee5ee0dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:33.552783 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bef47ed4-8657-4b6b-9c6b-9dd920a9fbe5 None None] MFA Rules not processed for user `d385c6fe26024adcb64885981bf70f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:33.553959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bef47ed4-8657-4b6b-9c6b-9dd920a9fbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:33.614617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:33.629866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4720a-6b7c-44f1-a779-18eee5ee0dcc admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.634496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c185dfe-68b7-4ab2-aafe-661ec39a8525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.635189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c185dfe-68b7-4ab2-aafe-661ec39a8525 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.635549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c185dfe-68b7-4ab2-aafe-661ec39a8525 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.635827 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c185dfe-68b7-4ab2-aafe-661ec39a8525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.644564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1073/2139] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:33.650286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6880f1e-1d3a-4bc4-98ff-497377be1cde None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.650588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6880f1e-1d3a-4bc4-98ff-497377be1cde None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.650868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6880f1e-1d3a-4bc4-98ff-497377be1cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.679774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e6880f1e-1d3a-4bc4-98ff-497377be1cde None None] MFA Rules not processed for user `37625f8541e548258aaa24f21aeca902`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:33.681395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e6880f1e-1d3a-4bc4-98ff-497377be1cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:33.702222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:33.706643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c185dfe-68b7-4ab2-aafe-661ec39a8525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.708467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c185dfe-68b7-4ab2-aafe-661ec39a8525 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.727326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1067/2140] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:33.729647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c185dfe-68b7-4ab2-aafe-661ec39a8525 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.741658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c185dfe-68b7-4ab2-aafe-661ec39a8525 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.748821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a43300-bab6-47cf-9416-72993df9cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.749682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a43300-bab6-47cf-9416-72993df9cca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.749973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a43300-bab6-47cf-9416-72993df9cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.750310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a43300-bab6-47cf-9416-72993df9cca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.751048 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a43300-bab6-47cf-9416-72993df9cca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.753656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a43300-bab6-47cf-9416-72993df9cca3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:33.772924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1074/2141] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:33.791326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6880f1e-1d3a-4bc4-98ff-497377be1cde None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.795288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e6880f1e-1d3a-4bc4-98ff-497377be1cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:33.817175 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1068/2142] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:33 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:33.818490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a43300-bab6-47cf-9416-72993df9cca3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:33.926445 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6880f1e-1d3a-4bc4-98ff-497377be1cde None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.950983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a43300-bab6-47cf-9416-72993df9cca3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:33.960435 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab786db4-69da-4800-9871-c70b7276ad5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:33.961523 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab786db4-69da-4800-9871-c70b7276ad5e admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:33.961827 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab786db4-69da-4800-9871-c70b7276ad5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:33.962110 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab786db4-69da-4800-9871-c70b7276ad5e admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:33.975092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab786db4-69da-4800-9871-c70b7276ad5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:33.977234 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab786db4-69da-4800-9871-c70b7276ad5e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:34.018144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1069/2143] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:33 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:34.019260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab786db4-69da-4800-9871-c70b7276ad5e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:34.021135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ab786db4-69da-4800-9871-c70b7276ad5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:34.023515 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6326-aa68-4b4f-b839-e634ffd5ead8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:34.024842 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6326-aa68-4b4f-b839-e634ffd5ead8 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:34.025209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6326-aa68-4b4f-b839-e634ffd5ead8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:34.025701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6326-aa68-4b4f-b839-e634ffd5ead8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:34.037620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab786db4-69da-4800-9871-c70b7276ad5e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:34.041760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e33a98-064d-4200-b408-eb0624afae22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:34.042405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e33a98-064d-4200-b408-eb0624afae22 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:34.042688 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e33a98-064d-4200-b408-eb0624afae22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:34.042964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e33a98-064d-4200-b408-eb0624afae22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:34.045714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-67e33a98-064d-4200-b408-eb0624afae22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:34.121650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d6326-aa68-4b4f-b839-e634ffd5ead8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:34.123440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d6326-aa68-4b4f-b839-e634ffd5ead8 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:34.129490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:34.136893 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e33a98-064d-4200-b408-eb0624afae22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:34.136893 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e33a98-064d-4200-b408-eb0624afae22 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:34.140087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1075/2144] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:34.141696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6326-aa68-4b4f-b839-e634ffd5ead8 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:34.168625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1070/2145] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:34.169919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e33a98-064d-4200-b408-eb0624afae22 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:34.180838 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6326-aa68-4b4f-b839-e634ffd5ead8 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:34.195635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e33a98-064d-4200-b408-eb0624afae22 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:34.202804 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bdec7-f1ba-4540-bb4f-35a48c978b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:34.204303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bdec7-f1ba-4540-bb4f-35a48c978b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:34.204440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bdec7-f1ba-4540-bb4f-35a48c978b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:34.204675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bdec7-f1ba-4540-bb4f-35a48c978b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:34.205481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bdec7-f1ba-4540-bb4f-35a48c978b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:34.208652 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ab960-de79-4971-828a-eb9bf7281af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:34.211151 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ab960-de79-4971-828a-eb9bf7281af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:34.211846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ab960-de79-4971-828a-eb9bf7281af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:34.213857 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bdec7-f1ba-4540-bb4f-35a48c978b57 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:34.214233 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ab960-de79-4971-828a-eb9bf7281af3 admin admin] PATH_INFO: `/v3/users/37625f8541e548258aaa24f21aeca902` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:34.216746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ab960-de79-4971-828a-eb9bf7281af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37625f8541e548258aaa24f21aeca902)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:34.223315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ab960-de79-4971-828a-eb9bf7281af3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:34.253172 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1076/2146] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:34.257347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bdec7-f1ba-4540-bb4f-35a48c978b57 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:34.293359 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bdec7-f1ba-4540-bb4f-35a48c978b57 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:34.301220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188f706-c023-45cd-80ec-d992cc2090f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:34.301993 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188f706-c023-45cd-80ec-d992cc2090f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:34.302214 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188f706-c023-45cd-80ec-d992cc2090f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:34.302485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188f706-c023-45cd-80ec-d992cc2090f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:34.303255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188f706-c023-45cd-80ec-d992cc2090f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:34.306383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188f706-c023-45cd-80ec-d992cc2090f2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:34.334844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-914ab960-de79-4971-828a-eb9bf7281af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37625f8541e548258aaa24f21aeca902'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:34.337202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-914ab960-de79-4971-828a-eb9bf7281af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37625f8541e548258aaa24f21aeca902'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:34.338651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1077/2147] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:34.347945 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188f706-c023-45cd-80ec-d992cc2090f2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:34.350225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2188f706-c023-45cd-80ec-d992cc2090f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:34.371624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:34.372294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-914ab960-de79-4971-828a-eb9bf7281af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37625f8541e548258aaa24f21aeca902'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:34.384981 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188f706-c023-45cd-80ec-d992cc2090f2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:34.392303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea17f2-4c6f-42ad-a0e3-b3e6785ab892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:34.392550 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-914ab960-de79-4971-828a-eb9bf7281af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37625f8541e548258aaa24f21aeca902'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:34.393461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea17f2-4c6f-42ad-a0e3-b3e6785ab892 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:34.394154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea17f2-4c6f-42ad-a0e3-b3e6785ab892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:34.394667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea17f2-4c6f-42ad-a0e3-b3e6785ab892 admin admin] PATH_INFO: `/v3/projects/0644fce54f56443ca83547a1eb5e980d/users/5ae372b34853431c810b21ab0ec9d03a/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:34.409296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-914ab960-de79-4971-828a-eb9bf7281af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37625f8541e548258aaa24f21aeca902'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:34.418568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1071/2148] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:34 2022] DELETE /identity/v3/users/37625f8541e548258aaa24f21aeca902 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:34.424540 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806fff-34f4-4c51-ab86-03ee74b25fc0 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:34.425491 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806fff-34f4-4c51-ab86-03ee74b25fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:34.425491 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806fff-34f4-4c51-ab86-03ee74b25fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:34.442723 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea17f2-4c6f-42ad-a0e3-b3e6785ab892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0644fce54f56443ca83547a1eb5e980d, user_id=5ae372b34853431c810b21ab0ec9d03a, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:34.447131 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea17f2-4c6f-42ad-a0e3-b3e6785ab892 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:34.456374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ec806fff-34f4-4c51-ab86-03ee74b25fc0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:34.457812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ec806fff-34f4-4c51-ab86-03ee74b25fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:34.474266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1078/2149] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:34 2022] PUT /identity/v3/projects/0644fce54f56443ca83547a1eb5e980d/users/5ae372b34853431c810b21ab0ec9d03a/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:34.488860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cb391-be36-4b2d-b11d-f5176b08aa56 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:34.489160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cb391-be36-4b2d-b11d-f5176b08aa56 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:34.489478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cb391-be36-4b2d-b11d-f5176b08aa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:34.555910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-533cb391-be36-4b2d-b11d-f5176b08aa56 None None] MFA Rules not processed for user `5ae372b34853431c810b21ab0ec9d03a`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:34.557403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-533cb391-be36-4b2d-b11d-f5176b08aa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:34.653785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1072/2150] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:34.662004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec806fff-34f4-4c51-ab86-03ee74b25fc0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:34.664514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ec806fff-34f4-4c51-ab86-03ee74b25fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:34.737317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1079/2151] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:34.738340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cb391-be36-4b2d-b11d-f5176b08aa56 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:34.740528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec806fff-34f4-4c51-ab86-03ee74b25fc0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:34.767590 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:34.842824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18932fba-a0ba-4fa7-9069-8548b1f73ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:34.843644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932fba-a0ba-4fa7-9069-8548b1f73ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:34.844005 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932fba-a0ba-4fa7-9069-8548b1f73ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:34.844929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932fba-a0ba-4fa7-9069-8548b1f73ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:34.848054 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cb391-be36-4b2d-b11d-f5176b08aa56 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:34.853588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a41068-4bdd-4c75-9695-607bcb10888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:34.854419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a41068-4bdd-4c75-9695-607bcb10888c admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:34.854714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a41068-4bdd-4c75-9695-607bcb10888c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:34.855204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a41068-4bdd-4c75-9695-607bcb10888c admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:34.856170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a41068-4bdd-4c75-9695-607bcb10888c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:34.858054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18932fba-a0ba-4fa7-9069-8548b1f73ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:34.858174 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a41068-4bdd-4c75-9695-607bcb10888c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:34.860377 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18932fba-a0ba-4fa7-9069-8548b1f73ae0 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:34.895909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1073/2152] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:34.902967 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1080/2153] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:34 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:34.904469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18932fba-a0ba-4fa7-9069-8548b1f73ae0 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:34.933895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18932fba-a0ba-4fa7-9069-8548b1f73ae0 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:35.044004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2188b-52f4-4d0e-a417-f9f7cf271090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:35.045168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2188b-52f4-4d0e-a417-f9f7cf271090 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:35.045593 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2188b-52f4-4d0e-a417-f9f7cf271090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:35.045876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2188b-52f4-4d0e-a417-f9f7cf271090 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:35.046706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2188b-52f4-4d0e-a417-f9f7cf271090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:35.050237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2188b-52f4-4d0e-a417-f9f7cf271090 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:35.081027 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1074/2154] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:34 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:35.082565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a41068-4bdd-4c75-9695-607bcb10888c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:35.094694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a41068-4bdd-4c75-9695-607bcb10888c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:35.102559 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e0ae2-1d7e-4ec1-865d-7d4fe46d0d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:35.104277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e0ae2-1d7e-4ec1-865d-7d4fe46d0d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:35.105146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e0ae2-1d7e-4ec1-865d-7d4fe46d0d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:35.105635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e0ae2-1d7e-4ec1-865d-7d4fe46d0d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:35.106638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e0ae2-1d7e-4ec1-865d-7d4fe46d0d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:35.111427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e0ae2-1d7e-4ec1-865d-7d4fe46d0d87 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:35.133524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2188b-52f4-4d0e-a417-f9f7cf271090 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:35.134492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1081/2155] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:35.146156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2188b-52f4-4d0e-a417-f9f7cf271090 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:35.153343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b20c6-e75c-4edb-81ac-dd23bfa7d842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:35.154559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b20c6-e75c-4edb-81ac-dd23bfa7d842 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:35.155066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b20c6-e75c-4edb-81ac-dd23bfa7d842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:35.155525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b20c6-e75c-4edb-81ac-dd23bfa7d842 admin admin] PATH_INFO: `/v3/projects/ae8dc7bd436544249a1a7e78e1bf6373/users/63a3c7ea89e04cb1a537187e9a82d108/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:35.180586 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b20c6-e75c-4edb-81ac-dd23bfa7d842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8dc7bd436544249a1a7e78e1bf6373, user_id=63a3c7ea89e04cb1a537187e9a82d108, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:35.184742 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b20c6-e75c-4edb-81ac-dd23bfa7d842 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:35.208702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1075/2156] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:35 2022] PUT /identity/v3/projects/ae8dc7bd436544249a1a7e78e1bf6373/users/63a3c7ea89e04cb1a537187e9a82d108/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:35.213826 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e0ae2-1d7e-4ec1-865d-7d4fe46d0d87 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:35.227194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e0ae2-1d7e-4ec1-865d-7d4fe46d0d87 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:35.309876 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:35.322439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b20c6-e75c-4edb-81ac-dd23bfa7d842 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:35.324465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a85b20c6-e75c-4edb-81ac-dd23bfa7d842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:35.337147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cd6db-b55c-491d-b990-7381b3dec0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:35.337845 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cd6db-b55c-491d-b990-7381b3dec0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:35.338813 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cd6db-b55c-491d-b990-7381b3dec0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:35.339096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cd6db-b55c-491d-b990-7381b3dec0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:35.340291 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cd6db-b55c-491d-b990-7381b3dec0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:35.343027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cd6db-b55c-491d-b990-7381b3dec0a9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:35.359498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1082/2157] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:35.366117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cd6db-b55c-491d-b990-7381b3dec0a9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:35.385191 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cd6db-b55c-491d-b990-7381b3dec0a9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:35.392446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3a085-549d-410c-94f8-5e601e6177ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:35.393452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3a085-549d-410c-94f8-5e601e6177ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:35.394548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3a085-549d-410c-94f8-5e601e6177ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:35.395634 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3a085-549d-410c-94f8-5e601e6177ec admin admin] PATH_INFO: `/v3/projects/ae8dc7bd436544249a1a7e78e1bf6373/users/63a3c7ea89e04cb1a537187e9a82d108/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:35.399095 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3a085-549d-410c-94f8-5e601e6177ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8dc7bd436544249a1a7e78e1bf6373, user_id=63a3c7ea89e04cb1a537187e9a82d108, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:35.402965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3a085-549d-410c-94f8-5e601e6177ec admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:35.437263 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1083/2158] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:35 2022] PUT /identity/v3/projects/ae8dc7bd436544249a1a7e78e1bf6373/users/63a3c7ea89e04cb1a537187e9a82d108/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:35.448486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc06ab0-4c1e-4483-8708-adfcc86d4d89 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:35.448779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc06ab0-4c1e-4483-8708-adfcc86d4d89 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:35.449164 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc06ab0-4c1e-4483-8708-adfcc86d4d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:35.452689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b20c6-e75c-4edb-81ac-dd23bfa7d842 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:35.483110 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-acc06ab0-4c1e-4483-8708-adfcc86d4d89 None None] MFA Rules not processed for user `63a3c7ea89e04cb1a537187e9a82d108`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:35.484507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-acc06ab0-4c1e-4483-8708-adfcc86d4d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:35.514606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:35.548976 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0af21d-3131-498b-9ff5-9512f3cb1374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:35.550246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0af21d-3131-498b-9ff5-9512f3cb1374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:35.551424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0af21d-3131-498b-9ff5-9512f3cb1374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:35.552029 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0af21d-3131-498b-9ff5-9512f3cb1374 admin admin] PATH_INFO: `/v3/projects/dde49b7293cb4ed7b86a8f0e729201bd` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:35.553899 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0af21d-3131-498b-9ff5-9512f3cb1374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde49b7293cb4ed7b86a8f0e729201bd)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:35.565452 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0af21d-3131-498b-9ff5-9512f3cb1374 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:35.618296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1084/2159] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:35.632686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc06ab0-4c1e-4483-8708-adfcc86d4d89 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:35.635749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-acc06ab0-4c1e-4483-8708-adfcc86d4d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:35.645900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fe0af21d-3131-498b-9ff5-9512f3cb1374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde49b7293cb4ed7b86a8f0e729201bd', 'request_id': 'req-fe0af21d-3131-498b-9ff5-9512f3cb1374'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:35.657876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fe0af21d-3131-498b-9ff5-9512f3cb1374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde49b7293cb4ed7b86a8f0e729201bd', 'request_id': 'req-fe0af21d-3131-498b-9ff5-9512f3cb1374'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:35.669080 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fe0af21d-3131-498b-9ff5-9512f3cb1374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde49b7293cb4ed7b86a8f0e729201bd', 'request_id': 'req-fe0af21d-3131-498b-9ff5-9512f3cb1374'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:35.690054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fe0af21d-3131-498b-9ff5-9512f3cb1374 admin admin] The token cache is being invalidate because project dde49b7293cb4ed7b86a8f0e729201bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:35.690054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fe0af21d-3131-498b-9ff5-9512f3cb1374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:35.690054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fe0af21d-3131-498b-9ff5-9512f3cb1374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:35.694603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1076/2160] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:35 2022] DELETE /identity/v3/projects/dde49b7293cb4ed7b86a8f0e729201bd => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:35.696287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9d8c8-4741-4ff4-bff3-1f7acba992e6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:35.696575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9d8c8-4741-4ff4-bff3-1f7acba992e6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:35.696964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9d8c8-4741-4ff4-bff3-1f7acba992e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:35.722049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-12b9d8c8-4741-4ff4-bff3-1f7acba992e6 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:35.726608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-12b9d8c8-4741-4ff4-bff3-1f7acba992e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:35.749235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc06ab0-4c1e-4483-8708-adfcc86d4d89 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:35.865988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b2799-b8be-4700-9b27-3e6a190e613f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:35.873579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1077/2161] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:35.873790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b2799-b8be-4700-9b27-3e6a190e613f service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:35.873790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b2799-b8be-4700-9b27-3e6a190e613f service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:35.873790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b2799-b8be-4700-9b27-3e6a190e613f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:35.873790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-033b2799-b8be-4700-9b27-3e6a190e613f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:35.876624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeddca-ddae-42e5-a4f6-c9ba870711c3 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:35.877008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeddca-ddae-42e5-a4f6-c9ba870711c3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:35.877291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeddca-ddae-42e5-a4f6-c9ba870711c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:35.919972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-60aeddca-ddae-42e5-a4f6-c9ba870711c3 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:35.921267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-60aeddca-ddae-42e5-a4f6-c9ba870711c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:35.929947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:35.940470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1078/2162] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:35.945732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeddca-ddae-42e5-a4f6-c9ba870711c3 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:35.980462 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeddca-ddae-42e5-a4f6-c9ba870711c3 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:35.988230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5080f8-049f-43dd-a6d2-7c276af9a747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:35.988907 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5080f8-049f-43dd-a6d2-7c276af9a747 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:35.989200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5080f8-049f-43dd-a6d2-7c276af9a747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:35.989520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5080f8-049f-43dd-a6d2-7c276af9a747 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:35.990324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5080f8-049f-43dd-a6d2-7c276af9a747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:35.990827 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5080f8-049f-43dd-a6d2-7c276af9a747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:35.992685 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5080f8-049f-43dd-a6d2-7c276af9a747 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:36.013315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1079/2163] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:42:36.019959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5080f8-049f-43dd-a6d2-7c276af9a747 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:36.029876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5080f8-049f-43dd-a6d2-7c276af9a747 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:36.035939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212523c-2d5c-4242-843b-804b7feaff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:36.036612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212523c-2d5c-4242-843b-804b7feaff19 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:36.037038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212523c-2d5c-4242-843b-804b7feaff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:36.037187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212523c-2d5c-4242-843b-804b7feaff19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:36.038478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212523c-2d5c-4242-843b-804b7feaff19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:36.039251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b2799-b8be-4700-9b27-3e6a190e613f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:36.040654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212523c-2d5c-4242-843b-804b7feaff19 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:36.041632 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b2799-b8be-4700-9b27-3e6a190e613f service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:36.058714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1085/2164] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:36.089098 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1080/2165] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:36 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:36.093711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b2799-b8be-4700-9b27-3e6a190e613f service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:36.173837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b2799-b8be-4700-9b27-3e6a190e613f service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:36.199270 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212523c-2d5c-4242-843b-804b7feaff19 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:36.201081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5212523c-2d5c-4242-843b-804b7feaff19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:36.269994 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:36.313064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212523c-2d5c-4242-843b-804b7feaff19 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:36.316885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f44ef-217c-40e2-8371-c51306af4992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:36.317537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f44ef-217c-40e2-8371-c51306af4992 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:36.321885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f44ef-217c-40e2-8371-c51306af4992 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:36.321885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f44ef-217c-40e2-8371-c51306af4992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:36.324033 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d61f44ef-217c-40e2-8371-c51306af4992 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:36.393437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7797c4-e3e8-428a-9a1c-7a619990f97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:36.394481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7797c4-e3e8-428a-9a1c-7a619990f97a admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:36.394927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7797c4-e3e8-428a-9a1c-7a619990f97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:36.395843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7797c4-e3e8-428a-9a1c-7a619990f97a admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:36.400841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7797c4-e3e8-428a-9a1c-7a619990f97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:36.403018 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7797c4-e3e8-428a-9a1c-7a619990f97a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:36.434326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f44ef-217c-40e2-8371-c51306af4992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:36.436814 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f44ef-217c-40e2-8371-c51306af4992 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:36.447963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1086/2166] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:36 2022] POST /identity/v3/users => generated 287 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:36.451782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7797c4-e3e8-428a-9a1c-7a619990f97a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:36.453095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1081/2167] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:36.467828 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7797c4-e3e8-428a-9a1c-7a619990f97a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:36.474114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7924ed7-5ac0-4c27-b7bc-e252e3391d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:36.475042 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7924ed7-5ac0-4c27-b7bc-e252e3391d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:36.475379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7924ed7-5ac0-4c27-b7bc-e252e3391d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:36.475665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7924ed7-5ac0-4c27-b7bc-e252e3391d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:36.476415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7924ed7-5ac0-4c27-b7bc-e252e3391d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:36.478125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7924ed7-5ac0-4c27-b7bc-e252e3391d26 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:36.497236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1087/2168] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:36.509218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f44ef-217c-40e2-8371-c51306af4992 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:36.524924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f44ef-217c-40e2-8371-c51306af4992 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:36.530603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd11133-fa86-4a40-80d0-802bc8e65328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:36.531330 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11133-fa86-4a40-80d0-802bc8e65328 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:36.531676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11133-fa86-4a40-80d0-802bc8e65328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:36.532449 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11133-fa86-4a40-80d0-802bc8e65328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:36.533187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd11133-fa86-4a40-80d0-802bc8e65328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:36.542378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd11133-fa86-4a40-80d0-802bc8e65328 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:36.557210 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1082/2169] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:36.561433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7924ed7-5ac0-4c27-b7bc-e252e3391d26 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:36.577088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7924ed7-5ac0-4c27-b7bc-e252e3391d26 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:36.590201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6d765-7bdd-4703-a18d-bb05a2f6db69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:36.590201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6d765-7bdd-4703-a18d-bb05a2f6db69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:36.590201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6d765-7bdd-4703-a18d-bb05a2f6db69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:36.590201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6d765-7bdd-4703-a18d-bb05a2f6db69 admin admin] PATH_INFO: `/v3/projects/a0915e259de448fd955e56d6b4041c56/users/7a73f507c9e74c0eac8c8eeecddd5e56/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:36.626732 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6d765-7bdd-4703-a18d-bb05a2f6db69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0915e259de448fd955e56d6b4041c56, user_id=7a73f507c9e74c0eac8c8eeecddd5e56, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:36.629819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6d765-7bdd-4703-a18d-bb05a2f6db69 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:36.649371 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1088/2170] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:36 2022] PUT /identity/v3/projects/a0915e259de448fd955e56d6b4041c56/users/7a73f507c9e74c0eac8c8eeecddd5e56/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:36.661347 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19867e-3ebc-42d1-8d87-c05d31d2e8cc None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:36.661822 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19867e-3ebc-42d1-8d87-c05d31d2e8cc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:36.661917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19867e-3ebc-42d1-8d87-c05d31d2e8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:36.701749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4c19867e-3ebc-42d1-8d87-c05d31d2e8cc None None] MFA Rules not processed for user `7a73f507c9e74c0eac8c8eeecddd5e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:36.702976 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4c19867e-3ebc-42d1-8d87-c05d31d2e8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:36.843926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1083/2171] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:36.864308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6d765-7bdd-4703-a18d-bb05a2f6db69 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:36.937470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6d765-7bdd-4703-a18d-bb05a2f6db69 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:36.943811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c6139-0d7b-4eb4-9c87-2bb0ff1c65b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:36.944639 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c6139-0d7b-4eb4-9c87-2bb0ff1c65b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:36.944928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c6139-0d7b-4eb4-9c87-2bb0ff1c65b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:36.945268 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c6139-0d7b-4eb4-9c87-2bb0ff1c65b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:36.980358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c6139-0d7b-4eb4-9c87-2bb0ff1c65b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:36.981986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c6139-0d7b-4eb4-9c87-2bb0ff1c65b5 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:37.012842 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1089/2172] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:39.267333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863c801-048b-456a-bb70-5808305f3e36 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:39.267948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863c801-048b-456a-bb70-5808305f3e36 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:39.267948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863c801-048b-456a-bb70-5808305f3e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:39.302102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8863c801-048b-456a-bb70-5808305f3e36 None None] MFA Rules not processed for user `be198c485fde404095bb2db07a06d5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:39.303464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8863c801-048b-456a-bb70-5808305f3e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:39.364446 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:39.394623 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1084/2173] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:39.405038 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fddc6b-b44f-4d78-9ebb-f5018e2af633 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:39.405549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fddc6b-b44f-4d78-9ebb-f5018e2af633 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:39.405786 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fddc6b-b44f-4d78-9ebb-f5018e2af633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:39.427606 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-64fddc6b-b44f-4d78-9ebb-f5018e2af633 None None] MFA Rules not processed for user `be198c485fde404095bb2db07a06d5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:39.429070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-64fddc6b-b44f-4d78-9ebb-f5018e2af633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:39.441438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1090/2174] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:39.450313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863c801-048b-456a-bb70-5808305f3e36 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:39.456520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8863c801-048b-456a-bb70-5808305f3e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:39.490601 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fddc6b-b44f-4d78-9ebb-f5018e2af633 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:39.492366 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-64fddc6b-b44f-4d78-9ebb-f5018e2af633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:39.515447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:39.614605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fddc6b-b44f-4d78-9ebb-f5018e2af633 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:39.615424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863c801-048b-456a-bb70-5808305f3e36 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:39.620986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:39.622182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721dc21-91b3-4149-903a-23cd039c1b73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:39.622623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:39.622952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:39.623104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721dc21-91b3-4149-903a-23cd039c1b73 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:39.623528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721dc21-91b3-4149-903a-23cd039c1b73 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:39.623653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] PATH_INFO: `/v3/users/2b53dba8ca6b42728e03282f1a612e18` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:39.623893 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721dc21-91b3-4149-903a-23cd039c1b73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:39.625861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b53dba8ca6b42728e03282f1a612e18)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:39.627990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:39.639719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721dc21-91b3-4149-903a-23cd039c1b73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:39.642009 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721dc21-91b3-4149-903a-23cd039c1b73 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:39.656818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1085/2175] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:39.740232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b53dba8ca6b42728e03282f1a612e18'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:39.759983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b53dba8ca6b42728e03282f1a612e18'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:39.782690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b53dba8ca6b42728e03282f1a612e18'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:39.784028 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b53dba8ca6b42728e03282f1a612e18'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:39.802320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b53dba8ca6b42728e03282f1a612e18'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:39.809114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1091/2176] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:39 2022] DELETE /identity/v3/users/2b53dba8ca6b42728e03282f1a612e18 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:39.815141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579ad1-b3d7-454c-99cd-176ca160e4c4 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:39.815541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579ad1-b3d7-454c-99cd-176ca160e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:39.815892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579ad1-b3d7-454c-99cd-176ca160e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:39.838970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d8579ad1-b3d7-454c-99cd-176ca160e4c4 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:39.840305 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d8579ad1-b3d7-454c-99cd-176ca160e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:39.923150 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1086/2177] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:39.930294 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:39.931852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:40.055346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299eb2a-22c9-4557-aca8-57162475cc7b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:40.060484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8579ad1-b3d7-454c-99cd-176ca160e4c4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:40.062267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d8579ad1-b3d7-454c-99cd-176ca160e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:40.069822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc175d-dcb3-47a3-aa5b-c36ec8543c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:40.070663 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc175d-dcb3-47a3-aa5b-c36ec8543c74 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.071034 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc175d-dcb3-47a3-aa5b-c36ec8543c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.071399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc175d-dcb3-47a3-aa5b-c36ec8543c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.083989 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc175d-dcb3-47a3-aa5b-c36ec8543c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:40.085642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc175d-dcb3-47a3-aa5b-c36ec8543c74 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:40.091905 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8579ad1-b3d7-454c-99cd-176ca160e4c4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:40.099159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1092/2178] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:40.100343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a728e3-5dc3-40e9-b2dc-dc6feedd2d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:40.101639 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a728e3-5dc3-40e9-b2dc-dc6feedd2d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.102179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a728e3-5dc3-40e9-b2dc-dc6feedd2d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.102610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a728e3-5dc3-40e9-b2dc-dc6feedd2d7c admin admin] PATH_INFO: `/v3/users/4bd7c473c28b48129b15e19b30ffe97f` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.104428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a728e3-5dc3-40e9-b2dc-dc6feedd2d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bd7c473c28b48129b15e19b30ffe97f)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:40.107129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a728e3-5dc3-40e9-b2dc-dc6feedd2d7c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:40.140225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc175d-dcb3-47a3-aa5b-c36ec8543c74 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:40.141879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4dbc175d-dcb3-47a3-aa5b-c36ec8543c74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:40.159281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc175d-dcb3-47a3-aa5b-c36ec8543c74 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:40.166502 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f37675-b060-4b42-91a9-0c57b531cd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:40.167702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f37675-b060-4b42-91a9-0c57b531cd65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.168084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f37675-b060-4b42-91a9-0c57b531cd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.168500 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f37675-b060-4b42-91a9-0c57b531cd65 admin admin] PATH_INFO: `/v3/users/d385c6fe26024adcb64885981bf70f35` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.170155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f37675-b060-4b42-91a9-0c57b531cd65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d385c6fe26024adcb64885981bf70f35)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:40.173020 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f37675-b060-4b42-91a9-0c57b531cd65 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:40.207078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-92a728e3-5dc3-40e9-b2dc-dc6feedd2d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bd7c473c28b48129b15e19b30ffe97f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.211699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-92a728e3-5dc3-40e9-b2dc-dc6feedd2d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bd7c473c28b48129b15e19b30ffe97f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.224326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:40.251157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-92a728e3-5dc3-40e9-b2dc-dc6feedd2d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bd7c473c28b48129b15e19b30ffe97f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.268380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-92a728e3-5dc3-40e9-b2dc-dc6feedd2d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bd7c473c28b48129b15e19b30ffe97f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.269930 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:40.271149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-51f37675-b060-4b42-91a9-0c57b531cd65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd385c6fe26024adcb64885981bf70f35'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.285595 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-92a728e3-5dc3-40e9-b2dc-dc6feedd2d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bd7c473c28b48129b15e19b30ffe97f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.286471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-51f37675-b060-4b42-91a9-0c57b531cd65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd385c6fe26024adcb64885981bf70f35'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.308410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1087/2179] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:40 2022] DELETE /identity/v3/users/4bd7c473c28b48129b15e19b30ffe97f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:40.310365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67dee1-bbdf-43b9-acbe-eda7db32009f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.310667 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67dee1-bbdf-43b9-acbe-eda7db32009f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.311005 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67dee1-bbdf-43b9-acbe-eda7db32009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.313006 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-51f37675-b060-4b42-91a9-0c57b531cd65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd385c6fe26024adcb64885981bf70f35'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.315064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-51f37675-b060-4b42-91a9-0c57b531cd65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd385c6fe26024adcb64885981bf70f35'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.338548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ee67dee1-bbdf-43b9-acbe-eda7db32009f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:40.340144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ee67dee1-bbdf-43b9-acbe-eda7db32009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:40.354178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-51f37675-b060-4b42-91a9-0c57b531cd65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd385c6fe26024adcb64885981bf70f35'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.366475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1093/2180] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:40 2022] DELETE /identity/v3/users/d385c6fe26024adcb64885981bf70f35 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:40.371427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3c18-3ef2-4da4-be5f-f581762d1c21 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.371714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3c18-3ef2-4da4-be5f-f581762d1c21 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.372000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3c18-3ef2-4da4-be5f-f581762d1c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.397781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1d6b3c18-3ef2-4da4-be5f-f581762d1c21 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:40.399106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1d6b3c18-3ef2-4da4-be5f-f581762d1c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:40.449531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1088/2181] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:40.461116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67dee1-bbdf-43b9-acbe-eda7db32009f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:40.462713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ee67dee1-bbdf-43b9-acbe-eda7db32009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:40.486595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1094/2182] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:40.496616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b3c18-3ef2-4da4-be5f-f581762d1c21 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:40.498510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1d6b3c18-3ef2-4da4-be5f-f581762d1c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:40.573030 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67dee1-bbdf-43b9-acbe-eda7db32009f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:40.685952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b3c18-3ef2-4da4-be5f-f581762d1c21 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:40.695994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2d01e-a549-453b-b7d4-a133ddec07cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:40.698688 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2d01e-a549-453b-b7d4-a133ddec07cd service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.699196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2d01e-a549-453b-b7d4-a133ddec07cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.700076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2d01e-a549-453b-b7d4-a133ddec07cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.740074 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2d01e-a549-453b-b7d4-a133ddec07cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:40.741536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2d01e-a549-453b-b7d4-a133ddec07cd service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:40.759558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1095/2183] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:40.761251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2d01e-a549-453b-b7d4-a133ddec07cd service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:40.768174 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-09b2d01e-a549-453b-b7d4-a133ddec07cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:40.770551 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcde8f-774e-450b-ba57-9a44daac2175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:40.772620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcde8f-774e-450b-ba57-9a44daac2175 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.773051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcde8f-774e-450b-ba57-9a44daac2175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.773469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcde8f-774e-450b-ba57-9a44daac2175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.799075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcde8f-774e-450b-ba57-9a44daac2175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:40.801850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcde8f-774e-450b-ba57-9a44daac2175 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:40.804334 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2d01e-a549-453b-b7d4-a133ddec07cd service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:40.819332 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fc826-b79a-4b5f-93d7-e3a4507574ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:40.820817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc826-b79a-4b5f-93d7-e3a4507574ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.821349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc826-b79a-4b5f-93d7-e3a4507574ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.822340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc826-b79a-4b5f-93d7-e3a4507574ac admin admin] PATH_INFO: `/v3/projects/ad58d29752594ce28ef6493eddaf1506` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.824835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fc826-b79a-4b5f-93d7-e3a4507574ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad58d29752594ce28ef6493eddaf1506)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:40.827623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fc826-b79a-4b5f-93d7-e3a4507574ac admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:40.831344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1089/2184] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:40.832003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcde8f-774e-450b-ba57-9a44daac2175 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:40.834956 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b0dcde8f-774e-450b-ba57-9a44daac2175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:40.864123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcde8f-774e-450b-ba57-9a44daac2175 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:40.871361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddceb4-5b46-4c93-abe7-34db19bec33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:40.872481 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddceb4-5b46-4c93-abe7-34db19bec33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.872880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddceb4-5b46-4c93-abe7-34db19bec33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.873140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddceb4-5b46-4c93-abe7-34db19bec33d admin admin] PATH_INFO: `/v3/users/7a73f507c9e74c0eac8c8eeecddd5e56` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.874841 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddceb4-5b46-4c93-abe7-34db19bec33d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a73f507c9e74c0eac8c8eeecddd5e56)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:40.879690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddceb4-5b46-4c93-abe7-34db19bec33d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:40.904430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:40.924278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-843fc826-b79a-4b5f-93d7-e3a4507574ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad58d29752594ce28ef6493eddaf1506', 'request_id': 'req-843fc826-b79a-4b5f-93d7-e3a4507574ac'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.941246 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-843fc826-b79a-4b5f-93d7-e3a4507574ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad58d29752594ce28ef6493eddaf1506', 'request_id': 'req-843fc826-b79a-4b5f-93d7-e3a4507574ac'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.951081 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-843fc826-b79a-4b5f-93d7-e3a4507574ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad58d29752594ce28ef6493eddaf1506', 'request_id': 'req-843fc826-b79a-4b5f-93d7-e3a4507574ac'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.970421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-843fc826-b79a-4b5f-93d7-e3a4507574ac admin admin] The token cache is being invalidate because project ad58d29752594ce28ef6493eddaf1506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:40.970848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-843fc826-b79a-4b5f-93d7-e3a4507574ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.971728 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:40.971868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-843fc826-b79a-4b5f-93d7-e3a4507574ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.974389 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1096/2185] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:40 2022] DELETE /identity/v3/projects/ad58d29752594ce28ef6493eddaf1506 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:40.975803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291b0d-b64a-4c2b-9835-2d06aef8868f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:40.976197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291b0d-b64a-4c2b-9835-2d06aef8868f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:40.976851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291b0d-b64a-4c2b-9835-2d06aef8868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:40.978777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cdddceb4-5b46-4c93-abe7-34db19bec33d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a73f507c9e74c0eac8c8eeecddd5e56'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:40.980254 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cdddceb4-5b46-4c93-abe7-34db19bec33d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a73f507c9e74c0eac8c8eeecddd5e56'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:41.006061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cdddceb4-5b46-4c93-abe7-34db19bec33d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a73f507c9e74c0eac8c8eeecddd5e56'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:41.006735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-76291b0d-b64a-4c2b-9835-2d06aef8868f None None] MFA Rules not processed for user `be198c485fde404095bb2db07a06d5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:41.009411 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-76291b0d-b64a-4c2b-9835-2d06aef8868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:41.030431 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cdddceb4-5b46-4c93-abe7-34db19bec33d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a73f507c9e74c0eac8c8eeecddd5e56'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:41.050653 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cdddceb4-5b46-4c93-abe7-34db19bec33d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a73f507c9e74c0eac8c8eeecddd5e56'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:41.057856 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1090/2186] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:40 2022] DELETE /identity/v3/users/7a73f507c9e74c0eac8c8eeecddd5e56 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:41.061049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eca2a-6d5e-4969-8107-9b977b362f44 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.061049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eca2a-6d5e-4969-8107-9b977b362f44 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.061049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eca2a-6d5e-4969-8107-9b977b362f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.090478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8b3eca2a-6d5e-4969-8107-9b977b362f44 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:41.094530 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8b3eca2a-6d5e-4969-8107-9b977b362f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:41.102698 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1097/2187] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:41.104104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe3c0d-4b0b-4048-8bab-19fa32db376b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.104434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe3c0d-4b0b-4048-8bab-19fa32db376b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.104714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe3c0d-4b0b-4048-8bab-19fa32db376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.129557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1ffe3c0d-4b0b-4048-8bab-19fa32db376b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:41.131707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1ffe3c0d-4b0b-4048-8bab-19fa32db376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:41.284672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1098/2188] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:41.292550 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1091/2189] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:41.300932 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bd38b-4280-4c47-8937-7016759a11fe None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.301225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bd38b-4280-4c47-8937-7016759a11fe None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.301527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bd38b-4280-4c47-8937-7016759a11fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.336864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eca2a-6d5e-4969-8107-9b977b362f44 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.336864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8b3eca2a-6d5e-4969-8107-9b977b362f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:41.340425 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6e8bd38b-4280-4c47-8937-7016759a11fe None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:41.345757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6e8bd38b-4280-4c47-8937-7016759a11fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:41.356795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1099/2190] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:41.362736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bd38b-4280-4c47-8937-7016759a11fe None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.374049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bd38b-4280-4c47-8937-7016759a11fe None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.382501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd69751-4a47-4bc6-a3d6-1c6c519e9947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.383538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd69751-4a47-4bc6-a3d6-1c6c519e9947 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.384169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd69751-4a47-4bc6-a3d6-1c6c519e9947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.384623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd69751-4a47-4bc6-a3d6-1c6c519e9947 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.385532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd69751-4a47-4bc6-a3d6-1c6c519e9947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:41.386049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd69751-4a47-4bc6-a3d6-1c6c519e9947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.388073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd69751-4a47-4bc6-a3d6-1c6c519e9947 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.410770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1100/2191] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:41.411994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd69751-4a47-4bc6-a3d6-1c6c519e9947 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.432643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd69751-4a47-4bc6-a3d6-1c6c519e9947 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.443065 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2475c-c703-4ec3-acb8-1ac7d259272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.444217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2475c-c703-4ec3-acb8-1ac7d259272c admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.444654 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2475c-c703-4ec3-acb8-1ac7d259272c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.445081 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2475c-c703-4ec3-acb8-1ac7d259272c admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.445977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2475c-c703-4ec3-acb8-1ac7d259272c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.447952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2475c-c703-4ec3-acb8-1ac7d259272c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.502299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eca2a-6d5e-4969-8107-9b977b362f44 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.508728 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3974907-ebbf-48cf-b235-dd46246b398c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.509797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3974907-ebbf-48cf-b235-dd46246b398c service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.510512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3974907-ebbf-48cf-b235-dd46246b398c service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.511043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3974907-ebbf-48cf-b235-dd46246b398c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.531759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1101/2192] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:41 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:41.533583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2475c-c703-4ec3-acb8-1ac7d259272c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.539545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3974907-ebbf-48cf-b235-dd46246b398c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.543647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3974907-ebbf-48cf-b235-dd46246b398c service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.573922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1092/2193] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:41.575872 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:41.632144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2475c-c703-4ec3-acb8-1ac7d259272c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.661568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4286925-7877-45c2-b89b-944e3d856943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.662583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4286925-7877-45c2-b89b-944e3d856943 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.664459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4286925-7877-45c2-b89b-944e3d856943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.664677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4286925-7877-45c2-b89b-944e3d856943 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.666770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4286925-7877-45c2-b89b-944e3d856943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.674399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4286925-7877-45c2-b89b-944e3d856943 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.729148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1102/2194] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:41 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:41.733413 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3974907-ebbf-48cf-b235-dd46246b398c service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.749008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3974907-ebbf-48cf-b235-dd46246b398c service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.766622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad33af-2bee-4bc9-89fc-cd34071e9bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.767785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad33af-2bee-4bc9-89fc-cd34071e9bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.768181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad33af-2bee-4bc9-89fc-cd34071e9bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.768565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad33af-2bee-4bc9-89fc-cd34071e9bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.769549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad33af-2bee-4bc9-89fc-cd34071e9bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.771579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad33af-2bee-4bc9-89fc-cd34071e9bcd admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.780101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4286925-7877-45c2-b89b-944e3d856943 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.783107 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f4286925-7877-45c2-b89b-944e3d856943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:41.791486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1093/2195] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:41.795881 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad33af-2bee-4bc9-89fc-cd34071e9bcd admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.811902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4286925-7877-45c2-b89b-944e3d856943 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.817999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad33af-2bee-4bc9-89fc-cd34071e9bcd admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.822437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.823436 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.823870 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.824001 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e admin admin] PATH_INFO: `/v3/projects/a2b7103282b349e2a6ff4a6e9f1bb605` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.825836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b7103282b349e2a6ff4a6e9f1bb605)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.827840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.834707 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5cce4-fe8f-462a-8c61-32b860d76270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.835490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5cce4-fe8f-462a-8c61-32b860d76270 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.835787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5cce4-fe8f-462a-8c61-32b860d76270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.836165 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5cce4-fe8f-462a-8c61-32b860d76270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.836802 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5cce4-fe8f-462a-8c61-32b860d76270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.838972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5cce4-fe8f-462a-8c61-32b860d76270 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.856582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1094/2196] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:41.864779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5cce4-fe8f-462a-8c61-32b860d76270 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.891955 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5cce4-fe8f-462a-8c61-32b860d76270 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:41.914939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3006310-de03-4a04-9816-20fc4d425c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:41.916004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3006310-de03-4a04-9816-20fc4d425c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:41.916323 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3006310-de03-4a04-9816-20fc4d425c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:41.916588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3006310-de03-4a04-9816-20fc4d425c53 admin admin] PATH_INFO: `/v3/projects/26cdcfbf4b3e43698a26656b92f61c0a/users/b8ad635d242d4a5d96448bf143a4a4af/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:41.949673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3006310-de03-4a04-9816-20fc4d425c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cdcfbf4b3e43698a26656b92f61c0a, user_id=b8ad635d242d4a5d96448bf143a4a4af, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:41.952791 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3006310-de03-4a04-9816-20fc4d425c53 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:41.977562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b7103282b349e2a6ff4a6e9f1bb605', 'request_id': 'req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:41.985505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1095/2197] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:41 2022] PUT /identity/v3/projects/26cdcfbf4b3e43698a26656b92f61c0a/users/b8ad635d242d4a5d96448bf143a4a4af/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:41.986639 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3006310-de03-4a04-9816-20fc4d425c53 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:41.989707 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b3006310-de03-4a04-9816-20fc4d425c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:41.998676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b7103282b349e2a6ff4a6e9f1bb605', 'request_id': 'req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.012322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b7103282b349e2a6ff4a6e9f1bb605', 'request_id': 'req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.020815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:42.032174 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e admin admin] The token cache is being invalidate because project a2b7103282b349e2a6ff4a6e9f1bb605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:42.032418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.034106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-42c727fe-b7f4-4cea-8c8f-9caa4c43644e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.038289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1103/2198] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:41 2022] DELETE /identity/v3/projects/a2b7103282b349e2a6ff4a6e9f1bb605 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:42.043567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4528f-3cef-46ca-bd19-53bdf23705e8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.043862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4528f-3cef-46ca-bd19-53bdf23705e8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.044291 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4528f-3cef-46ca-bd19-53bdf23705e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.081257 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e5d4528f-3cef-46ca-bd19-53bdf23705e8 None None] MFA Rules not processed for user `b8ad635d242d4a5d96448bf143a4a4af`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:42.082490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e5d4528f-3cef-46ca-bd19-53bdf23705e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:42.089562 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3006310-de03-4a04-9816-20fc4d425c53 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:42.096346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:42.098131 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.098574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.099039 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] PATH_INFO: `/v3/projects/19fe24c464ff46ae943bba272919d451` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.101185 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19fe24c464ff46ae943bba272919d451)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:42.103423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:42.175143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1104/2199] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:42.179919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4528f-3cef-46ca-bd19-53bdf23705e8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:42.181519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e5d4528f-3cef-46ca-bd19-53bdf23705e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:42.192154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19fe24c464ff46ae943bba272919d451', 'request_id': 'req-987787cc-c318-463d-a156-6a64e54f8e25'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.206468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4528f-3cef-46ca-bd19-53bdf23705e8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:42.214371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19fe24c464ff46ae943bba272919d451', 'request_id': 'req-987787cc-c318-463d-a156-6a64e54f8e25'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.232053 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19fe24c464ff46ae943bba272919d451', 'request_id': 'req-987787cc-c318-463d-a156-6a64e54f8e25'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.248719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] The token cache is being invalidate because project 19fe24c464ff46ae943bba272919d451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:42.249254 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.249951 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.255737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1096/2200] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:41 2022] DELETE /identity/v3/projects/19fe24c464ff46ae943bba272919d451 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:42.255737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:42.255737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:42.257025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:42.306002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:42.308197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.308488 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.309273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] PATH_INFO: `/v3/users/6061540c68034c058b36ad48f5a9c44b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.310592 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6061540c68034c058b36ad48f5a9c44b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:42.313255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:42.352402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987787cc-c318-463d-a156-6a64e54f8e25 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:42.361626 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca9e80-0486-4b33-8df5-bec1d94cf307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:42.362707 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca9e80-0486-4b33-8df5-bec1d94cf307 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.363423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca9e80-0486-4b33-8df5-bec1d94cf307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.363927 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca9e80-0486-4b33-8df5-bec1d94cf307 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.365380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca9e80-0486-4b33-8df5-bec1d94cf307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:42.371719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca9e80-0486-4b33-8df5-bec1d94cf307 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:42.379400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6061540c68034c058b36ad48f5a9c44b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.392831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6061540c68034c058b36ad48f5a9c44b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.404135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6061540c68034c058b36ad48f5a9c44b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.405443 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6061540c68034c058b36ad48f5a9c44b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.418534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1097/2201] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:42 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:42.418534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca9e80-0486-4b33-8df5-bec1d94cf307 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:42.422740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ecca9e80-0486-4b33-8df5-bec1d94cf307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:42.428165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6061540c68034c058b36ad48f5a9c44b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.440424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1105/2202] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:42 2022] DELETE /identity/v3/users/6061540c68034c058b36ad48f5a9c44b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:42.444036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:42.445610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:42.496629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:42.552785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2da0ff-5b19-454f-a05e-c14698677700 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:42.561727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:42.562717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.562923 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca9e80-0486-4b33-8df5-bec1d94cf307 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:42.563045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.563635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] PATH_INFO: `/v3/users/5ae372b34853431c810b21ab0ec9d03a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.565881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae372b34853431c810b21ab0ec9d03a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:42.568512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:42.568598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc607e-b18d-4668-964d-35407d0d1333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:42.569454 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc607e-b18d-4668-964d-35407d0d1333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.569766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc607e-b18d-4668-964d-35407d0d1333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.570071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc607e-b18d-4668-964d-35407d0d1333 admin admin] PATH_INFO: `/v3/projects/a0915e259de448fd955e56d6b4041c56` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.572238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc607e-b18d-4668-964d-35407d0d1333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0915e259de448fd955e56d6b4041c56)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:42.574844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc607e-b18d-4668-964d-35407d0d1333 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:42.668054 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae372b34853431c810b21ab0ec9d03a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.678996 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8abc607e-b18d-4668-964d-35407d0d1333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0915e259de448fd955e56d6b4041c56', 'request_id': 'req-8abc607e-b18d-4668-964d-35407d0d1333'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.686807 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae372b34853431c810b21ab0ec9d03a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.689200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:42.699759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae372b34853431c810b21ab0ec9d03a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.701240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae372b34853431c810b21ab0ec9d03a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.714281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8abc607e-b18d-4668-964d-35407d0d1333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0915e259de448fd955e56d6b4041c56', 'request_id': 'req-8abc607e-b18d-4668-964d-35407d0d1333'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.733348 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae372b34853431c810b21ab0ec9d03a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.738153 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8abc607e-b18d-4668-964d-35407d0d1333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0915e259de448fd955e56d6b4041c56', 'request_id': 'req-8abc607e-b18d-4668-964d-35407d0d1333'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.743815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1106/2203] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:42 2022] DELETE /identity/v3/users/5ae372b34853431c810b21ab0ec9d03a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:42.744418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:42.747529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:42.776365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8abc607e-b18d-4668-964d-35407d0d1333 admin admin] The token cache is being invalidate because project a0915e259de448fd955e56d6b4041c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:42.776618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8abc607e-b18d-4668-964d-35407d0d1333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.778417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8abc607e-b18d-4668-964d-35407d0d1333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:42.782606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1098/2204] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:42 2022] DELETE /identity/v3/projects/a0915e259de448fd955e56d6b4041c56 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:42.789816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4d18d-ceea-47ef-be01-1e7a34e80fb6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.790113 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4d18d-ceea-47ef-be01-1e7a34e80fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.790876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4d18d-ceea-47ef-be01-1e7a34e80fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.826525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-88a4d18d-ceea-47ef-be01-1e7a34e80fb6 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:42.828447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-88a4d18d-ceea-47ef-be01-1e7a34e80fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:42.894017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15455f44-7dd9-4752-9ae0-26597924c2db admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:42.901862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4616ad-538c-4b91-9c6f-c7e55767d5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:42.903786 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4616ad-538c-4b91-9c6f-c7e55767d5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:42.904292 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4616ad-538c-4b91-9c6f-c7e55767d5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:42.904745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4616ad-538c-4b91-9c6f-c7e55767d5a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:42.905599 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4616ad-538c-4b91-9c6f-c7e55767d5a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:42.910485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4616ad-538c-4b91-9c6f-c7e55767d5a6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:42.967386 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1107/2205] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:42 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:42.970574 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4616ad-538c-4b91-9c6f-c7e55767d5a6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:42.977265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ad4616ad-538c-4b91-9c6f-c7e55767d5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:43.003910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4616ad-538c-4b91-9c6f-c7e55767d5a6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:43.014255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd1399-4ca6-48f2-acc9-9ae59ff74fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:43.018134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd1399-4ca6-48f2-acc9-9ae59ff74fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.018622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd1399-4ca6-48f2-acc9-9ae59ff74fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.019611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd1399-4ca6-48f2-acc9-9ae59ff74fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.021439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd1399-4ca6-48f2-acc9-9ae59ff74fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:43.024262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd1399-4ca6-48f2-acc9-9ae59ff74fd5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:43.026607 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1099/2206] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:43.028394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4d18d-ceea-47ef-be01-1e7a34e80fb6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:43.032966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-88a4d18d-ceea-47ef-be01-1e7a34e80fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:43.043710 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1108/2207] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:43.056603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5cf45-5522-4038-861d-9349c6cdc87c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.058339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5cf45-5522-4038-861d-9349c6cdc87c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.058759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5cf45-5522-4038-861d-9349c6cdc87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.065290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4d18d-ceea-47ef-be01-1e7a34e80fb6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:43.077969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:43.080577 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.080577 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.080577 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] PATH_INFO: `/v3/projects/c63ff77f731a405d869bfffe9cbe10cd` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.086636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63ff77f731a405d869bfffe9cbe10cd)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:43.088721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:43.103880 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d9e5cf45-5522-4038-861d-9349c6cdc87c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:43.107698 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d9e5cf45-5522-4038-861d-9349c6cdc87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:43.137865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1109/2208] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:43.140351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5cf45-5522-4038-861d-9349c6cdc87c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:43.168357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5cf45-5522-4038-861d-9349c6cdc87c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:43.190522 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207505a5-af79-4fa8-a575-15bd8ce6a967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:43.193298 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207505a5-af79-4fa8-a575-15bd8ce6a967 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.194157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207505a5-af79-4fa8-a575-15bd8ce6a967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.195325 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207505a5-af79-4fa8-a575-15bd8ce6a967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.196241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207505a5-af79-4fa8-a575-15bd8ce6a967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:43.201215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207505a5-af79-4fa8-a575-15bd8ce6a967 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:43.224997 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63ff77f731a405d869bfffe9cbe10cd', 'request_id': 'req-d383b50f-d49f-44c3-9b1d-7079058680eb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.233660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1110/2209] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:43.237227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207505a5-af79-4fa8-a575-15bd8ce6a967 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:43.249633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63ff77f731a405d869bfffe9cbe10cd', 'request_id': 'req-d383b50f-d49f-44c3-9b1d-7079058680eb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.257099 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:43.273522 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207505a5-af79-4fa8-a575-15bd8ce6a967 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:43.276918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63ff77f731a405d869bfffe9cbe10cd', 'request_id': 'req-d383b50f-d49f-44c3-9b1d-7079058680eb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.309173 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] The token cache is being invalidate because project c63ff77f731a405d869bfffe9cbe10cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:43.310724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.314437 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:43.324160 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1100/2210] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:43 2022] DELETE /identity/v3/projects/c63ff77f731a405d869bfffe9cbe10cd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:43.325164 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:43.327722 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:43.438259 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af40535-284c-46f8-b327-b6ea94fe630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:43.438949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af40535-284c-46f8-b327-b6ea94fe630f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.441027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af40535-284c-46f8-b327-b6ea94fe630f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.441323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af40535-284c-46f8-b327-b6ea94fe630f admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.442323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af40535-284c-46f8-b327-b6ea94fe630f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:43.442641 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af40535-284c-46f8-b327-b6ea94fe630f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:43.447238 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af40535-284c-46f8-b327-b6ea94fe630f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:43.475227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1111/2211] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:43.481416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f0ac-188a-464e-b93b-b406c57a4474 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.481755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f0ac-188a-464e-b93b-b406c57a4474 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.482323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f0ac-188a-464e-b93b-b406c57a4474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.517550 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b50f-d49f-44c3-9b1d-7079058680eb admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:43.532491 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e826f0ac-188a-464e-b93b-b406c57a4474 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:43.533753 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e826f0ac-188a-464e-b93b-b406c57a4474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:43.533936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b0446-e53d-4fb6-8f90-4395704fe30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:43.535115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0446-e53d-4fb6-8f90-4395704fe30d admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.535612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0446-e53d-4fb6-8f90-4395704fe30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.535936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0446-e53d-4fb6-8f90-4395704fe30d admin admin] PATH_INFO: `/v3/projects/fe7305c6f1884bf1ba24dbb2d16b87c3/users/c5b83991da304a888f957528f3e59cd9/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.551320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1112/2212] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:43.552281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f0ac-188a-464e-b93b-b406c57a4474 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:43.553599 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e826f0ac-188a-464e-b93b-b406c57a4474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:43.577173 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f0ac-188a-464e-b93b-b406c57a4474 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:43.577945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b0446-e53d-4fb6-8f90-4395704fe30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7305c6f1884bf1ba24dbb2d16b87c3, user_id=c5b83991da304a888f957528f3e59cd9, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:43.583184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b0446-e53d-4fb6-8f90-4395704fe30d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:43.608807 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4649e-6a79-4574-aa6f-afe8359dd7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:43.609523 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4649e-6a79-4574-aa6f-afe8359dd7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.614116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1101/2213] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:43 2022] PUT /identity/v3/projects/fe7305c6f1884bf1ba24dbb2d16b87c3/users/c5b83991da304a888f957528f3e59cd9/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:43.615640 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a2d41-93e8-4171-a7db-a99d3d9ca816 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.615939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a2d41-93e8-4171-a7db-a99d3d9ca816 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.616424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4649e-6a79-4574-aa6f-afe8359dd7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.616790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4649e-6a79-4574-aa6f-afe8359dd7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.617532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4649e-6a79-4574-aa6f-afe8359dd7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:43.618602 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a2d41-93e8-4171-a7db-a99d3d9ca816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.621269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4649e-6a79-4574-aa6f-afe8359dd7d9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:43.653000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d81a2d41-93e8-4171-a7db-a99d3d9ca816 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:43.656854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d81a2d41-93e8-4171-a7db-a99d3d9ca816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:43.670472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:43.685754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1113/2214] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:43 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:43.687357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af493-d7b4-4810-b43f-3ebc6e80976a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:43.688118 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af493-d7b4-4810-b43f-3ebc6e80976a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:43.688549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af493-d7b4-4810-b43f-3ebc6e80976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:43.760447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d60af493-d7b4-4810-b43f-3ebc6e80976a None None] MFA Rules not processed for user `c5b83991da304a888f957528f3e59cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:43.761797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d60af493-d7b4-4810-b43f-3ebc6e80976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:43.856868 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1102/2215] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:43.857626 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a2d41-93e8-4171-a7db-a99d3d9ca816 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:43.860786 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d81a2d41-93e8-4171-a7db-a99d3d9ca816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:43.881864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a2d41-93e8-4171-a7db-a99d3d9ca816 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:43.900461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1114/2216] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:43.902382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af493-d7b4-4810-b43f-3ebc6e80976a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.003966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.005239 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.005668 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.006093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] PATH_INFO: `/v3/projects/0644fce54f56443ca83547a1eb5e980d` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.007720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0644fce54f56443ca83547a1eb5e980d)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.010309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.028383 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:44.048786 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af493-d7b4-4810-b43f-3ebc6e80976a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.058328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf0b55-03a0-4e26-8cb9-07c167d57bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.059200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf0b55-03a0-4e26-8cb9-07c167d57bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.060652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf0b55-03a0-4e26-8cb9-07c167d57bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.061029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf0b55-03a0-4e26-8cb9-07c167d57bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.061909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf0b55-03a0-4e26-8cb9-07c167d57bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.065492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf0b55-03a0-4e26-8cb9-07c167d57bc5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.102950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1115/2217] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:43 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:44.104080 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf0b55-03a0-4e26-8cb9-07c167d57bc5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.116120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf0b55-03a0-4e26-8cb9-07c167d57bc5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.124871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cdf34-5aba-4711-81aa-d6e083f6e07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.126508 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cdf34-5aba-4711-81aa-d6e083f6e07d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.126651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cdf34-5aba-4711-81aa-d6e083f6e07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.126935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cdf34-5aba-4711-81aa-d6e083f6e07d admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.128139 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cdf34-5aba-4711-81aa-d6e083f6e07d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:44.129392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cdf34-5aba-4711-81aa-d6e083f6e07d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.132064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cdf34-5aba-4711-81aa-d6e083f6e07d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.150814 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0644fce54f56443ca83547a1eb5e980d', 'request_id': 'req-61f8bf0d-a58b-402b-996f-d01f4f42b838'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.159252 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0644fce54f56443ca83547a1eb5e980d', 'request_id': 'req-61f8bf0d-a58b-402b-996f-d01f4f42b838'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.167142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0644fce54f56443ca83547a1eb5e980d', 'request_id': 'req-61f8bf0d-a58b-402b-996f-d01f4f42b838'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.176508 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1116/2218] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:44.177245 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cdf34-5aba-4711-81aa-d6e083f6e07d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.184026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] The token cache is being invalidate because project 0644fce54f56443ca83547a1eb5e980d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:44.184322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.186436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.186995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1103/2219] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:43 2022] DELETE /identity/v3/projects/0644fce54f56443ca83547a1eb5e980d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:44.188566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.191309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:44.200953 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cdf34-5aba-4711-81aa-d6e083f6e07d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.291775 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8bf0d-a58b-402b-996f-d01f4f42b838 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.298047 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21354-a7e3-4cd8-b4a9-32ee4b6f077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.299554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21354-a7e3-4cd8-b4a9-32ee4b6f077f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.299840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21354-a7e3-4cd8-b4a9-32ee4b6f077f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.300118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21354-a7e3-4cd8-b4a9-32ee4b6f077f admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.301010 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f21354-a7e3-4cd8-b4a9-32ee4b6f077f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.302835 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f21354-a7e3-4cd8-b4a9-32ee4b6f077f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.329222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deb400-e1ea-41cd-af32-a8e500c1fab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.330837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deb400-e1ea-41cd-af32-a8e500c1fab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.331146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deb400-e1ea-41cd-af32-a8e500c1fab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.331615 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deb400-e1ea-41cd-af32-a8e500c1fab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.332728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99deb400-e1ea-41cd-af32-a8e500c1fab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.335031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99deb400-e1ea-41cd-af32-a8e500c1fab5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.335507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1104/2220] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:44.336571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21354-a7e3-4cd8-b4a9-32ee4b6f077f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.340263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-09f21354-a7e3-4cd8-b4a9-32ee4b6f077f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:44.349171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:44.373992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21354-a7e3-4cd8-b4a9-32ee4b6f077f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.380087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1117/2221] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:44 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:44.381065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbd3d6-28b9-457a-8ba1-c63a55111472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.381393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deb400-e1ea-41cd-af32-a8e500c1fab5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.382205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbd3d6-28b9-457a-8ba1-c63a55111472 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.382718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbd3d6-28b9-457a-8ba1-c63a55111472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.383233 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbd3d6-28b9-457a-8ba1-c63a55111472 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.384302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbd3d6-28b9-457a-8ba1-c63a55111472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.387111 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbd3d6-28b9-457a-8ba1-c63a55111472 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.389516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-99deb400-e1ea-41cd-af32-a8e500c1fab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:44.442544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1105/2222] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:44 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:44.442544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbd3d6-28b9-457a-8ba1-c63a55111472 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.541350 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deb400-e1ea-41cd-af32-a8e500c1fab5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.608080 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbd3d6-28b9-457a-8ba1-c63a55111472 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.624507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cde68-34b0-4890-a5ae-2c8ae4e38b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.625358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cde68-34b0-4890-a5ae-2c8ae4e38b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.625645 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cde68-34b0-4890-a5ae-2c8ae4e38b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.626344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cde68-34b0-4890-a5ae-2c8ae4e38b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.627297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cde68-34b0-4890-a5ae-2c8ae4e38b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.629098 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cde68-34b0-4890-a5ae-2c8ae4e38b12 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.646145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1106/2223] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:44.648328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cde68-34b0-4890-a5ae-2c8ae4e38b12 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.650412 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4b3cde68-34b0-4890-a5ae-2c8ae4e38b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:44.669396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cde68-34b0-4890-a5ae-2c8ae4e38b12 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.681042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d7c81-b5a8-430e-b3fd-86b79a34d88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.682366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7c81-b5a8-430e-b3fd-86b79a34d88c admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.682892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7c81-b5a8-430e-b3fd-86b79a34d88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.683493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7c81-b5a8-430e-b3fd-86b79a34d88c admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.684774 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d7c81-b5a8-430e-b3fd-86b79a34d88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.687611 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d7c81-b5a8-430e-b3fd-86b79a34d88c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.698545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:44.717155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.718692 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.726823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1107/2224] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:44 2022] POST /identity/v3/users => generated 299 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:44.727554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.727832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d7c81-b5a8-430e-b3fd-86b79a34d88c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.728487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] PATH_INFO: `/v3/users/63a3c7ea89e04cb1a537187e9a82d108` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.731618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a3c7ea89e04cb1a537187e9a82d108)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.733849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.749497 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d7c81-b5a8-430e-b3fd-86b79a34d88c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.756310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add36974-c1b6-4b1d-aa39-9d276ac63ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.756974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add36974-c1b6-4b1d-aa39-9d276ac63ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.757859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add36974-c1b6-4b1d-aa39-9d276ac63ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.758141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add36974-c1b6-4b1d-aa39-9d276ac63ac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.758848 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add36974-c1b6-4b1d-aa39-9d276ac63ac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.764447 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add36974-c1b6-4b1d-aa39-9d276ac63ac9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.838053 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1108/2225] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:44 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:44.838946 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add36974-c1b6-4b1d-aa39-9d276ac63ac9 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.856015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a3c7ea89e04cb1a537187e9a82d108'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.872260 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add36974-c1b6-4b1d-aa39-9d276ac63ac9 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:44.884959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a3c7ea89e04cb1a537187e9a82d108'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.885896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d7c9a-fe04-405a-9814-7d3ef6d8d77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:44.892900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d7c9a-fe04-405a-9814-7d3ef6d8d77a admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:44.893656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d7c9a-fe04-405a-9814-7d3ef6d8d77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:44.893959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d7c9a-fe04-405a-9814-7d3ef6d8d77a admin admin] PATH_INFO: `/v3/projects/3f4952355c424ca3b1c0433d06b0673b/users/9944667e98934d41aa374f4837ade695/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:44.896594 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a3c7ea89e04cb1a537187e9a82d108'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.897787 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a3c7ea89e04cb1a537187e9a82d108'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.930901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a3c7ea89e04cb1a537187e9a82d108'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:44.947247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1118/2226] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:44 2022] DELETE /identity/v3/users/63a3c7ea89e04cb1a537187e9a82d108 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:44.949548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:44.951301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d7c9a-fe04-405a-9814-7d3ef6d8d77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4952355c424ca3b1c0433d06b0673b, user_id=9944667e98934d41aa374f4837ade695, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:44.956978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d7c9a-fe04-405a-9814-7d3ef6d8d77a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:44.957293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:45.001100 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1109/2227] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:44 2022] PUT /identity/v3/projects/3f4952355c424ca3b1c0433d06b0673b/users/9944667e98934d41aa374f4837ade695/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:45.002154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d7c9a-fe04-405a-9814-7d3ef6d8d77a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:45.006831 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ef9d7c9a-fe04-405a-9814-7d3ef6d8d77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:45.028809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:45.150019 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e1677-916e-4af0-940c-2734c1104cfc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:45.158728 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d7c9a-fe04-405a-9814-7d3ef6d8d77a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:45.161776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaaa816-0dc4-40ec-9b21-0778a0feaed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:45.162481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaa816-0dc4-40ec-9b21-0778a0feaed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.162770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaa816-0dc4-40ec-9b21-0778a0feaed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.163054 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaa816-0dc4-40ec-9b21-0778a0feaed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.166889 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaaa816-0dc4-40ec-9b21-0778a0feaed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:45.175054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044d9b8-b9b3-470c-a8c3-73235140f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:45.175782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044d9b8-b9b3-470c-a8c3-73235140f4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.176067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044d9b8-b9b3-470c-a8c3-73235140f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.176345 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044d9b8-b9b3-470c-a8c3-73235140f4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.176915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaaa816-0dc4-40ec-9b21-0778a0feaed9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:45.187248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044d9b8-b9b3-470c-a8c3-73235140f4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:45.193031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044d9b8-b9b3-470c-a8c3-73235140f4e6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:45.207962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1119/2228] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:45.209373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324526d9-552e-4e2b-868d-98573053b592 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.209671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324526d9-552e-4e2b-868d-98573053b592 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.209960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324526d9-552e-4e2b-868d-98573053b592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.238243 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1110/2229] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:45.241216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044d9b8-b9b3-470c-a8c3-73235140f4e6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:45.256341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-324526d9-552e-4e2b-868d-98573053b592 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:45.257620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-324526d9-552e-4e2b-868d-98573053b592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:45.282707 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044d9b8-b9b3-470c-a8c3-73235140f4e6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:45.283161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1120/2230] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:45.295021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324526d9-552e-4e2b-868d-98573053b592 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:45.295705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed7d50-cecc-4641-b87c-b8a6357f5540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:45.298571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed7d50-cecc-4641-b87c-b8a6357f5540 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.299065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed7d50-cecc-4641-b87c-b8a6357f5540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.299622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed7d50-cecc-4641-b87c-b8a6357f5540 admin admin] PATH_INFO: `/v3/projects/53d19004b6b347e7ad3ae8b4420181b1/users/fa525d959f634a1dbfc1d5e738f2ae97/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.323602 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed7d50-cecc-4641-b87c-b8a6357f5540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d19004b6b347e7ad3ae8b4420181b1, user_id=fa525d959f634a1dbfc1d5e738f2ae97, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:45.324485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324526d9-552e-4e2b-868d-98573053b592 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:45.327358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed7d50-cecc-4641-b87c-b8a6357f5540 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:45.339454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b7841-1728-42f5-9381-506d9eeeda11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:45.340161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7841-1728-42f5-9381-506d9eeeda11 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.340451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7841-1728-42f5-9381-506d9eeeda11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.340826 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7841-1728-42f5-9381-506d9eeeda11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.341581 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b7841-1728-42f5-9381-506d9eeeda11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:45.343373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b7841-1728-42f5-9381-506d9eeeda11 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:45.361441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1111/2231] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:45 2022] PUT /identity/v3/projects/53d19004b6b347e7ad3ae8b4420181b1/users/fa525d959f634a1dbfc1d5e738f2ae97/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:45.361441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed7d50-cecc-4641-b87c-b8a6357f5540 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:45.367374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-11ed7d50-cecc-4641-b87c-b8a6357f5540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:45.377498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1121/2232] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:45.379360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b7841-1728-42f5-9381-506d9eeeda11 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:45.408043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b7841-1728-42f5-9381-506d9eeeda11 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:45.521770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed7d50-cecc-4641-b87c-b8a6357f5540 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:45.531101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f1deb-a6b2-4198-978e-e77e3278d4ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:45.532833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f1deb-a6b2-4198-978e-e77e3278d4ca service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.533191 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f1deb-a6b2-4198-978e-e77e3278d4ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.533594 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f1deb-a6b2-4198-978e-e77e3278d4ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.567468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494232f0-756a-4eef-ac00-984550fc5558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:45.568166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494232f0-756a-4eef-ac00-984550fc5558 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.568488 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494232f0-756a-4eef-ac00-984550fc5558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.568722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494232f0-756a-4eef-ac00-984550fc5558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.569457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494232f0-756a-4eef-ac00-984550fc5558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:45.571083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494232f0-756a-4eef-ac00-984550fc5558 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:45.608329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1122/2233] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:45.609178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494232f0-756a-4eef-ac00-984550fc5558 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:45.632720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494232f0-756a-4eef-ac00-984550fc5558 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:45.647728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f46c9d-2ecf-4d38-ab11-7d235a618728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:45.648651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f46c9d-2ecf-4d38-ab11-7d235a618728 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.648942 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f46c9d-2ecf-4d38-ab11-7d235a618728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.649341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f46c9d-2ecf-4d38-ab11-7d235a618728 admin admin] PATH_INFO: `/v3/projects/5cd904b4315a479a83d3a38b46519764/users/20391809bbeb425e9cac6f73640ae022/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.657290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:45.680751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f46c9d-2ecf-4d38-ab11-7d235a618728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd904b4315a479a83d3a38b46519764, user_id=20391809bbeb425e9cac6f73640ae022, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:45.683932 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f46c9d-2ecf-4d38-ab11-7d235a618728 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:45.717621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1123/2234] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:45 2022] PUT /identity/v3/projects/5cd904b4315a479a83d3a38b46519764/users/20391809bbeb425e9cac6f73640ae022/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:45.720470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f46c9d-2ecf-4d38-ab11-7d235a618728 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:45.729959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f1deb-a6b2-4198-978e-e77e3278d4ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:45.732217 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f1deb-a6b2-4198-978e-e77e3278d4ca service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:45.757205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1112/2235] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:45.758560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de910a-a2ad-49ef-a909-65ddcf1e5527 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.758823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de910a-a2ad-49ef-a909-65ddcf1e5527 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.759077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de910a-a2ad-49ef-a909-65ddcf1e5527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.803762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-45de910a-a2ad-49ef-a909-65ddcf1e5527 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:45.805094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-45de910a-a2ad-49ef-a909-65ddcf1e5527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:45.877653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f46c9d-2ecf-4d38-ab11-7d235a618728 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:45.891510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f031911-12b2-41d9-bc99-c54de21735a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:45.892471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f031911-12b2-41d9-bc99-c54de21735a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.892830 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f031911-12b2-41d9-bc99-c54de21735a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.893188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f031911-12b2-41d9-bc99-c54de21735a0 admin admin] PATH_INFO: `/v3/projects/53d19004b6b347e7ad3ae8b4420181b1/users/fa525d959f634a1dbfc1d5e738f2ae97/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:45.895994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f031911-12b2-41d9-bc99-c54de21735a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d19004b6b347e7ad3ae8b4420181b1, user_id=fa525d959f634a1dbfc1d5e738f2ae97, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:45.900352 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f031911-12b2-41d9-bc99-c54de21735a0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:45.911783 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:45.951357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1124/2236] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:45 2022] PUT /identity/v3/projects/53d19004b6b347e7ad3ae8b4420181b1/users/fa525d959f634a1dbfc1d5e738f2ae97/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:45.951357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498ad7b-3a61-4988-8efc-ba0c38c3728d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:45.951357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498ad7b-3a61-4988-8efc-ba0c38c3728d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:45.951638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498ad7b-3a61-4988-8efc-ba0c38c3728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:46.002673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e498ad7b-3a61-4988-8efc-ba0c38c3728d None None] MFA Rules not processed for user `fa525d959f634a1dbfc1d5e738f2ae97`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:46.004200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e498ad7b-3a61-4988-8efc-ba0c38c3728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:46.025395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1113/2237] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:46.094601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de910a-a2ad-49ef-a909-65ddcf1e5527 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:46.211959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1125/2238] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:46.236495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498ad7b-3a61-4988-8efc-ba0c38c3728d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:46.241947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e498ad7b-3a61-4988-8efc-ba0c38c3728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:46.296788 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de910a-a2ad-49ef-a909-65ddcf1e5527 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:46.401781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498ad7b-3a61-4988-8efc-ba0c38c3728d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:46.412049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfae48-5df3-4979-9c6f-f9d32f97ec46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:46.413628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfae48-5df3-4979-9c6f-f9d32f97ec46 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:46.413920 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfae48-5df3-4979-9c6f-f9d32f97ec46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:46.414200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfae48-5df3-4979-9c6f-f9d32f97ec46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:46.417918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fddfae48-5df3-4979-9c6f-f9d32f97ec46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:46.430567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fad24-8dd7-4056-a7da-4e96d638db20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:46.438097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fad24-8dd7-4056-a7da-4e96d638db20 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:46.438462 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fad24-8dd7-4056-a7da-4e96d638db20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:46.441502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fad24-8dd7-4056-a7da-4e96d638db20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:46.574710 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfae48-5df3-4979-9c6f-f9d32f97ec46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:46.576365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfae48-5df3-4979-9c6f-f9d32f97ec46 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:46.576503 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:46.601977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1126/2239] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:46.602801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfae48-5df3-4979-9c6f-f9d32f97ec46 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:46.605403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fddfae48-5df3-4979-9c6f-f9d32f97ec46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:46.621588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fad24-8dd7-4056-a7da-4e96d638db20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:46.625846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fad24-8dd7-4056-a7da-4e96d638db20 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:46.634691 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfae48-5df3-4979-9c6f-f9d32f97ec46 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:46.639279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:46.640368 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:46.641103 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:46.641469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e admin admin] PATH_INFO: `/v3/projects/ae8dc7bd436544249a1a7e78e1bf6373` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:46.642905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae8dc7bd436544249a1a7e78e1bf6373)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:46.645424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:46.657530 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1114/2240] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:46.702321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:46.725064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae8dc7bd436544249a1a7e78e1bf6373', 'request_id': 'req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.738905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae8dc7bd436544249a1a7e78e1bf6373', 'request_id': 'req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.753968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae8dc7bd436544249a1a7e78e1bf6373', 'request_id': 'req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.773153 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e admin admin] The token cache is being invalidate because project ae8dc7bd436544249a1a7e78e1bf6373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:46.773548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.774329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3ec60147-06e7-4cf1-98fc-ce2a156a0d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:46.779347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1127/2241] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:46 2022] DELETE /identity/v3/projects/ae8dc7bd436544249a1a7e78e1bf6373 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:46.788465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bcff4-9da3-4e94-a244-0fe21c978755 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:46.789019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bcff4-9da3-4e94-a244-0fe21c978755 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:46.789437 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bcff4-9da3-4e94-a244-0fe21c978755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:46.846605 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-358bcff4-9da3-4e94-a244-0fe21c978755 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:46.851324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-358bcff4-9da3-4e94-a244-0fe21c978755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:46.987947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f53fc-5032-4b0e-a7fb-6e731db351c8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:46.988430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f53fc-5032-4b0e-a7fb-6e731db351c8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:46.988802 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f53fc-5032-4b0e-a7fb-6e731db351c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:46.991287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1115/2242] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:47.018675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5f2f53fc-5032-4b0e-a7fb-6e731db351c8 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:47.019956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5f2f53fc-5032-4b0e-a7fb-6e731db351c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:47.034724 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1128/2243] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:47.039364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bcff4-9da3-4e94-a244-0fe21c978755 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.055810 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bcff4-9da3-4e94-a244-0fe21c978755 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.068733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af3815-7a78-4ca7-b0c4-df6fb491cac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.069475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af3815-7a78-4ca7-b0c4-df6fb491cac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.069738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af3815-7a78-4ca7-b0c4-df6fb491cac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.070043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af3815-7a78-4ca7-b0c4-df6fb491cac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.070706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af3815-7a78-4ca7-b0c4-df6fb491cac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:47.071026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af3815-7a78-4ca7-b0c4-df6fb491cac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.074276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f53fc-5032-4b0e-a7fb-6e731db351c8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.076377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5f2f53fc-5032-4b0e-a7fb-6e731db351c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:47.090477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af3815-7a78-4ca7-b0c4-df6fb491cac4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.111794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f53fc-5032-4b0e-a7fb-6e731db351c8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.148044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b80db8-ed51-4dae-83e4-2a284d39f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.148044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b80db8-ed51-4dae-83e4-2a284d39f1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.148044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b80db8-ed51-4dae-83e4-2a284d39f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.148044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b80db8-ed51-4dae-83e4-2a284d39f1fa admin admin] PATH_INFO: `/v3/users/95888f930f9b4b8aa3b81c905a207a0a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.148381 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1116/2244] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:47.148381 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af3815-7a78-4ca7-b0c4-df6fb491cac4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.152769 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b80db8-ed51-4dae-83e4-2a284d39f1fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=95888f930f9b4b8aa3b81c905a207a0a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.161656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b80db8-ed51-4dae-83e4-2a284d39f1fa admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.196493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af3815-7a78-4ca7-b0c4-df6fb491cac4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.220110 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1b75-6085-49a4-adf0-993fe0da97e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.220986 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1b75-6085-49a4-adf0-993fe0da97e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.221283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1b75-6085-49a4-adf0-993fe0da97e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.221566 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1b75-6085-49a4-adf0-993fe0da97e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.222395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e1b75-6085-49a4-adf0-993fe0da97e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.251488 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e1b75-6085-49a4-adf0-993fe0da97e8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.325755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-39b80db8-ed51-4dae-83e4-2a284d39f1fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95888f930f9b4b8aa3b81c905a207a0a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:47.331754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1117/2245] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:47 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:47.336036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1b75-6085-49a4-adf0-993fe0da97e8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.347839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-39b80db8-ed51-4dae-83e4-2a284d39f1fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95888f930f9b4b8aa3b81c905a207a0a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:47.364859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-39b80db8-ed51-4dae-83e4-2a284d39f1fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95888f930f9b4b8aa3b81c905a207a0a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:47.365718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-39b80db8-ed51-4dae-83e4-2a284d39f1fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95888f930f9b4b8aa3b81c905a207a0a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:47.402622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-39b80db8-ed51-4dae-83e4-2a284d39f1fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95888f930f9b4b8aa3b81c905a207a0a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:47.417963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1129/2246] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:47 2022] DELETE /identity/v3/users/95888f930f9b4b8aa3b81c905a207a0a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:47.422618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a26bbd-2f32-4d6f-a2b3-33cb47e84e0c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.423100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a26bbd-2f32-4d6f-a2b3-33cb47e84e0c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.423445 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a26bbd-2f32-4d6f-a2b3-33cb47e84e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.431025 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1b75-6085-49a4-adf0-993fe0da97e8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.471500 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-37a26bbd-2f32-4d6f-a2b3-33cb47e84e0c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:47.473161 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-37a26bbd-2f32-4d6f-a2b3-33cb47e84e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:47.494813 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:47.506651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115dc63-5bcf-476d-9003-e77b4f6e2a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.507856 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115dc63-5bcf-476d-9003-e77b4f6e2a97 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.508360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115dc63-5bcf-476d-9003-e77b4f6e2a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.508842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115dc63-5bcf-476d-9003-e77b4f6e2a97 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.509923 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115dc63-5bcf-476d-9003-e77b4f6e2a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.513281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115dc63-5bcf-476d-9003-e77b4f6e2a97 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.541964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1118/2247] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:47 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:47.545380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115dc63-5bcf-476d-9003-e77b4f6e2a97 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.549341 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7115dc63-5bcf-476d-9003-e77b4f6e2a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:47.561640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1130/2248] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:47.563777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115dc63-5bcf-476d-9003-e77b4f6e2a97 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.569660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324b4f6-2570-4327-b57a-974d00148943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.570884 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324b4f6-2570-4327-b57a-974d00148943 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.571018 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324b4f6-2570-4327-b57a-974d00148943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.571339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324b4f6-2570-4327-b57a-974d00148943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.572152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324b4f6-2570-4327-b57a-974d00148943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.573525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a26bbd-2f32-4d6f-a2b3-33cb47e84e0c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.574624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324b4f6-2570-4327-b57a-974d00148943 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.575621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-37a26bbd-2f32-4d6f-a2b3-33cb47e84e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:47.590079 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1119/2249] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:47.593796 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324b4f6-2570-4327-b57a-974d00148943 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.625239 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324b4f6-2570-4327-b57a-974d00148943 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.631374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f1b05-4341-4b4f-a6fe-62448e3d36b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.632325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f1b05-4341-4b4f-a6fe-62448e3d36b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.632669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f1b05-4341-4b4f-a6fe-62448e3d36b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.632957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f1b05-4341-4b4f-a6fe-62448e3d36b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.633752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f1b05-4341-4b4f-a6fe-62448e3d36b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.635510 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f1b05-4341-4b4f-a6fe-62448e3d36b1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.651090 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:47.659086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1120/2250] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:47.660156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f1b05-4341-4b4f-a6fe-62448e3d36b1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.674613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f1b05-4341-4b4f-a6fe-62448e3d36b1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.680606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c43107-6ca1-4ca6-93b3-47cda2f910bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.681512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c43107-6ca1-4ca6-93b3-47cda2f910bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.681803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c43107-6ca1-4ca6-93b3-47cda2f910bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.682148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c43107-6ca1-4ca6-93b3-47cda2f910bb admin admin] PATH_INFO: `/v3/projects/20e0876bf4a64ed3928d0b00497a9fe4/users/f10bec0adffe4c43a99e4fa15f11a268/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.691853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a26bbd-2f32-4d6f-a2b3-33cb47e84e0c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:47.698092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ff1d6-4aae-475d-a94c-552a1a2c9cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:47.698916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff1d6-4aae-475d-a94c-552a1a2c9cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.699402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff1d6-4aae-475d-a94c-552a1a2c9cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.699996 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff1d6-4aae-475d-a94c-552a1a2c9cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.707302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c43107-6ca1-4ca6-93b3-47cda2f910bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e0876bf4a64ed3928d0b00497a9fe4, user_id=f10bec0adffe4c43a99e4fa15f11a268, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.710811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c43107-6ca1-4ca6-93b3-47cda2f910bb admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.713799 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ff1d6-4aae-475d-a94c-552a1a2c9cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:47.716481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ff1d6-4aae-475d-a94c-552a1a2c9cf5 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:47.741235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1131/2252] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:47.742883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1121/2252] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:47 2022] PUT /identity/v3/projects/20e0876bf4a64ed3928d0b00497a9fe4/users/f10bec0adffe4c43a99e4fa15f11a268/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:47.745002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e11862-3e54-4768-958d-c27632ae6251 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:47.746109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e11862-3e54-4768-958d-c27632ae6251 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:47.746621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e11862-3e54-4768-958d-c27632ae6251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:47.780730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-47e11862-3e54-4768-958d-c27632ae6251 None None] MFA Rules not processed for user `f10bec0adffe4c43a99e4fa15f11a268`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:47.783349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-47e11862-3e54-4768-958d-c27632ae6251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:47.907312 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1132/2253] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:47.916025 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c43107-6ca1-4ca6-93b3-47cda2f910bb admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:47.919212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-36c43107-6ca1-4ca6-93b3-47cda2f910bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:48.058816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c43107-6ca1-4ca6-93b3-47cda2f910bb admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:48.063663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a73a17-7b43-4a9a-8985-045cd9fcd89b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:48.064328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a73a17-7b43-4a9a-8985-045cd9fcd89b service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:48.064613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a73a17-7b43-4a9a-8985-045cd9fcd89b service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:48.064891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a73a17-7b43-4a9a-8985-045cd9fcd89b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:48.074543 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a73a17-7b43-4a9a-8985-045cd9fcd89b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:48.076179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a73a17-7b43-4a9a-8985-045cd9fcd89b service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:48.100866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1122/2254] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:48.136172 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e11862-3e54-4768-958d-c27632ae6251 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:48.242088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e11862-3e54-4768-958d-c27632ae6251 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:48.251204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:48.252436 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:48.252863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:48.253280 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] PATH_INFO: `/v3/users/f10bec0adffe4c43a99e4fa15f11a268` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:48.254930 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f10bec0adffe4c43a99e4fa15f11a268)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:48.258040 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:48.339362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10bec0adffe4c43a99e4fa15f11a268'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.353746 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10bec0adffe4c43a99e4fa15f11a268'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.365562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10bec0adffe4c43a99e4fa15f11a268'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.366799 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10bec0adffe4c43a99e4fa15f11a268'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.369087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:48.392313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10bec0adffe4c43a99e4fa15f11a268'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.403307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1133/2255] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:48 2022] DELETE /identity/v3/users/f10bec0adffe4c43a99e4fa15f11a268 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:48.408045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123314c9-392c-4680-b991-e8c93abd59fc None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:48.408337 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123314c9-392c-4680-b991-e8c93abd59fc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:48.408615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123314c9-392c-4680-b991-e8c93abd59fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:48.451436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-123314c9-392c-4680-b991-e8c93abd59fc None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:48.456264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-123314c9-392c-4680-b991-e8c93abd59fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:48.494814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:48.497150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:48.596704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1123/2256] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:48.617306 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123314c9-392c-4680-b991-e8c93abd59fc None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:48.619601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-123314c9-392c-4680-b991-e8c93abd59fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:48.649603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734df438-995d-48a9-b797-59fdb65f4a5c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:48.655600 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:48.656526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:48.656809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:48.657089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] PATH_INFO: `/v3/projects/0ce933817afb43d09e65d15a8ae3bf1a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:48.658335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce933817afb43d09e65d15a8ae3bf1a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:48.660828 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:48.723112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:48.746736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce933817afb43d09e65d15a8ae3bf1a', 'request_id': 'req-fc7244d4-fb73-4503-a186-7be64a3953dd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.755714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123314c9-392c-4680-b991-e8c93abd59fc None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:48.763575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce933817afb43d09e65d15a8ae3bf1a', 'request_id': 'req-fc7244d4-fb73-4503-a186-7be64a3953dd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.785467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce933817afb43d09e65d15a8ae3bf1a', 'request_id': 'req-fc7244d4-fb73-4503-a186-7be64a3953dd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.838669 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] The token cache is being invalidate because project 0ce933817afb43d09e65d15a8ae3bf1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:48.842615 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.845017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:48.846928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1134/2257] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:48 2022] DELETE /identity/v3/projects/0ce933817afb43d09e65d15a8ae3bf1a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:48.847841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:48.854531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:48.913098 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf50a9-c122-48d6-93c7-5f86eabdb5c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:48.914269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf50a9-c122-48d6-93c7-5f86eabdb5c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:48.914747 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf50a9-c122-48d6-93c7-5f86eabdb5c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:48.915404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf50a9-c122-48d6-93c7-5f86eabdb5c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:48.917545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a9cf50a9-c122-48d6-93c7-5f86eabdb5c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:48.999671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7244d4-fb73-4503-a186-7be64a3953dd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.014800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccce3a-8c15-45b7-a68e-6716b41e01ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.015530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccce3a-8c15-45b7-a68e-6716b41e01ea service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.016242 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccce3a-8c15-45b7-a68e-6716b41e01ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.016242 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccce3a-8c15-45b7-a68e-6716b41e01ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.020196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ffccce3a-8c15-45b7-a68e-6716b41e01ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:49.041498 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf50a9-c122-48d6-93c7-5f86eabdb5c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.045434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf50a9-c122-48d6-93c7-5f86eabdb5c5 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.064965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1124/2258] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:49.066766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88839e8d-db24-49c9-8af3-1e612eff49a4 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.067288 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88839e8d-db24-49c9-8af3-1e612eff49a4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.067802 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88839e8d-db24-49c9-8af3-1e612eff49a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.085144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:49.095491 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-88839e8d-db24-49c9-8af3-1e612eff49a4 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:49.097830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-88839e8d-db24-49c9-8af3-1e612eff49a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:49.195791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccce3a-8c15-45b7-a68e-6716b41e01ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.197894 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccce3a-8c15-45b7-a68e-6716b41e01ea service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.215102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1125/2259] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:49.215102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195bb87-9b2f-4bad-b901-35803f90abb5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.215102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195bb87-9b2f-4bad-b901-35803f90abb5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.215102 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195bb87-9b2f-4bad-b901-35803f90abb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.224063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1135/2260] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:49.225592 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a1d52-fa56-48e6-929f-76d202c3195a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.225888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a1d52-fa56-48e6-929f-76d202c3195a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.226164 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a1d52-fa56-48e6-929f-76d202c3195a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.250515 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e195bb87-9b2f-4bad-b901-35803f90abb5 None None] MFA Rules not processed for user `20391809bbeb425e9cac6f73640ae022`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:49.252360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e195bb87-9b2f-4bad-b901-35803f90abb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:49.263645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0d2a1d52-fa56-48e6-929f-76d202c3195a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:49.264985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0d2a1d52-fa56-48e6-929f-76d202c3195a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:49.292487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1136/2261] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:49.297450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a1d52-fa56-48e6-929f-76d202c3195a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:49.312849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a1d52-fa56-48e6-929f-76d202c3195a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.326873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:49.334383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1302f-80f3-4ff9-b8c8-707352c44adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.334727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1302f-80f3-4ff9-b8c8-707352c44adc admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.335160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1302f-80f3-4ff9-b8c8-707352c44adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.335300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1302f-80f3-4ff9-b8c8-707352c44adc admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.335968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1302f-80f3-4ff9-b8c8-707352c44adc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:49.336285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1302f-80f3-4ff9-b8c8-707352c44adc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.338424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1302f-80f3-4ff9-b8c8-707352c44adc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.369568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1137/2262] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:42:49.374732 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1302f-80f3-4ff9-b8c8-707352c44adc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:49.381119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1126/2263] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:49.394803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1302f-80f3-4ff9-b8c8-707352c44adc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.401861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195bb87-9b2f-4bad-b901-35803f90abb5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:49.403925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e195bb87-9b2f-4bad-b901-35803f90abb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:49.410697 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acec18b-f8c5-40a4-a06d-1f8a9f446aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.410697 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acec18b-f8c5-40a4-a06d-1f8a9f446aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.411008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acec18b-f8c5-40a4-a06d-1f8a9f446aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.411267 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acec18b-f8c5-40a4-a06d-1f8a9f446aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.411882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acec18b-f8c5-40a4-a06d-1f8a9f446aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.414065 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acec18b-f8c5-40a4-a06d-1f8a9f446aa0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.426235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195bb87-9b2f-4bad-b901-35803f90abb5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.434121 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb0a18-610d-4406-8487-01d3b5fe7508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.434915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb0a18-610d-4406-8487-01d3b5fe7508 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.435044 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb0a18-610d-4406-8487-01d3b5fe7508 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.435343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb0a18-610d-4406-8487-01d3b5fe7508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.456309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb0a18-610d-4406-8487-01d3b5fe7508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.458664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb0a18-610d-4406-8487-01d3b5fe7508 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.492849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1138/2264] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:49 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:42:49.497625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acec18b-f8c5-40a4-a06d-1f8a9f446aa0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:49.498429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1127/2265] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:49.649361 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acec18b-f8c5-40a4-a06d-1f8a9f446aa0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.659834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d4d00-1d36-4ee4-8f47-b886fe78a48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.660955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d4d00-1d36-4ee4-8f47-b886fe78a48f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.663269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d4d00-1d36-4ee4-8f47-b886fe78a48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.664854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d4d00-1d36-4ee4-8f47-b886fe78a48f admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.668132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d4d00-1d36-4ee4-8f47-b886fe78a48f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.674519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d4d00-1d36-4ee4-8f47-b886fe78a48f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.715818 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1139/2266] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:49 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:42:49.720195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb0a18-610d-4406-8487-01d3b5fe7508 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:49.736721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb0a18-610d-4406-8487-01d3b5fe7508 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.750689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4085e-dc02-4cb7-b016-500037ff1b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.751480 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4085e-dc02-4cb7-b016-500037ff1b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.751768 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4085e-dc02-4cb7-b016-500037ff1b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.752048 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4085e-dc02-4cb7-b016-500037ff1b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.752775 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4085e-dc02-4cb7-b016-500037ff1b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.760440 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4085e-dc02-4cb7-b016-500037ff1b4a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.791932 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1128/2267] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:49.793737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d4d00-1d36-4ee4-8f47-b886fe78a48f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:49.813015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d4d00-1d36-4ee4-8f47-b886fe78a48f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.821748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236612b-fd03-4885-af3a-f745950ba171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.822889 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236612b-fd03-4885-af3a-f745950ba171 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.823277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236612b-fd03-4885-af3a-f745950ba171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.823564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236612b-fd03-4885-af3a-f745950ba171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.824275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236612b-fd03-4885-af3a-f745950ba171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.826004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236612b-fd03-4885-af3a-f745950ba171 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.848931 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4085e-dc02-4cb7-b016-500037ff1b4a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:49.851201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-eca4085e-dc02-4cb7-b016-500037ff1b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:49.855110 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1140/2268] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:42:49.857699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236612b-fd03-4885-af3a-f745950ba171 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:49.877001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4085e-dc02-4cb7-b016-500037ff1b4a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.888816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.891681 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.895022 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.896087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7 admin admin] PATH_INFO: `/v3/projects/20e0876bf4a64ed3928d0b00497a9fe4` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.897852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e0876bf4a64ed3928d0b00497a9fe4)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.901125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236612b-fd03-4885-af3a-f745950ba171 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:49.901507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:49.916650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20266e40-867c-48f1-8a4d-f5e6b976f5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:49.918591 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20266e40-867c-48f1-8a4d-f5e6b976f5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:49.918890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20266e40-867c-48f1-8a4d-f5e6b976f5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:49.919272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20266e40-867c-48f1-8a4d-f5e6b976f5ec admin admin] PATH_INFO: `/v3/projects/115b31c0aa7640dda3f0b835fce580e9/users/26860d953585434d9bcb5c0460491bce/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:49.980287 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20266e40-867c-48f1-8a4d-f5e6b976f5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=115b31c0aa7640dda3f0b835fce580e9, user_id=26860d953585434d9bcb5c0460491bce, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:49.993825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20266e40-867c-48f1-8a4d-f5e6b976f5ec admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:50.037737 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1141/2269] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:49 2022] PUT /identity/v3/projects/115b31c0aa7640dda3f0b835fce580e9/users/26860d953585434d9bcb5c0460491bce/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:50.049193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19761ef5-e3fe-48dc-9706-32e4a890e005 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:50.049850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19761ef5-e3fe-48dc-9706-32e4a890e005 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:50.050383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19761ef5-e3fe-48dc-9706-32e4a890e005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:50.081316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e0876bf4a64ed3928d0b00497a9fe4', 'request_id': 'req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:50.118206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e0876bf4a64ed3928d0b00497a9fe4', 'request_id': 'req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:50.140529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e0876bf4a64ed3928d0b00497a9fe4', 'request_id': 'req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:50.153468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-19761ef5-e3fe-48dc-9706-32e4a890e005 None None] MFA Rules not processed for user `26860d953585434d9bcb5c0460491bce`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:50.154717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-19761ef5-e3fe-48dc-9706-32e4a890e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:50.174603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7 admin admin] The token cache is being invalidate because project 20e0876bf4a64ed3928d0b00497a9fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:50.174915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:50.176818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c3f8558d-d6f3-4726-a72c-ff359d1cf0c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:50.189724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1129/2270] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:49 2022] DELETE /identity/v3/projects/20e0876bf4a64ed3928d0b00497a9fe4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:50.193411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd129214-eabf-4065-b13c-20564a756b27 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:50.193771 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd129214-eabf-4065-b13c-20564a756b27 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:50.194157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd129214-eabf-4065-b13c-20564a756b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:50.224637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:50.226103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fd129214-eabf-4065-b13c-20564a756b27 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:50.228156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fd129214-eabf-4065-b13c-20564a756b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:50.319063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1142/2271] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:50.336651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19761ef5-e3fe-48dc-9706-32e4a890e005 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:50.338537 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-19761ef5-e3fe-48dc-9706-32e4a890e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:50.374331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1130/2272] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:50.376632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c5005-10e5-48a4-b9d3-1937f7031302 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:50.377187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c5005-10e5-48a4-b9d3-1937f7031302 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:50.378052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c5005-10e5-48a4-b9d3-1937f7031302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:50.456731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a33c5005-10e5-48a4-b9d3-1937f7031302 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:50.457725 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a33c5005-10e5-48a4-b9d3-1937f7031302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:50.472672 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1131/2273] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:50.473368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c5005-10e5-48a4-b9d3-1937f7031302 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:50.476689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a33c5005-10e5-48a4-b9d3-1937f7031302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:50.497834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19761ef5-e3fe-48dc-9706-32e4a890e005 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:50.501762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc9f0e-7060-4d19-90be-e2bc476a2bf8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f892e618b01a46aaaab4f79aa0c3daa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:50.502427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9f0e-7060-4d19-90be-e2bc476a2bf8 service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:50.502715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9f0e-7060-4d19-90be-e2bc476a2bf8 service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:50.502995 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9f0e-7060-4d19-90be-e2bc476a2bf8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:50.513011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc9f0e-7060-4d19-90be-e2bc476a2bf8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:50.515310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc9f0e-7060-4d19-90be-e2bc476a2bf8 service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:50.527900 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1143/2274] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:42:50.528863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc9f0e-7060-4d19-90be-e2bc476a2bf8 service glance] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:50.530013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:50.550169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc9f0e-7060-4d19-90be-e2bc476a2bf8 service glance] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:50.563036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781dca8-b43d-44f3-97f5-e6bebb9e5072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:50.564583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781dca8-b43d-44f3-97f5-e6bebb9e5072 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:50.565088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781dca8-b43d-44f3-97f5-e6bebb9e5072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:50.565609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781dca8-b43d-44f3-97f5-e6bebb9e5072 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:50.566448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781dca8-b43d-44f3-97f5-e6bebb9e5072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:42:50.567350 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781dca8-b43d-44f3-97f5-e6bebb9e5072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:50.568048 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c5005-10e5-48a4-b9d3-1937f7031302 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:50.569833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781dca8-b43d-44f3-97f5-e6bebb9e5072 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:50.573240 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24f866-8f41-4a9a-ac09-1a84718bb535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:50.573972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24f866-8f41-4a9a-ac09-1a84718bb535 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:50.574872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24f866-8f41-4a9a-ac09-1a84718bb535 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:50.575254 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24f866-8f41-4a9a-ac09-1a84718bb535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:50.577844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8b24f866-8f41-4a9a-ac09-1a84718bb535 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:50.605539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1144/2275] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:42:50.610526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781dca8-b43d-44f3-97f5-e6bebb9e5072 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:50.622866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781dca8-b43d-44f3-97f5-e6bebb9e5072 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:50.634545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2d5c0-3894-4408-8fb9-317bdcca4dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:50.644309 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2d5c0-3894-4408-8fb9-317bdcca4dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:50.644748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2d5c0-3894-4408-8fb9-317bdcca4dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:50.645142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2d5c0-3894-4408-8fb9-317bdcca4dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:50.646302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2d5c0-3894-4408-8fb9-317bdcca4dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:50.648308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2d5c0-3894-4408-8fb9-317bdcca4dd8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:50.701334 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1145/2276] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:50 2022] POST /identity/v3/projects => generated 361 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:50.702458 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2d5c0-3894-4408-8fb9-317bdcca4dd8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:50.720433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24f866-8f41-4a9a-ac09-1a84718bb535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:50.721959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24f866-8f41-4a9a-ac09-1a84718bb535 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:50.736063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1132/2277] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:50.806987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2d5c0-3894-4408-8fb9-317bdcca4dd8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:50.815490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65105195-a57b-4d4c-8c14-c77755854d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:50.816193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65105195-a57b-4d4c-8c14-c77755854d41 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:50.816485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65105195-a57b-4d4c-8c14-c77755854d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:50.816775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65105195-a57b-4d4c-8c14-c77755854d41 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:50.817658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65105195-a57b-4d4c-8c14-c77755854d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:50.821625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65105195-a57b-4d4c-8c14-c77755854d41 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:50.869512 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1146/2278] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:50 2022] POST /identity/v3/users => generated 281 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:50.873648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24f866-8f41-4a9a-ac09-1a84718bb535 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:50.889818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24f866-8f41-4a9a-ac09-1a84718bb535 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:50.908775 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934ebbc-5367-4efb-b3ba-225c02c5182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:50.909448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934ebbc-5367-4efb-b3ba-225c02c5182e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:50.909829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934ebbc-5367-4efb-b3ba-225c02c5182e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:50.910233 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934ebbc-5367-4efb-b3ba-225c02c5182e admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:50.911014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934ebbc-5367-4efb-b3ba-225c02c5182e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:50.912652 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934ebbc-5367-4efb-b3ba-225c02c5182e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:50.930735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1133/2279] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:42:50.932267 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65105195-a57b-4d4c-8c14-c77755854d41 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:50.946716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65105195-a57b-4d4c-8c14-c77755854d41 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:50.955492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7e799-c1a2-4a71-ab2c-9494bdc247ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:50.956651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7e799-c1a2-4a71-ab2c-9494bdc247ca admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:50.957035 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7e799-c1a2-4a71-ab2c-9494bdc247ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:50.957632 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7e799-c1a2-4a71-ab2c-9494bdc247ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:50.959647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7e799-c1a2-4a71-ab2c-9494bdc247ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:50.962308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7e799-c1a2-4a71-ab2c-9494bdc247ca admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:50.992105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1147/2280] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:50.997588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934ebbc-5367-4efb-b3ba-225c02c5182e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:51.013535 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934ebbc-5367-4efb-b3ba-225c02c5182e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:51.025063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769a4d0-e18f-4cb3-b771-21b80fabbc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:51.026107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a4d0-e18f-4cb3-b771-21b80fabbc9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:51.026784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a4d0-e18f-4cb3-b771-21b80fabbc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:51.027459 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a4d0-e18f-4cb3-b771-21b80fabbc9f admin admin] PATH_INFO: `/v3/projects/345d194ad47142a2815f1a819a262fd3/users/5ec116ad41e84bb19cc8941cd7458d5d/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:51.057214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769a4d0-e18f-4cb3-b771-21b80fabbc9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=345d194ad47142a2815f1a819a262fd3, user_id=5ec116ad41e84bb19cc8941cd7458d5d, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:51.061578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769a4d0-e18f-4cb3-b771-21b80fabbc9f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:51.099076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e728d06-63ca-476e-aa4d-91ec15acc51c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:51.099744 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e728d06-63ca-476e-aa4d-91ec15acc51c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:51.100590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e728d06-63ca-476e-aa4d-91ec15acc51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:51.102057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1134/2281] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:50 2022] PUT /identity/v3/projects/345d194ad47142a2815f1a819a262fd3/users/5ec116ad41e84bb19cc8941cd7458d5d/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:51.124206 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:51.137606 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7e728d06-63ca-476e-aa4d-91ec15acc51c None None] MFA Rules not processed for user `5ec116ad41e84bb19cc8941cd7458d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:51.139469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7e728d06-63ca-476e-aa4d-91ec15acc51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:51.389336 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cfbd0-7325-42c5-b5d0-ed7edfbe152e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:51.389642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cfbd0-7325-42c5-b5d0-ed7edfbe152e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:51.389943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cfbd0-7325-42c5-b5d0-ed7edfbe152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:51.426387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ee3cfbd0-7325-42c5-b5d0-ed7edfbe152e None None] MFA Rules not processed for user `20391809bbeb425e9cac6f73640ae022`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:51.428899 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1148/2282] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:51.430842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ee3cfbd0-7325-42c5-b5d0-ed7edfbe152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:51.466881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e728d06-63ca-476e-aa4d-91ec15acc51c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:51.578782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e728d06-63ca-476e-aa4d-91ec15acc51c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:51.593568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa1b67-9856-4de6-b5eb-5fdf36c262d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:51.595091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa1b67-9856-4de6-b5eb-5fdf36c262d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:51.597075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa1b67-9856-4de6-b5eb-5fdf36c262d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:51.599099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa1b67-9856-4de6-b5eb-5fdf36c262d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:51.601278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1135/2283] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:51.618806 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa1b67-9856-4de6-b5eb-5fdf36c262d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:51.620530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa1b67-9856-4de6-b5eb-5fdf36c262d5 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:51.643528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1149/2284] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:51.669798 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cfbd0-7325-42c5-b5d0-ed7edfbe152e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:51.755070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:51.772486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cfbd0-7325-42c5-b5d0-ed7edfbe152e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:51.778770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:51.779806 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:51.780109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:51.780381 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] PATH_INFO: `/v3/users/5ec116ad41e84bb19cc8941cd7458d5d` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:51.782300 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec116ad41e84bb19cc8941cd7458d5d)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:51.785779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:51.860045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec116ad41e84bb19cc8941cd7458d5d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:51.860699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec116ad41e84bb19cc8941cd7458d5d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:51.893088 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec116ad41e84bb19cc8941cd7458d5d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:51.918832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec116ad41e84bb19cc8941cd7458d5d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:51.945311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec116ad41e84bb19cc8941cd7458d5d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:51.967516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1136/2285] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:51 2022] DELETE /identity/v3/users/5ec116ad41e84bb19cc8941cd7458d5d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:51.972412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d1b5e-9f0f-4e10-a19d-218f64b4caa7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:51.973461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d1b5e-9f0f-4e10-a19d-218f64b4caa7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:51.973896 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d1b5e-9f0f-4e10-a19d-218f64b4caa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:52.013754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fe9d1b5e-9f0f-4e10-a19d-218f64b4caa7 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:52.017892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fe9d1b5e-9f0f-4e10-a19d-218f64b4caa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:52.158123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1150/2286] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:52.176015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:52.177797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:52.282301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18853d4b-064e-4a65-9978-da589c95a0d0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:52.292646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384addd2-e1be-453b-9180-74b8d8abff1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:52.293331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384addd2-e1be-453b-9180-74b8d8abff1b service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:52.296120 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384addd2-e1be-453b-9180-74b8d8abff1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:52.296120 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384addd2-e1be-453b-9180-74b8d8abff1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:52.330110 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384addd2-e1be-453b-9180-74b8d8abff1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:52.332094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384addd2-e1be-453b-9180-74b8d8abff1b service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:52.347455 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1137/2287] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:52.729888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d1b5e-9f0f-4e10-a19d-218f64b4caa7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:52.732399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fe9d1b5e-9f0f-4e10-a19d-218f64b4caa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:52.749261 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d1b5e-9f0f-4e10-a19d-218f64b4caa7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:52.755831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:52.757032 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:52.757830 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:52.758267 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf admin admin] PATH_INFO: `/v3/projects/345d194ad47142a2815f1a819a262fd3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:52.759653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=345d194ad47142a2815f1a819a262fd3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:52.761852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:52.863834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:52.907340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '345d194ad47142a2815f1a819a262fd3', 'request_id': 'req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:52.929207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '345d194ad47142a2815f1a819a262fd3', 'request_id': 'req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:52.942746 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '345d194ad47142a2815f1a819a262fd3', 'request_id': 'req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:52.968432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf admin admin] The token cache is being invalidate because project 345d194ad47142a2815f1a819a262fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:52.968897 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:52.970349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b9c3d5fd-e79d-4821-ab3b-47fd675beccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:52.979574 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1151/2288] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:52 2022] DELETE /identity/v3/projects/345d194ad47142a2815f1a819a262fd3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:55.306971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384addd2-e1be-453b-9180-74b8d8abff1b service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:55.309056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-384addd2-e1be-453b-9180-74b8d8abff1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:55.349950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384addd2-e1be-453b-9180-74b8d8abff1b service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:55.466206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc95710-4869-4db3-90b3-a2dbea92a527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:55.467992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95710-4869-4db3-90b3-a2dbea92a527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:55.468552 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95710-4869-4db3-90b3-a2dbea92a527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:55.469053 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95710-4869-4db3-90b3-a2dbea92a527 admin admin] PATH_INFO: `/v3/users/b8ad635d242d4a5d96448bf143a4a4af` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:55.470628 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc95710-4869-4db3-90b3-a2dbea92a527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ad635d242d4a5d96448bf143a4a4af)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:55.473719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc95710-4869-4db3-90b3-a2dbea92a527 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:55.502643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:55.568669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bbc95710-4869-4db3-90b3-a2dbea92a527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ad635d242d4a5d96448bf143a4a4af'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:55.569362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bbc95710-4869-4db3-90b3-a2dbea92a527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ad635d242d4a5d96448bf143a4a4af'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:55.612355 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bbc95710-4869-4db3-90b3-a2dbea92a527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ad635d242d4a5d96448bf143a4a4af'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:55.637925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bbc95710-4869-4db3-90b3-a2dbea92a527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ad635d242d4a5d96448bf143a4a4af'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:55.652269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bbc95710-4869-4db3-90b3-a2dbea92a527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ad635d242d4a5d96448bf143a4a4af'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:55.666291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1138/2289] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:55 2022] DELETE /identity/v3/users/b8ad635d242d4a5d96448bf143a4a4af => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:55.671132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9e333-6eef-45cb-b082-aff82bb143ad None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:55.671745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9e333-6eef-45cb-b082-aff82bb143ad None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:55.672289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9e333-6eef-45cb-b082-aff82bb143ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:55.707745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8dd9e333-6eef-45cb-b082-aff82bb143ad None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:55.709241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8dd9e333-6eef-45cb-b082-aff82bb143ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:55.760548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa7b92-ccce-42f3-a838-41e6bca3ebe7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:55.760844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa7b92-ccce-42f3-a838-41e6bca3ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:55.761119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa7b92-ccce-42f3-a838-41e6bca3ebe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:55.849500 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7afa7b92-ccce-42f3-a838-41e6bca3ebe7 None None] MFA Rules not processed for user `9944667e98934d41aa374f4837ade695`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:42:55.854263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7afa7b92-ccce-42f3-a838-41e6bca3ebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:55.871510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1152/2290] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:42:55.887607 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9e333-6eef-45cb-b082-aff82bb143ad None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:55.889444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8dd9e333-6eef-45cb-b082-aff82bb143ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:56.017608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9e333-6eef-45cb-b082-aff82bb143ad None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:56.028722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc208b1d-d96a-4f0c-a456-9c8fcacd9d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:56.029419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc208b1d-d96a-4f0c-a456-9c8fcacd9d66 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:56.029802 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc208b1d-d96a-4f0c-a456-9c8fcacd9d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:56.030159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc208b1d-d96a-4f0c-a456-9c8fcacd9d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:56.032101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1139/2291] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:42:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:42:56.034561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa7b92-ccce-42f3-a838-41e6bca3ebe7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:56.035994 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7afa7b92-ccce-42f3-a838-41e6bca3ebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:56.057133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc208b1d-d96a-4f0c-a456-9c8fcacd9d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:56.058606 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc208b1d-d96a-4f0c-a456-9c8fcacd9d66 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:56.059553 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa7b92-ccce-42f3-a838-41e6bca3ebe7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:56.075902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d812536-d747-4e06-a6d2-f20704f2acb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:56.076775 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812536-d747-4e06-a6d2-f20704f2acb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:56.077066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812536-d747-4e06-a6d2-f20704f2acb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:56.077346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812536-d747-4e06-a6d2-f20704f2acb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:56.078753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d812536-d747-4e06-a6d2-f20704f2acb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:56.079739 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1153/2292] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:42:56.081198 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d812536-d747-4e06-a6d2-f20704f2acb6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:56.140492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1140/2293] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:42:56 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:56.144994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc208b1d-d96a-4f0c-a456-9c8fcacd9d66 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:56.161265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc208b1d-d96a-4f0c-a456-9c8fcacd9d66 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:56.285400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed939d4-dafc-437b-8242-1167047b736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:56.286696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed939d4-dafc-437b-8242-1167047b736f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:56.286991 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed939d4-dafc-437b-8242-1167047b736f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:56.287355 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed939d4-dafc-437b-8242-1167047b736f admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:56.288057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed939d4-dafc-437b-8242-1167047b736f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:56.294253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed939d4-dafc-437b-8242-1167047b736f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:56.330071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:56.340367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1154/2294] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:42:56 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:42:56.341784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d812536-d747-4e06-a6d2-f20704f2acb6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:56.354227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d812536-d747-4e06-a6d2-f20704f2acb6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:56.378909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228efda-f610-4a6f-bdbd-6292d2ac0690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:56.389954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228efda-f610-4a6f-bdbd-6292d2ac0690 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:56.389954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228efda-f610-4a6f-bdbd-6292d2ac0690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:56.392058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228efda-f610-4a6f-bdbd-6292d2ac0690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:56.397508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228efda-f610-4a6f-bdbd-6292d2ac0690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:56.406540 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228efda-f610-4a6f-bdbd-6292d2ac0690 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:56.433531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1141/2295] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:42:56.435589 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed939d4-dafc-437b-8242-1167047b736f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:56.449452 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed939d4-dafc-437b-8242-1167047b736f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:56.461415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b607a7-fa40-4758-8f71-1148c15fc969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:56.464766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b607a7-fa40-4758-8f71-1148c15fc969 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:56.465587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b607a7-fa40-4758-8f71-1148c15fc969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:56.466563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b607a7-fa40-4758-8f71-1148c15fc969 admin admin] PATH_INFO: `/v3/projects/aa49378ed758445c98b2ed64114d9de0/users/77af14475af84082bae70ebb9e895193/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:56.499049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b607a7-fa40-4758-8f71-1148c15fc969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa49378ed758445c98b2ed64114d9de0, user_id=77af14475af84082bae70ebb9e895193, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:56.502801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b607a7-fa40-4758-8f71-1148c15fc969 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:56.510349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228efda-f610-4a6f-bdbd-6292d2ac0690 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:56.512262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4228efda-f610-4a6f-bdbd-6292d2ac0690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:56.535522 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228efda-f610-4a6f-bdbd-6292d2ac0690 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:56.541501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1155/2296] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:56 2022] PUT /identity/v3/projects/aa49378ed758445c98b2ed64114d9de0/users/77af14475af84082bae70ebb9e895193/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:56.547080 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b607a7-fa40-4758-8f71-1148c15fc969 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:56.614314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:56.631676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:56.632746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:56.633834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:56.634228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] PATH_INFO: `/v3/projects/26cdcfbf4b3e43698a26656b92f61c0a` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:56.636283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] RBAC: Authorizing `identity:delete_project(project_id=26cdcfbf4b3e43698a26656b92f61c0a)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:56.638302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b607a7-fa40-4758-8f71-1148c15fc969 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:56.638432 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:56.646193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf19f4-0ad1-4312-8922-1c020b0d4285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:56.646928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf19f4-0ad1-4312-8922-1c020b0d4285 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:56.647507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf19f4-0ad1-4312-8922-1c020b0d4285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:56.647789 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf19f4-0ad1-4312-8922-1c020b0d4285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:56.648525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf19f4-0ad1-4312-8922-1c020b0d4285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:56.650132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf19f4-0ad1-4312-8922-1c020b0d4285 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:56.671460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1156/2297] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:42:56.673019 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf19f4-0ad1-4312-8922-1c020b0d4285 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:56.688679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf19f4-0ad1-4312-8922-1c020b0d4285 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:56.696154 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26cdcfbf4b3e43698a26656b92f61c0a', 'request_id': 'req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:56.706368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26cdcfbf4b3e43698a26656b92f61c0a', 'request_id': 'req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:56.713484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26cdcfbf4b3e43698a26656b92f61c0a', 'request_id': 'req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:56.731983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] The token cache is being invalidate because project 26cdcfbf4b3e43698a26656b92f61c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:56.732367 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:56.733622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:56.738590 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1142/2298] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:56 2022] DELETE /identity/v3/projects/26cdcfbf4b3e43698a26656b92f61c0a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:56.742808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:56.744806 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:56.835411 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c92fc5-664c-4650-b3c9-fff3f21a82b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:56.836707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c92fc5-664c-4650-b3c9-fff3f21a82b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:56.837060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c92fc5-664c-4650-b3c9-fff3f21a82b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:56.837488 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c92fc5-664c-4650-b3c9-fff3f21a82b9 admin admin] PATH_INFO: `/v3/projects/aa49378ed758445c98b2ed64114d9de0/users/77af14475af84082bae70ebb9e895193/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:56.840004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c92fc5-664c-4650-b3c9-fff3f21a82b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa49378ed758445c98b2ed64114d9de0, user_id=77af14475af84082bae70ebb9e895193, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:56.847470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c92fc5-664c-4650-b3c9-fff3f21a82b9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:56.870060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1157/2299] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:42:56 2022] PUT /identity/v3/projects/aa49378ed758445c98b2ed64114d9de0/users/77af14475af84082bae70ebb9e895193/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:42:56.915638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd151ab-bdfa-43a8-bbc1-eed094c6393e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:57.050178 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f1f1e-cf16-4ab9-89cb-10b060c81ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:57.052267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1f1e-cf16-4ab9-89cb-10b060c81ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:57.053239 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1f1e-cf16-4ab9-89cb-10b060c81ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:57.053704 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1f1e-cf16-4ab9-89cb-10b060c81ab5 admin admin] PATH_INFO: `/v3/users/c5b83991da304a888f957528f3e59cd9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:57.058509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f1f1e-cf16-4ab9-89cb-10b060c81ab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b83991da304a888f957528f3e59cd9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:57.061755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f1f1e-cf16-4ab9-89cb-10b060c81ab5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:57.144174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:57.171121 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cd1f1f1e-cf16-4ab9-89cb-10b060c81ab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b83991da304a888f957528f3e59cd9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:57.172943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cd1f1f1e-cf16-4ab9-89cb-10b060c81ab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b83991da304a888f957528f3e59cd9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:57.215408 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cd1f1f1e-cf16-4ab9-89cb-10b060c81ab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b83991da304a888f957528f3e59cd9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:57.239805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cd1f1f1e-cf16-4ab9-89cb-10b060c81ab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b83991da304a888f957528f3e59cd9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:57.259851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cd1f1f1e-cf16-4ab9-89cb-10b060c81ab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b83991da304a888f957528f3e59cd9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:57.271807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1143/2300] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:56 2022] DELETE /identity/v3/users/c5b83991da304a888f957528f3e59cd9 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:58.229818 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c92fc5-664c-4650-b3c9-fff3f21a82b9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:58.232911 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b4c92fc5-664c-4650-b3c9-fff3f21a82b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:58.247635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c92fc5-664c-4650-b3c9-fff3f21a82b9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:58.402443 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:58.404575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:58.404883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:58.405168 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] PATH_INFO: `/v3/projects/fe7305c6f1884bf1ba24dbb2d16b87c3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:58.407458 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7305c6f1884bf1ba24dbb2d16b87c3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:58.409474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:58.419768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:42:58.508837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7305c6f1884bf1ba24dbb2d16b87c3', 'request_id': 'req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:58.522434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7305c6f1884bf1ba24dbb2d16b87c3', 'request_id': 'req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:58.544204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7305c6f1884bf1ba24dbb2d16b87c3', 'request_id': 'req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:58.570579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] The token cache is being invalidate because project fe7305c6f1884bf1ba24dbb2d16b87c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:42:58.570883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:58.571630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:58.588381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1158/2301] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:58 2022] DELETE /identity/v3/projects/fe7305c6f1884bf1ba24dbb2d16b87c3 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:58.596076 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f1f1e-cf16-4ab9-89cb-10b060c81ab5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:58.610978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f1f1e-cf16-4ab9-89cb-10b060c81ab5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:42:58.738000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3306c5f-5e04-4b08-99d6-ff39bca774df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:42:58.739197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3306c5f-5e04-4b08-99d6-ff39bca774df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:42:58.739715 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3306c5f-5e04-4b08-99d6-ff39bca774df admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:42:58.740894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3306c5f-5e04-4b08-99d6-ff39bca774df admin admin] PATH_INFO: `/v3/users/fa525d959f634a1dbfc1d5e738f2ae97` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:42:58.742620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3306c5f-5e04-4b08-99d6-ff39bca774df admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa525d959f634a1dbfc1d5e738f2ae97)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:42:58.744813 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3306c5f-5e04-4b08-99d6-ff39bca774df admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:42:58.859638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f3306c5f-5e04-4b08-99d6-ff39bca774df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa525d959f634a1dbfc1d5e738f2ae97'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:58.861389 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f3306c5f-5e04-4b08-99d6-ff39bca774df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa525d959f634a1dbfc1d5e738f2ae97'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:58.894564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f3306c5f-5e04-4b08-99d6-ff39bca774df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa525d959f634a1dbfc1d5e738f2ae97'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:58.918505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f3306c5f-5e04-4b08-99d6-ff39bca774df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa525d959f634a1dbfc1d5e738f2ae97'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:58.930244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f3306c5f-5e04-4b08-99d6-ff39bca774df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa525d959f634a1dbfc1d5e738f2ae97'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:42:58.943598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1144/2302] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:42:58 2022] DELETE /identity/v3/users/fa525d959f634a1dbfc1d5e738f2ae97 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:42:59.913523 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:42:59.915704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:42:59.932149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c9a19-4ec4-48a9-acdc-af29b0dd51b6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:00.052379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:00.053659 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:00.054105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:00.054526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1 admin admin] PATH_INFO: `/v3/projects/53d19004b6b347e7ad3ae8b4420181b1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:00.058023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d19004b6b347e7ad3ae8b4420181b1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:00.076630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:00.208001 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d19004b6b347e7ad3ae8b4420181b1', 'request_id': 'req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:00.228999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d19004b6b347e7ad3ae8b4420181b1', 'request_id': 'req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:00.269946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d19004b6b347e7ad3ae8b4420181b1', 'request_id': 'req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:00.291651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1 admin admin] The token cache is being invalidate because project 53d19004b6b347e7ad3ae8b4420181b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:43:00.291946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:00.292650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-01b755d3-c4db-4c4e-b5d4-b890ff9695b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:00.295731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1159/2303] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:42:59 2022] DELETE /identity/v3/projects/53d19004b6b347e7ad3ae8b4420181b1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:43:00.301450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dda6dc-497b-49c5-8012-bfe991cd111d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:00.301988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dda6dc-497b-49c5-8012-bfe991cd111d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:00.302469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dda6dc-497b-49c5-8012-bfe991cd111d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:00.340623 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-73dda6dc-497b-49c5-8012-bfe991cd111d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:00.345646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-73dda6dc-497b-49c5-8012-bfe991cd111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:00.415487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:00.556737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1145/2304] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:00.560431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7170a-ba74-44d7-9b5f-be6814898249 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:00.560726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7170a-ba74-44d7-9b5f-be6814898249 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:00.561007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7170a-ba74-44d7-9b5f-be6814898249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:00.608184 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-65f7170a-ba74-44d7-9b5f-be6814898249 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:00.611447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-65f7170a-ba74-44d7-9b5f-be6814898249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:00.630269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dda6dc-497b-49c5-8012-bfe991cd111d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:00.644796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1160/2305] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:00.648272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dda6dc-497b-49c5-8012-bfe991cd111d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:00.655669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414167a-2a1d-4733-af3d-3d91a75c6c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:00.656516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414167a-2a1d-4733-af3d-3d91a75c6c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:00.657007 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414167a-2a1d-4733-af3d-3d91a75c6c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:00.657385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414167a-2a1d-4733-af3d-3d91a75c6c00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:00.669987 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414167a-2a1d-4733-af3d-3d91a75c6c00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:43:00.670370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414167a-2a1d-4733-af3d-3d91a75c6c00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:00.672612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414167a-2a1d-4733-af3d-3d91a75c6c00 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:00.711583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1146/2306] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:43:00.714565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7170a-ba74-44d7-9b5f-be6814898249 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:00.731248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7170a-ba74-44d7-9b5f-be6814898249 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:00.749125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380b85b-437f-4b68-ad51-1c3d1bcc1d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:00.750538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380b85b-437f-4b68-ad51-1c3d1bcc1d40 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:00.750978 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380b85b-437f-4b68-ad51-1c3d1bcc1d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:00.751630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380b85b-437f-4b68-ad51-1c3d1bcc1d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:00.752456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380b85b-437f-4b68-ad51-1c3d1bcc1d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:00.754941 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380b85b-437f-4b68-ad51-1c3d1bcc1d40 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:00.776227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:00.797217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1161/2307] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:43:00 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:43:00.801003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414167a-2a1d-4733-af3d-3d91a75c6c00 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:00.819354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414167a-2a1d-4733-af3d-3d91a75c6c00 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:00.976745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff99d09-926d-42e8-becb-a9ab13d6a2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:00.977877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff99d09-926d-42e8-becb-a9ab13d6a2ad admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:00.978262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff99d09-926d-42e8-becb-a9ab13d6a2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:00.978695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff99d09-926d-42e8-becb-a9ab13d6a2ad admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:00.979696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff99d09-926d-42e8-becb-a9ab13d6a2ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:00.982077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff99d09-926d-42e8-becb-a9ab13d6a2ad admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:01.014843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380b85b-437f-4b68-ad51-1c3d1bcc1d40 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:01.027060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1147/2308] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:43:00 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:43:01.030024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380b85b-437f-4b68-ad51-1c3d1bcc1d40 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:01.035833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165cc6e-71d1-4646-9192-dff45671506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:01.036866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165cc6e-71d1-4646-9192-dff45671506f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:01.037301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165cc6e-71d1-4646-9192-dff45671506f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:01.037785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165cc6e-71d1-4646-9192-dff45671506f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:01.038667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165cc6e-71d1-4646-9192-dff45671506f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:01.040900 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165cc6e-71d1-4646-9192-dff45671506f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:01.061926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff99d09-926d-42e8-becb-a9ab13d6a2ad admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:01.063767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1162/2309] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:43:01.090804 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff99d09-926d-42e8-becb-a9ab13d6a2ad admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:01.114578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591f2fc-51cd-4780-95b8-d0c4a351f109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:01.119187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591f2fc-51cd-4780-95b8-d0c4a351f109 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:01.119592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591f2fc-51cd-4780-95b8-d0c4a351f109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:01.120434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591f2fc-51cd-4780-95b8-d0c4a351f109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:01.124311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591f2fc-51cd-4780-95b8-d0c4a351f109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:01.126162 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591f2fc-51cd-4780-95b8-d0c4a351f109 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:01.152157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165cc6e-71d1-4646-9192-dff45671506f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:01.153031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1148/2310] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:43:01.167500 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165cc6e-71d1-4646-9192-dff45671506f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:01.191154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa195a8-8a37-4db2-81c5-3f53ea7c3990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:01.192275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa195a8-8a37-4db2-81c5-3f53ea7c3990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:01.193143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa195a8-8a37-4db2-81c5-3f53ea7c3990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:01.193143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa195a8-8a37-4db2-81c5-3f53ea7c3990 admin admin] PATH_INFO: `/v3/projects/b17d6b2f420a4b158cbba83837e05759/users/de4740e44fb44a3784ffd0a0cd4a6cc2/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:01.210666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa195a8-8a37-4db2-81c5-3f53ea7c3990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17d6b2f420a4b158cbba83837e05759, user_id=de4740e44fb44a3784ffd0a0cd4a6cc2, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:01.218468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa195a8-8a37-4db2-81c5-3f53ea7c3990 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:01.254093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1163/2311] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:43:01 2022] PUT /identity/v3/projects/b17d6b2f420a4b158cbba83837e05759/users/de4740e44fb44a3784ffd0a0cd4a6cc2/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:01.256138 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee114f14-57b7-47b4-9ad9-49b892b6a836 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:01.256456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee114f14-57b7-47b4-9ad9-49b892b6a836 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:01.256722 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee114f14-57b7-47b4-9ad9-49b892b6a836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:01.310765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ee114f14-57b7-47b4-9ad9-49b892b6a836 None None] MFA Rules not processed for user `de4740e44fb44a3784ffd0a0cd4a6cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:01.312273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ee114f14-57b7-47b4-9ad9-49b892b6a836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:01.496061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1149/2312] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:01.506364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa195a8-8a37-4db2-81c5-3f53ea7c3990 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:01.509381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ffa195a8-8a37-4db2-81c5-3f53ea7c3990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:01.636678 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa195a8-8a37-4db2-81c5-3f53ea7c3990 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:01.644613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64eb71-1ba8-4b08-b647-73de1ac390bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:01.645559 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64eb71-1ba8-4b08-b647-73de1ac390bb service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:01.646050 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64eb71-1ba8-4b08-b647-73de1ac390bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:01.646820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64eb71-1ba8-4b08-b647-73de1ac390bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:01.668249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64eb71-1ba8-4b08-b647-73de1ac390bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:01.669798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64eb71-1ba8-4b08-b647-73de1ac390bb service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:01.682611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1164/2313] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:04.173244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a4cb8-6341-46fb-962d-b2c102e94f81 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:04.173744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a4cb8-6341-46fb-962d-b2c102e94f81 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:04.174107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a4cb8-6341-46fb-962d-b2c102e94f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:04.210153 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-629a4cb8-6341-46fb-962d-b2c102e94f81 None None] MFA Rules not processed for user `77af14475af84082bae70ebb9e895193`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:04.214911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-629a4cb8-6341-46fb-962d-b2c102e94f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:04.228155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:04.304719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1150/2314] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:04.317381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64eb71-1ba8-4b08-b647-73de1ac390bb service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:04.318785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5f64eb71-1ba8-4b08-b647-73de1ac390bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:04.383788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64eb71-1ba8-4b08-b647-73de1ac390bb service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:04.387697 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1edbfa-ebcb-4975-abe8-ece2a88ada05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f892e618b01a46aaaab4f79aa0c3daa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:04.388695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1edbfa-ebcb-4975-abe8-ece2a88ada05 service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:04.388974 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1edbfa-ebcb-4975-abe8-ece2a88ada05 service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:04.389917 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1edbfa-ebcb-4975-abe8-ece2a88ada05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:04.393472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6b1edbfa-ebcb-4975-abe8-ece2a88ada05 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:04.465873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1edbfa-ebcb-4975-abe8-ece2a88ada05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:04.467362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1edbfa-ebcb-4975-abe8-ece2a88ada05 service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:04.477578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1165/2315] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:04.629839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ba2c6-2437-4e58-83ad-833897c89f85 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:04.630196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ba2c6-2437-4e58-83ad-833897c89f85 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:04.630483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ba2c6-2437-4e58-83ad-833897c89f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:04.660575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-711ba2c6-2437-4e58-83ad-833897c89f85 None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:04.661952 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-711ba2c6-2437-4e58-83ad-833897c89f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:04.750354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1151/2316] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:43:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:04.794258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1edbfa-ebcb-4975-abe8-ece2a88ada05 service glance] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:04.795754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6b1edbfa-ebcb-4975-abe8-ece2a88ada05 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:04.816216 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:04.873341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1edbfa-ebcb-4975-abe8-ece2a88ada05 service glance] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:04.879583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d497122-d702-4b86-8c25-76d2e075df55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:04.880208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d497122-d702-4b86-8c25-76d2e075df55 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:04.880505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d497122-d702-4b86-8c25-76d2e075df55 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:04.880799 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d497122-d702-4b86-8c25-76d2e075df55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:04.892086 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d497122-d702-4b86-8c25-76d2e075df55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:04.903936 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d497122-d702-4b86-8c25-76d2e075df55 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:04.916079 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1166/2317] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:43:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:43:13.447635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce6d99-a278-4ec3-8a1a-2cd7d43fc584 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:13.448993 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce6d99-a278-4ec3-8a1a-2cd7d43fc584 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:13.449541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce6d99-a278-4ec3-8a1a-2cd7d43fc584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:13.487979 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c5ce6d99-a278-4ec3-8a1a-2cd7d43fc584 None None] MFA Rules not processed for user `fb6987f34f174552bab9495f3d50ee45`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:13.489284 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c5ce6d99-a278-4ec3-8a1a-2cd7d43fc584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:13.563801 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1152/2318] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:14.529442 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d497122-d702-4b86-8c25-76d2e075df55 service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:14.662299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d497122-d702-4b86-8c25-76d2e075df55 service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:14.674046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:14.677939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:14.678432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:14.678915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] PATH_INFO: `/v3/users/de4740e44fb44a3784ffd0a0cd4a6cc2` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:14.681886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4740e44fb44a3784ffd0a0cd4a6cc2)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:14.685126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:14.760128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4740e44fb44a3784ffd0a0cd4a6cc2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:14.770797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4740e44fb44a3784ffd0a0cd4a6cc2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:14.794111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4740e44fb44a3784ffd0a0cd4a6cc2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:14.796724 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4740e44fb44a3784ffd0a0cd4a6cc2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:14.829766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4740e44fb44a3784ffd0a0cd4a6cc2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:14.844004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1167/2319] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:43:14 2022] DELETE /identity/v3/users/de4740e44fb44a3784ffd0a0cd4a6cc2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:14.849176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b284ec-2ad4-4543-bb86-7319d45a9c22 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:14.850146 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b284ec-2ad4-4543-bb86-7319d45a9c22 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:14.850687 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b284ec-2ad4-4543-bb86-7319d45a9c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:14.916209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f2b284ec-2ad4-4543-bb86-7319d45a9c22 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:14.920473 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f2b284ec-2ad4-4543-bb86-7319d45a9c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:15.002736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:15.014731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1153/2320] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:15.025034 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:15.026476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:15.072027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:15.108731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233159d-f523-43b2-b7b6-68f19e19518d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:15.119044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9719e-1a40-42d6-9c04-ca8492a61e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:15.119833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9719e-1a40-42d6-9c04-ca8492a61e09 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:15.120184 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9719e-1a40-42d6-9c04-ca8492a61e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:15.120536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9719e-1a40-42d6-9c04-ca8492a61e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:15.131550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9719e-1a40-42d6-9c04-ca8492a61e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:15.133345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9719e-1a40-42d6-9c04-ca8492a61e09 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:15.154258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1168/2321] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:15.619724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b284ec-2ad4-4543-bb86-7319d45a9c22 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:15.622051 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f2b284ec-2ad4-4543-bb86-7319d45a9c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:15.662297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b284ec-2ad4-4543-bb86-7319d45a9c22 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:15.679360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:15.680234 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:15.680628 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:15.680811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35 admin admin] PATH_INFO: `/v3/projects/b17d6b2f420a4b158cbba83837e05759` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:15.682608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b17d6b2f420a4b158cbba83837e05759)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:15.688700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:15.835889 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17d6b2f420a4b158cbba83837e05759', 'request_id': 'req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:15.870291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17d6b2f420a4b158cbba83837e05759', 'request_id': 'req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:15.882598 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17d6b2f420a4b158cbba83837e05759', 'request_id': 'req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:15.945152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35 admin admin] The token cache is being invalidate because project b17d6b2f420a4b158cbba83837e05759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:43:15.951582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:15.952562 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7d83f244-3eb7-4d05-a12c-dbf8994a0e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:15.959696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1154/2322] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:43:15 2022] DELETE /identity/v3/projects/b17d6b2f420a4b158cbba83837e05759 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:15.961604 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd35cf-49fa-4621-8a18-b0b44895fb3d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:15.962248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd35cf-49fa-4621-8a18-b0b44895fb3d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:15.962609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd35cf-49fa-4621-8a18-b0b44895fb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:16.003396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f3dd35cf-49fa-4621-8a18-b0b44895fb3d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:16.005174 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f3dd35cf-49fa-4621-8a18-b0b44895fb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:16.152869 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1169/2323] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:16.156389 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a3e82-5454-4736-be28-113f6d6093e0 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:16.156760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a3e82-5454-4736-be28-113f6d6093e0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:16.157294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a3e82-5454-4736-be28-113f6d6093e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:16.215529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fa9a3e82-5454-4736-be28-113f6d6093e0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:16.220096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fa9a3e82-5454-4736-be28-113f6d6093e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:16.252216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1155/2324] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:16.253440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd35cf-49fa-4621-8a18-b0b44895fb3d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:16.284702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd35cf-49fa-4621-8a18-b0b44895fb3d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:16.289823 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a37584-ee99-4509-9b20-0aac6655dce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:16.290514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37584-ee99-4509-9b20-0aac6655dce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:16.290809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37584-ee99-4509-9b20-0aac6655dce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:16.291149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37584-ee99-4509-9b20-0aac6655dce3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:16.291863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a37584-ee99-4509-9b20-0aac6655dce3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:43:16.292180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a37584-ee99-4509-9b20-0aac6655dce3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:16.293818 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a37584-ee99-4509-9b20-0aac6655dce3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:16.315702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1170/2325] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:43:16.316453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a3e82-5454-4736-be28-113f6d6093e0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:16.328498 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a3e82-5454-4736-be28-113f6d6093e0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:16.338641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e488a-bd10-4aed-b3fc-89635eba7bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:16.339446 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e488a-bd10-4aed-b3fc-89635eba7bce admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:16.339811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e488a-bd10-4aed-b3fc-89635eba7bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:16.340187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e488a-bd10-4aed-b3fc-89635eba7bce admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:16.343950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e488a-bd10-4aed-b3fc-89635eba7bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:16.346119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e488a-bd10-4aed-b3fc-89635eba7bce admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:16.392489 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1156/2326] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:43:16 2022] POST /identity/v3/projects => generated 399 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:43:16.396738 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a37584-ee99-4509-9b20-0aac6655dce3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:16.412860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a37584-ee99-4509-9b20-0aac6655dce3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:16.488406 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f14de-b49a-41dd-9308-c548ceb27184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:16.489184 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f14de-b49a-41dd-9308-c548ceb27184 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:16.489781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f14de-b49a-41dd-9308-c548ceb27184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:16.490416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f14de-b49a-41dd-9308-c548ceb27184 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:16.490694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f14de-b49a-41dd-9308-c548ceb27184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:16.492781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f14de-b49a-41dd-9308-c548ceb27184 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:16.519499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1171/2327] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:43:16 2022] POST /identity/v3/users => generated 300 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:43:16.523588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e488a-bd10-4aed-b3fc-89635eba7bce admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:16.534821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e488a-bd10-4aed-b3fc-89635eba7bce admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:16.539744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad664a8d-c1b3-4a2a-bdab-26d6b7228aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:16.540407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad664a8d-c1b3-4a2a-bdab-26d6b7228aab admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:16.540691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad664a8d-c1b3-4a2a-bdab-26d6b7228aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:16.540971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad664a8d-c1b3-4a2a-bdab-26d6b7228aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:16.541733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad664a8d-c1b3-4a2a-bdab-26d6b7228aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:16.543714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad664a8d-c1b3-4a2a-bdab-26d6b7228aab admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:16.558310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1157/2328] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:43:16.559068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f14de-b49a-41dd-9308-c548ceb27184 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:16.571220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f14de-b49a-41dd-9308-c548ceb27184 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:16.576738 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99509fd3-8421-4842-8aa4-cb1e709da14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:16.577049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99509fd3-8421-4842-8aa4-cb1e709da14d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:16.578031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99509fd3-8421-4842-8aa4-cb1e709da14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:16.578310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99509fd3-8421-4842-8aa4-cb1e709da14d admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:16.579208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99509fd3-8421-4842-8aa4-cb1e709da14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:16.580839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99509fd3-8421-4842-8aa4-cb1e709da14d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:16.596042 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1172/2329] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:43:16.598073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad664a8d-c1b3-4a2a-bdab-26d6b7228aab admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:16.611355 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad664a8d-c1b3-4a2a-bdab-26d6b7228aab admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:16.618720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17fc64-f86c-48bf-9506-db55636fee9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:16.619783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17fc64-f86c-48bf-9506-db55636fee9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:16.620164 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17fc64-f86c-48bf-9506-db55636fee9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:16.620503 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17fc64-f86c-48bf-9506-db55636fee9c admin admin] PATH_INFO: `/v3/projects/0ea8d723598743718f06f2973fa1cc9f/users/602d2ed408fc4c899588519f1c70e613/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:16.664526 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17fc64-f86c-48bf-9506-db55636fee9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea8d723598743718f06f2973fa1cc9f, user_id=602d2ed408fc4c899588519f1c70e613, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:16.668053 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17fc64-f86c-48bf-9506-db55636fee9c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:16.691936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1158/2330] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:43:16 2022] PUT /identity/v3/projects/0ea8d723598743718f06f2973fa1cc9f/users/602d2ed408fc4c899588519f1c70e613/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:16.701883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df996890-8a4e-4c0d-ba9b-fd5af223daee None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:16.702807 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df996890-8a4e-4c0d-ba9b-fd5af223daee None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:16.703164 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df996890-8a4e-4c0d-ba9b-fd5af223daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:16.737552 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-df996890-8a4e-4c0d-ba9b-fd5af223daee None None] MFA Rules not processed for user `602d2ed408fc4c899588519f1c70e613`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:16.738957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-df996890-8a4e-4c0d-ba9b-fd5af223daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:16.768415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:16.845192 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1173/2331] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:16.861595 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17fc64-f86c-48bf-9506-db55636fee9c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:16.864056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4b17fc64-f86c-48bf-9506-db55636fee9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:17.070556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17fc64-f86c-48bf-9506-db55636fee9c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:17.079732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73960214-1193-41ea-8b7c-0d2527b72b91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:17.080948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73960214-1193-41ea-8b7c-0d2527b72b91 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:17.081512 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73960214-1193-41ea-8b7c-0d2527b72b91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:17.081799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73960214-1193-41ea-8b7c-0d2527b72b91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:17.105991 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73960214-1193-41ea-8b7c-0d2527b72b91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:17.107589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73960214-1193-41ea-8b7c-0d2527b72b91 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:17.131429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1159/2332] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:17.326567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1971a78-8305-4b61-baa1-ab6881fc5f60 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:17.327103 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1971a78-8305-4b61-baa1-ab6881fc5f60 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:17.327271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1971a78-8305-4b61-baa1-ab6881fc5f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:17.354270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c1971a78-8305-4b61-baa1-ab6881fc5f60 None None] MFA Rules not processed for user `20391809bbeb425e9cac6f73640ae022`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:17.356307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c1971a78-8305-4b61-baa1-ab6881fc5f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:17.455927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1174/2333] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:18.239220 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73960214-1193-41ea-8b7c-0d2527b72b91 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:18.241288 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-73960214-1193-41ea-8b7c-0d2527b72b91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:18.282187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:18.419650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73960214-1193-41ea-8b7c-0d2527b72b91 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:18.427530 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:18.430263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:18.430799 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:18.432016 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] PATH_INFO: `/v3/users/26860d953585434d9bcb5c0460491bce` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:18.433826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26860d953585434d9bcb5c0460491bce)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:18.439427 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:18.529841 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26860d953585434d9bcb5c0460491bce'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:18.532043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26860d953585434d9bcb5c0460491bce'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:18.563400 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26860d953585434d9bcb5c0460491bce'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:18.586679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26860d953585434d9bcb5c0460491bce'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:18.610817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26860d953585434d9bcb5c0460491bce'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:18.627513 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1160/2334] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:43:18 2022] DELETE /identity/v3/users/26860d953585434d9bcb5c0460491bce => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:18.629043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3342e1-9bab-4b12-a127-0a07925ed186 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:18.629485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3342e1-9bab-4b12-a127-0a07925ed186 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:18.629580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3342e1-9bab-4b12-a127-0a07925ed186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:18.669046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bd3342e1-9bab-4b12-a127-0a07925ed186 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:18.671064 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bd3342e1-9bab-4b12-a127-0a07925ed186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:18.764272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1175/2335] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:18.800564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:18.802159 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:18.951615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f4f5-c279-4ba7-9a46-481a33d7ea24 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:18.963214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a1415-c99c-4ad4-bfa2-a784fcfc4f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:18.964045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a1415-c99c-4ad4-bfa2-a784fcfc4f55 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:18.964419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a1415-c99c-4ad4-bfa2-a784fcfc4f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:18.965199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a1415-c99c-4ad4-bfa2-a784fcfc4f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:19.018075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a1415-c99c-4ad4-bfa2-a784fcfc4f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:19.027333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a1415-c99c-4ad4-bfa2-a784fcfc4f55 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:19.083407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1161/2336] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:43:19.262698 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6947a-066f-4821-a346-72d2aff49f14 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:19.263284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6947a-066f-4821-a346-72d2aff49f14 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:19.263656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6947a-066f-4821-a346-72d2aff49f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:19.350548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b6c6947a-066f-4821-a346-72d2aff49f14 None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:19.359922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b6c6947a-066f-4821-a346-72d2aff49f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:19.488336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1176/2337] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:43:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:19.510657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a1415-c99c-4ad4-bfa2-a784fcfc4f55 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:19.512654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d01a1415-c99c-4ad4-bfa2-a784fcfc4f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:19.723644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:19.849247 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a1415-c99c-4ad4-bfa2-a784fcfc4f55 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:19.887242 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f3c9a-341f-4a8b-b28a-12b27d59c108 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:19.892469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f3c9a-341f-4a8b-b28a-12b27d59c108 service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:19.894664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f3c9a-341f-4a8b-b28a-12b27d59c108 service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:19.895110 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f3c9a-341f-4a8b-b28a-12b27d59c108 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:19.923818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f3c9a-341f-4a8b-b28a-12b27d59c108 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:19.926438 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f3c9a-341f-4a8b-b28a-12b27d59c108 service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:19.947809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1162/2338] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:43:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:43:19.961030 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6947a-066f-4821-a346-72d2aff49f14 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:19.966480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b6c6947a-066f-4821-a346-72d2aff49f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:20.003159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6947a-066f-4821-a346-72d2aff49f14 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:20.016874 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeea155-0670-4829-9bcb-8cf038fec9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:20.019239 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeea155-0670-4829-9bcb-8cf038fec9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:20.027517 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeea155-0670-4829-9bcb-8cf038fec9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:20.028547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeea155-0670-4829-9bcb-8cf038fec9b4 admin admin] PATH_INFO: `/v3/projects/115b31c0aa7640dda3f0b835fce580e9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:20.030396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeea155-0670-4829-9bcb-8cf038fec9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115b31c0aa7640dda3f0b835fce580e9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:20.032529 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeea155-0670-4829-9bcb-8cf038fec9b4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:20.055536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:20.180766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-afeea155-0670-4829-9bcb-8cf038fec9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115b31c0aa7640dda3f0b835fce580e9', 'request_id': 'req-afeea155-0670-4829-9bcb-8cf038fec9b4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:20.200021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-afeea155-0670-4829-9bcb-8cf038fec9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115b31c0aa7640dda3f0b835fce580e9', 'request_id': 'req-afeea155-0670-4829-9bcb-8cf038fec9b4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:20.220728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-afeea155-0670-4829-9bcb-8cf038fec9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115b31c0aa7640dda3f0b835fce580e9', 'request_id': 'req-afeea155-0670-4829-9bcb-8cf038fec9b4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:20.266664 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-afeea155-0670-4829-9bcb-8cf038fec9b4 admin admin] The token cache is being invalidate because project 115b31c0aa7640dda3f0b835fce580e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:43:20.268168 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-afeea155-0670-4829-9bcb-8cf038fec9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:20.269875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-afeea155-0670-4829-9bcb-8cf038fec9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:20.275428 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1177/2339] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:43:19 2022] DELETE /identity/v3/projects/115b31c0aa7640dda3f0b835fce580e9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:20.278112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6edd-2112-4e38-a92b-20d7f0046616 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:20.278112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6edd-2112-4e38-a92b-20d7f0046616 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:20.278112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6edd-2112-4e38-a92b-20d7f0046616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:20.315156 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9bbf6edd-2112-4e38-a92b-20d7f0046616 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:20.316434 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9bbf6edd-2112-4e38-a92b-20d7f0046616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:20.510063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1163/2340] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:20.521195 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b4871-93d4-4a8a-b921-dd7c626a903c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:20.521525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b4871-93d4-4a8a-b921-dd7c626a903c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:20.522165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b4871-93d4-4a8a-b921-dd7c626a903c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:20.579821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5a3b4871-93d4-4a8a-b921-dd7c626a903c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:20.584130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5a3b4871-93d4-4a8a-b921-dd7c626a903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:20.629469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1178/2341] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:20.633012 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf6edd-2112-4e38-a92b-20d7f0046616 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:20.653507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf6edd-2112-4e38-a92b-20d7f0046616 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:20.683046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed0f75-8f64-4a19-8126-0a999c17ebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:20.687655 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed0f75-8f64-4a19-8126-0a999c17ebf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:20.687999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed0f75-8f64-4a19-8126-0a999c17ebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:20.692124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed0f75-8f64-4a19-8126-0a999c17ebf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:20.692124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed0f75-8f64-4a19-8126-0a999c17ebf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:43:20.697037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed0f75-8f64-4a19-8126-0a999c17ebf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:20.708467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed0f75-8f64-4a19-8126-0a999c17ebf1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:20.760508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1164/2342] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:43:20.763867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b4871-93d4-4a8a-b921-dd7c626a903c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:20.779563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b4871-93d4-4a8a-b921-dd7c626a903c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:20.807905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9754c-aa03-4707-bcaf-63363c271f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:20.808593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9754c-aa03-4707-bcaf-63363c271f5c admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:20.808878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9754c-aa03-4707-bcaf-63363c271f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:20.809155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9754c-aa03-4707-bcaf-63363c271f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:20.815318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9754c-aa03-4707-bcaf-63363c271f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:20.817321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9754c-aa03-4707-bcaf-63363c271f5c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:20.903820 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed0f75-8f64-4a19-8126-0a999c17ebf1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:20.904229 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1179/2343] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:43:20 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:43:20.933800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed0f75-8f64-4a19-8126-0a999c17ebf1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:21.086250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f07ea7-2576-490c-8583-d85e2df2e0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:21.088150 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f07ea7-2576-490c-8583-d85e2df2e0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:21.088443 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f07ea7-2576-490c-8583-d85e2df2e0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:21.088733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f07ea7-2576-490c-8583-d85e2df2e0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:21.093596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f07ea7-2576-490c-8583-d85e2df2e0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:21.100065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f07ea7-2576-490c-8583-d85e2df2e0f9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:21.169012 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1165/2344] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:43:20 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:43:21.173434 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9754c-aa03-4707-bcaf-63363c271f5c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:21.198754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9754c-aa03-4707-bcaf-63363c271f5c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:21.219934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c3a0a-d49d-4a96-844b-0a272bf86c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:21.221518 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c3a0a-d49d-4a96-844b-0a272bf86c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:21.221963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c3a0a-d49d-4a96-844b-0a272bf86c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:21.222392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c3a0a-d49d-4a96-844b-0a272bf86c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:21.223525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c3a0a-d49d-4a96-844b-0a272bf86c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:21.225847 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c3a0a-d49d-4a96-844b-0a272bf86c8c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:21.263061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f07ea7-2576-490c-8583-d85e2df2e0f9 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:21.265088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1180/2345] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:43:21.281676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f07ea7-2576-490c-8583-d85e2df2e0f9 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:21.289191 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5691c8-c7f5-4343-9749-8deae8acfe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:21.290214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5691c8-c7f5-4343-9749-8deae8acfe7e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:21.290856 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5691c8-c7f5-4343-9749-8deae8acfe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:21.291270 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5691c8-c7f5-4343-9749-8deae8acfe7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:21.292394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5691c8-c7f5-4343-9749-8deae8acfe7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:21.297246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5691c8-c7f5-4343-9749-8deae8acfe7e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:21.319229 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1166/2346] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:43:21.321707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c3a0a-d49d-4a96-844b-0a272bf86c8c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:21.334536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c3a0a-d49d-4a96-844b-0a272bf86c8c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:21.347129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1298a40-7f9a-422e-8fba-22a015f63cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:21.351031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1298a40-7f9a-422e-8fba-22a015f63cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:21.351779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1298a40-7f9a-422e-8fba-22a015f63cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:21.352214 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1298a40-7f9a-422e-8fba-22a015f63cfb admin admin] PATH_INFO: `/v3/projects/63db305d9e0b4e3d8f7b5b0b75076c74/users/cf0eed1f40df413ba5f5b08f4276c3bb/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:21.395600 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1298a40-7f9a-422e-8fba-22a015f63cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=63db305d9e0b4e3d8f7b5b0b75076c74, user_id=cf0eed1f40df413ba5f5b08f4276c3bb, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:21.409344 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1298a40-7f9a-422e-8fba-22a015f63cfb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:21.455156 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1181/2347] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:43:21 2022] PUT /identity/v3/projects/63db305d9e0b4e3d8f7b5b0b75076c74/users/cf0eed1f40df413ba5f5b08f4276c3bb/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:21.457100 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f31db-fccb-4d7e-944d-a8dc7d55733e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:21.457393 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f31db-fccb-4d7e-944d-a8dc7d55733e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:21.457674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f31db-fccb-4d7e-944d-a8dc7d55733e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:21.521227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-185f31db-fccb-4d7e-944d-a8dc7d55733e None None] MFA Rules not processed for user `cf0eed1f40df413ba5f5b08f4276c3bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:21.522738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-185f31db-fccb-4d7e-944d-a8dc7d55733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:21.579972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:21.716897 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1167/2348] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:21.729348 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1298a40-7f9a-422e-8fba-22a015f63cfb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:21.731278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e1298a40-7f9a-422e-8fba-22a015f63cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:21.836857 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1298a40-7f9a-422e-8fba-22a015f63cfb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:21.842112 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702f763-c683-4462-826b-7d2b542418f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:21.843581 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702f763-c683-4462-826b-7d2b542418f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:21.844058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702f763-c683-4462-826b-7d2b542418f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:21.844634 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702f763-c683-4462-826b-7d2b542418f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:21.861568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702f763-c683-4462-826b-7d2b542418f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:21.863539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702f763-c683-4462-826b-7d2b542418f0 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:21.878682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1182/2349] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:21.909738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37cb8e-7325-4790-bb55-1ba4505ad989 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:21.910043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37cb8e-7325-4790-bb55-1ba4505ad989 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:21.910354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37cb8e-7325-4790-bb55-1ba4505ad989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:21.966658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-dd37cb8e-7325-4790-bb55-1ba4505ad989 None None] MFA Rules not processed for user `9944667e98934d41aa374f4837ade695`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:21.967985 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-dd37cb8e-7325-4790-bb55-1ba4505ad989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:22.110700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1168/2350] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:23.256533 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702f763-c683-4462-826b-7d2b542418f0 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:23.258901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4702f763-c683-4462-826b-7d2b542418f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:23.389729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:23.457580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702f763-c683-4462-826b-7d2b542418f0 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:23.488133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:23.491128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:23.492375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:23.496384 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] PATH_INFO: `/v3/users/602d2ed408fc4c899588519f1c70e613` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:23.500888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] RBAC: Authorizing `identity:delete_user(user_id=602d2ed408fc4c899588519f1c70e613)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:23.509682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:23.637451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602d2ed408fc4c899588519f1c70e613'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:23.659134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602d2ed408fc4c899588519f1c70e613'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:23.674322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602d2ed408fc4c899588519f1c70e613'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:23.675260 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602d2ed408fc4c899588519f1c70e613'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:23.719230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602d2ed408fc4c899588519f1c70e613'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:23.732084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1183/2351] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:43:23 2022] DELETE /identity/v3/users/602d2ed408fc4c899588519f1c70e613 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:23.733698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4204b-ae9a-4ea2-b5a4-e0cd83c9f2e9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:23.734265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4204b-ae9a-4ea2-b5a4-e0cd83c9f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:23.734985 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4204b-ae9a-4ea2-b5a4-e0cd83c9f2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:23.775520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ece4204b-ae9a-4ea2-b5a4-e0cd83c9f2e9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:23.776754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ece4204b-ae9a-4ea2-b5a4-e0cd83c9f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:23.930139 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1169/2352] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:23.966166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:23.970017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:24.070536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e50c0-165e-40c0-9be0-dfe203ada9df admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:24.079904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09d95b-0594-4b6d-a5bc-a70891672e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:24.081421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09d95b-0594-4b6d-a5bc-a70891672e3b service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:24.081710 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09d95b-0594-4b6d-a5bc-a70891672e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:24.081996 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09d95b-0594-4b6d-a5bc-a70891672e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:24.115618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09d95b-0594-4b6d-a5bc-a70891672e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:24.117514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09d95b-0594-4b6d-a5bc-a70891672e3b service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:24.146427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1184/2353] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:24.916171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4204b-ae9a-4ea2-b5a4-e0cd83c9f2e9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:24.917757 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ece4204b-ae9a-4ea2-b5a4-e0cd83c9f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:24.942826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4204b-ae9a-4ea2-b5a4-e0cd83c9f2e9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:24.958011 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:24.959149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:24.959649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:24.960392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] PATH_INFO: `/v3/projects/0ea8d723598743718f06f2973fa1cc9f` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:24.962835 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea8d723598743718f06f2973fa1cc9f)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:24.964992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:25.018627 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8f392-c4e9-4292-b9a6-384e620ce9c1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:25.021485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8f392-c4e9-4292-b9a6-384e620ce9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:25.022255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8f392-c4e9-4292-b9a6-384e620ce9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:25.052958 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d4a8f392-c4e9-4292-b9a6-384e620ce9c1 None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:25.059344 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d4a8f392-c4e9-4292-b9a6-384e620ce9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:25.079256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea8d723598743718f06f2973fa1cc9f', 'request_id': 'req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:25.097450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea8d723598743718f06f2973fa1cc9f', 'request_id': 'req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:25.115297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea8d723598743718f06f2973fa1cc9f', 'request_id': 'req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:25.125639 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:25.159461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] The token cache is being invalidate because project 0ea8d723598743718f06f2973fa1cc9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:43:25.159770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:25.161201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:25.165562 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1170/2354] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:43:24 2022] DELETE /identity/v3/projects/0ea8d723598743718f06f2973fa1cc9f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:25.166426 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:25.168656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:25.175639 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1185/2355] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:43:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:43:25.239645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8f392-c4e9-4292-b9a6-384e620ce9c1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:25.243401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d4a8f392-c4e9-4292-b9a6-384e620ce9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:25.253300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:25.526210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8f392-c4e9-4292-b9a6-384e620ce9c1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:25.559745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276706ba-8bd6-4224-90bb-2e008022724f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:25.560419 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276706ba-8bd6-4224-90bb-2e008022724f service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:25.560701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276706ba-8bd6-4224-90bb-2e008022724f service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:25.560971 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276706ba-8bd6-4224-90bb-2e008022724f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:25.577586 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-276706ba-8bd6-4224-90bb-2e008022724f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:25.578391 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e2ba6-0bb3-47a3-a6e7-36f532fefa3b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:25.595764 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:25.599152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:25.600056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:25.600360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] PATH_INFO: `/v3/users/cf0eed1f40df413ba5f5b08f4276c3bb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:25.609104 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf0eed1f40df413ba5f5b08f4276c3bb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:25.609431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276706ba-8bd6-4224-90bb-2e008022724f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:25.611090 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276706ba-8bd6-4224-90bb-2e008022724f service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:25.611258 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:25.623145 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1186/2356] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:43:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 20:43:25.734078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf0eed1f40df413ba5f5b08f4276c3bb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:25.734899 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf0eed1f40df413ba5f5b08f4276c3bb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:25.750193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf0eed1f40df413ba5f5b08f4276c3bb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:25.766313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf0eed1f40df413ba5f5b08f4276c3bb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:25.783847 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf0eed1f40df413ba5f5b08f4276c3bb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:25.795932 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1171/2357] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:43:25 2022] DELETE /identity/v3/users/cf0eed1f40df413ba5f5b08f4276c3bb => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:25.798825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d7dc9-c720-4901-813e-7b977f084a89 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:25.799116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d7dc9-c720-4901-813e-7b977f084a89 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:25.799433 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d7dc9-c720-4901-813e-7b977f084a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:25.846169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-321d7dc9-c720-4901-813e-7b977f084a89 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:25.848945 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-321d7dc9-c720-4901-813e-7b977f084a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:26.000338 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1187/2358] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:26.037522 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:26.040963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:26.147244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e633c-6b39-4bee-8ca1-710243806015 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:26.151081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34013714-4d5d-4219-b7c8-8549e39ec4af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:26.152141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34013714-4d5d-4219-b7c8-8549e39ec4af service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:26.152429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34013714-4d5d-4219-b7c8-8549e39ec4af service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:26.152978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34013714-4d5d-4219-b7c8-8549e39ec4af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:26.170019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34013714-4d5d-4219-b7c8-8549e39ec4af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:26.171833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34013714-4d5d-4219-b7c8-8549e39ec4af service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:26.185187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1172/2359] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:26.668739 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d7dc9-c720-4901-813e-7b977f084a89 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:26.671513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-321d7dc9-c720-4901-813e-7b977f084a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:26.696165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d7dc9-c720-4901-813e-7b977f084a89 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:26.705171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84ee0a-9c77-4354-8871-f6481589a79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:26.705171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84ee0a-9c77-4354-8871-f6481589a79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:26.705171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84ee0a-9c77-4354-8871-f6481589a79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:26.705171 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84ee0a-9c77-4354-8871-f6481589a79d admin admin] PATH_INFO: `/v3/projects/63db305d9e0b4e3d8f7b5b0b75076c74` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:26.706656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84ee0a-9c77-4354-8871-f6481589a79d admin admin] RBAC: Authorizing `identity:delete_project(project_id=63db305d9e0b4e3d8f7b5b0b75076c74)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:26.708910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84ee0a-9c77-4354-8871-f6481589a79d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:26.811468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d84ee0a-9c77-4354-8871-f6481589a79d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63db305d9e0b4e3d8f7b5b0b75076c74', 'request_id': 'req-5d84ee0a-9c77-4354-8871-f6481589a79d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:26.820303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d84ee0a-9c77-4354-8871-f6481589a79d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63db305d9e0b4e3d8f7b5b0b75076c74', 'request_id': 'req-5d84ee0a-9c77-4354-8871-f6481589a79d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:26.835837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d84ee0a-9c77-4354-8871-f6481589a79d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63db305d9e0b4e3d8f7b5b0b75076c74', 'request_id': 'req-5d84ee0a-9c77-4354-8871-f6481589a79d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:26.849570 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d84ee0a-9c77-4354-8871-f6481589a79d admin admin] The token cache is being invalidate because project 63db305d9e0b4e3d8f7b5b0b75076c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:43:26.850767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d84ee0a-9c77-4354-8871-f6481589a79d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:26.852060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d84ee0a-9c77-4354-8871-f6481589a79d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:43:26.853875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1188/2360] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:43:26 2022] DELETE /identity/v3/projects/63db305d9e0b4e3d8f7b5b0b75076c74 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:43:26.859132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19154b18-711d-4ea3-a9c4-daf3b5da5175 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:26.859450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19154b18-711d-4ea3-a9c4-daf3b5da5175 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:26.859737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19154b18-711d-4ea3-a9c4-daf3b5da5175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:26.883460 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-19154b18-711d-4ea3-a9c4-daf3b5da5175 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:26.885543 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-19154b18-711d-4ea3-a9c4-daf3b5da5175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:26.910680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:27.033793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1173/2361] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:27.042129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cc524-b476-478b-8d6f-c521cf5cb5d3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:27.044612 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cc524-b476-478b-8d6f-c521cf5cb5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:27.044612 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cc524-b476-478b-8d6f-c521cf5cb5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:27.090296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1a4cc524-b476-478b-8d6f-c521cf5cb5d3 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:27.091857 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1a4cc524-b476-478b-8d6f-c521cf5cb5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:27.113702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1189/2362] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:27.120205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19154b18-711d-4ea3-a9c4-daf3b5da5175 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:27.134668 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19154b18-711d-4ea3-a9c4-daf3b5da5175 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:27.148886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954bd3e-5206-486f-812b-508a79f33890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:27.149783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954bd3e-5206-486f-812b-508a79f33890 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:27.150176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954bd3e-5206-486f-812b-508a79f33890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:27.150560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954bd3e-5206-486f-812b-508a79f33890 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:27.153095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954bd3e-5206-486f-812b-508a79f33890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:43:27.153573 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954bd3e-5206-486f-812b-508a79f33890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:27.156938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954bd3e-5206-486f-812b-508a79f33890 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:27.191079 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1174/2363] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:43:27.195540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cc524-b476-478b-8d6f-c521cf5cb5d3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:27.206671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cc524-b476-478b-8d6f-c521cf5cb5d3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:27.223369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc2cbd-9d9b-46f1-a31a-e0b3c95e7629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:27.223747 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2cbd-9d9b-46f1-a31a-e0b3c95e7629 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:27.224133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2cbd-9d9b-46f1-a31a-e0b3c95e7629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:27.224885 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2cbd-9d9b-46f1-a31a-e0b3c95e7629 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:27.225815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc2cbd-9d9b-46f1-a31a-e0b3c95e7629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:27.228894 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc2cbd-9d9b-46f1-a31a-e0b3c95e7629 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:27.250934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:27.296644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954bd3e-5206-486f-812b-508a79f33890 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:27.299735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1190/2364] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:43:27 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:43:27.311406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954bd3e-5206-486f-812b-508a79f33890 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:27.462416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b936a-7f38-40ce-8aa8-0dcee2d5f2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:27.462416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b936a-7f38-40ce-8aa8-0dcee2d5f2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:27.462416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b936a-7f38-40ce-8aa8-0dcee2d5f2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:27.462416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b936a-7f38-40ce-8aa8-0dcee2d5f2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:27.463638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b936a-7f38-40ce-8aa8-0dcee2d5f2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:27.465700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b936a-7f38-40ce-8aa8-0dcee2d5f2f3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:27.512196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1175/2365] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:43:27 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:43:27.513556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc2cbd-9d9b-46f1-a31a-e0b3c95e7629 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:27.536572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc2cbd-9d9b-46f1-a31a-e0b3c95e7629 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:27.549808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b525952-55c6-4dc5-91b0-5af0008cd724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:27.550925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b525952-55c6-4dc5-91b0-5af0008cd724 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:27.551620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b525952-55c6-4dc5-91b0-5af0008cd724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:27.552679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b525952-55c6-4dc5-91b0-5af0008cd724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:27.554412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b525952-55c6-4dc5-91b0-5af0008cd724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:27.562527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b525952-55c6-4dc5-91b0-5af0008cd724 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:27.620381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1191/2366] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:43:27.622776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b936a-7f38-40ce-8aa8-0dcee2d5f2f3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:27.638692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b936a-7f38-40ce-8aa8-0dcee2d5f2f3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:27.656280 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f60f4-6b91-46de-a9aa-7a88edd5180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:27.657324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f60f4-6b91-46de-a9aa-7a88edd5180f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:27.657979 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f60f4-6b91-46de-a9aa-7a88edd5180f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:27.658468 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f60f4-6b91-46de-a9aa-7a88edd5180f admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:27.659471 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f60f4-6b91-46de-a9aa-7a88edd5180f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:27.661309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f60f4-6b91-46de-a9aa-7a88edd5180f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:27.701748 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b525952-55c6-4dc5-91b0-5af0008cd724 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:27.702838 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1176/2367] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:43:27.719714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b525952-55c6-4dc5-91b0-5af0008cd724 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:27.746193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57f718-6323-4a2d-b3f0-ae100c5f21ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:27.747302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57f718-6323-4a2d-b3f0-ae100c5f21ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:27.747574 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57f718-6323-4a2d-b3f0-ae100c5f21ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:27.747855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57f718-6323-4a2d-b3f0-ae100c5f21ca admin admin] PATH_INFO: `/v3/projects/140222cc9b384d6cbd95e996265c6fd1/users/06b07d2f273d433ca9fe9ba86672b5a5/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:27.798698 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57f718-6323-4a2d-b3f0-ae100c5f21ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=140222cc9b384d6cbd95e996265c6fd1, user_id=06b07d2f273d433ca9fe9ba86672b5a5, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:27.805304 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57f718-6323-4a2d-b3f0-ae100c5f21ca admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:27.840709 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1192/2368] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:43:27 2022] PUT /identity/v3/projects/140222cc9b384d6cbd95e996265c6fd1/users/06b07d2f273d433ca9fe9ba86672b5a5/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:43:27.854990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd74f69-f2d6-4314-ab04-0f2a3d68c3c2 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:27.855404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd74f69-f2d6-4314-ab04-0f2a3d68c3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:27.855767 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd74f69-f2d6-4314-ab04-0f2a3d68c3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:27.947132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3dd74f69-f2d6-4314-ab04-0f2a3d68c3c2 None None] MFA Rules not processed for user `06b07d2f273d433ca9fe9ba86672b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:27.948508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3dd74f69-f2d6-4314-ab04-0f2a3d68c3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:28.156048 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1177/2369] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:28.166930 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57f718-6323-4a2d-b3f0-ae100c5f21ca admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:28.169073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4c57f718-6323-4a2d-b3f0-ae100c5f21ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:28.375669 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57f718-6323-4a2d-b3f0-ae100c5f21ca admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:28.384113 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edeccc-f54c-4bb1-9519-1c566dd5c328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:28.384779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edeccc-f54c-4bb1-9519-1c566dd5c328 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:28.385335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edeccc-f54c-4bb1-9519-1c566dd5c328 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:28.385638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edeccc-f54c-4bb1-9519-1c566dd5c328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:28.408596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edeccc-f54c-4bb1-9519-1c566dd5c328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:28.409807 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edeccc-f54c-4bb1-9519-1c566dd5c328 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:28.446087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1193/2370] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:30.417078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62544a6-df61-4cb6-96d5-e08b9d333a72 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:30.417665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62544a6-df61-4cb6-96d5-e08b9d333a72 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:30.418044 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62544a6-df61-4cb6-96d5-e08b9d333a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:30.461373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d62544a6-df61-4cb6-96d5-e08b9d333a72 None None] MFA Rules not processed for user `06b07d2f273d433ca9fe9ba86672b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:30.465220 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d62544a6-df61-4cb6-96d5-e08b9d333a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:30.489650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1178/2371] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:43:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:38.420478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:40.442388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:50.096023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d410a-005f-4db1-8db4-f5f4af4d869c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:50.096548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d410a-005f-4db1-8db4-f5f4af4d869c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:50.096628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d410a-005f-4db1-8db4-f5f4af4d869c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:50.115627 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-832d410a-005f-4db1-8db4-f5f4af4d869c None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:50.116797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-832d410a-005f-4db1-8db4-f5f4af4d869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:50.174998 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1194/2372] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:43:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:43:50.188722 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62544a6-df61-4cb6-96d5-e08b9d333a72 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:50.190830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d62544a6-df61-4cb6-96d5-e08b9d333a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:50.269378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62544a6-df61-4cb6-96d5-e08b9d333a72 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:50.275875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aaaa5-9ae1-4be4-8845-5098ddf7259e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:50.276752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aaaa5-9ae1-4be4-8845-5098ddf7259e service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:50.277197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aaaa5-9ae1-4be4-8845-5098ddf7259e service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:50.277652 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aaaa5-9ae1-4be4-8845-5098ddf7259e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:50.287541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7aaaa5-9ae1-4be4-8845-5098ddf7259e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:50.289250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7aaaa5-9ae1-4be4-8845-5098ddf7259e service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:50.298876 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1179/2373] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:43:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:43:51.100003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5fdc9-379b-4961-8130-b8bc6d33eb23 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:51.100923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5fdc9-379b-4961-8130-b8bc6d33eb23 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:51.101299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5fdc9-379b-4961-8130-b8bc6d33eb23 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:51.102943 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1195/2374] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:43:51.118304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73b835-fc05-4dc6-8811-3d3fff203cbd None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:51.118304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73b835-fc05-4dc6-8811-3d3fff203cbd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:51.118555 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73b835-fc05-4dc6-8811-3d3fff203cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:51.172743 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9a73b835-fc05-4dc6-8811-3d3fff203cbd None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:51.175851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9a73b835-fc05-4dc6-8811-3d3fff203cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:51.338727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1180/2375] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:51.352304 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5fdc9-379b-4961-8130-b8bc6d33eb23 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:51.354202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-edc5fdc9-379b-4961-8130-b8bc6d33eb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:51.449273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5fdc9-379b-4961-8130-b8bc6d33eb23 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:51.453689 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5a372-556e-4850-9029-f3b206fe8ccb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f892e618b01a46aaaab4f79aa0c3daa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:51.454353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5a372-556e-4850-9029-f3b206fe8ccb service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:51.454630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5a372-556e-4850-9029-f3b206fe8ccb service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:51.454963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5a372-556e-4850-9029-f3b206fe8ccb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:51.465773 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5a372-556e-4850-9029-f3b206fe8ccb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:51.468240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5a372-556e-4850-9029-f3b206fe8ccb service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:51.480211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1196/2376] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:51.570478 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d8c1e-a547-4ec5-997d-96f0d8aa5f60 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:51.570872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d8c1e-a547-4ec5-997d-96f0d8aa5f60 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:51.571106 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d8c1e-a547-4ec5-997d-96f0d8aa5f60 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:51.574030 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1181/2377] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:43:51.581165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60647579-074c-452c-88ca-d0a51555d815 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:51.581657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60647579-074c-452c-88ca-d0a51555d815 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:51.582015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60647579-074c-452c-88ca-d0a51555d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:51.621593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-60647579-074c-452c-88ca-d0a51555d815 None None] MFA Rules not processed for user `d7bb4a244df24a19b4c3ad3d1ad2bc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:51.625593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-60647579-074c-452c-88ca-d0a51555d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:51.739328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1197/2378] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:51.753835 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d8c1e-a547-4ec5-997d-96f0d8aa5f60 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:51.755771 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7a8d8c1e-a547-4ec5-997d-96f0d8aa5f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:51.783416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d8c1e-a547-4ec5-997d-96f0d8aa5f60 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:51.789675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f746e9-1adf-48a3-8c97-84d2268960a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:51.790402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f746e9-1adf-48a3-8c97-84d2268960a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:51.790802 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f746e9-1adf-48a3-8c97-84d2268960a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:51.791090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f746e9-1adf-48a3-8c97-84d2268960a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:51.801803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f746e9-1adf-48a3-8c97-84d2268960a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:51.803503 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f746e9-1adf-48a3-8c97-84d2268960a4 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:51.817376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1182/2379] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:51.975341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997133c-baa2-44c6-b95b-99a02db8d9e3 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:51.975992 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997133c-baa2-44c6-b95b-99a02db8d9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:51.976541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997133c-baa2-44c6-b95b-99a02db8d9e3 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:51.978662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1198/2380] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:43:51.989380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88379ee2-53d1-4af2-b362-4a167a9a45ee None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:51.989672 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88379ee2-53d1-4af2-b362-4a167a9a45ee None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:51.989955 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88379ee2-53d1-4af2-b362-4a167a9a45ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:52.055216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-88379ee2-53d1-4af2-b362-4a167a9a45ee None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:52.056872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-88379ee2-53d1-4af2-b362-4a167a9a45ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:52.071805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1183/2381] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:43:52.086108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997133c-baa2-44c6-b95b-99a02db8d9e3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:52.109849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997133c-baa2-44c6-b95b-99a02db8d9e3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:52.117358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4429411-8635-498e-99f9-360bae7b0d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:52.118198 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429411-8635-498e-99f9-360bae7b0d30 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:52.118491 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429411-8635-498e-99f9-360bae7b0d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:52.118768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429411-8635-498e-99f9-360bae7b0d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:52.134559 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4429411-8635-498e-99f9-360bae7b0d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:52.136040 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4429411-8635-498e-99f9-360bae7b0d30 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:52.154257 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1199/2382] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:43:57.361671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4006d-1084-467a-8b3d-9cad9587af6d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:57.362490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4006d-1084-467a-8b3d-9cad9587af6d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:57.362915 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4006d-1084-467a-8b3d-9cad9587af6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:57.414276 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f2e4006d-1084-467a-8b3d-9cad9587af6d None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:43:57.417134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f2e4006d-1084-467a-8b3d-9cad9587af6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:57.461316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1184/2383] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:43:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:43:57.481224 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4429411-8635-498e-99f9-360bae7b0d30 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:57.535477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4429411-8635-498e-99f9-360bae7b0d30 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:57.541257 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a1e14-ba27-4238-9514-6c9b33cb5ddd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:57.542209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a1e14-ba27-4238-9514-6c9b33cb5ddd service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:57.542899 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a1e14-ba27-4238-9514-6c9b33cb5ddd service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:57.543854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a1e14-ba27-4238-9514-6c9b33cb5ddd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:57.555378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a1e14-ba27-4238-9514-6c9b33cb5ddd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:57.558772 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a1e14-ba27-4238-9514-6c9b33cb5ddd service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:57.564835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:57.570754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1200/2384] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:43:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:43:58.133398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4006d-1084-467a-8b3d-9cad9587af6d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:43:58.134843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f2e4006d-1084-467a-8b3d-9cad9587af6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:58.177307 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4006d-1084-467a-8b3d-9cad9587af6d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:43:58.181003 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6213d8a-5bd9-4590-987c-a16c602a3829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:43:58.181650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6213d8a-5bd9-4590-987c-a16c602a3829 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:43:58.181932 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6213d8a-5bd9-4590-987c-a16c602a3829 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:43:58.182207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6213d8a-5bd9-4590-987c-a16c602a3829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:43:58.184134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d6213d8a-5bd9-4590-987c-a16c602a3829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:43:58.193529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:43:58.308278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6213d8a-5bd9-4590-987c-a16c602a3829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:43:58.310058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6213d8a-5bd9-4590-987c-a16c602a3829 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:43:58.335591 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1185/2385] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:43:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:44:08.317465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=27 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:44:09.336646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da435e-5177-4a7d-bf1a-855655cb0c0b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:09.337150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da435e-5177-4a7d-bf1a-855655cb0c0b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:09.337242 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da435e-5177-4a7d-bf1a-855655cb0c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:09.368603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-98da435e-5177-4a7d-bf1a-855655cb0c0b None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:09.369833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-98da435e-5177-4a7d-bf1a-855655cb0c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:09.377307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1201/2386] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:44:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:44:09.392280 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6213d8a-5bd9-4590-987c-a16c602a3829 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:09.406455 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6213d8a-5bd9-4590-987c-a16c602a3829 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:09.411886 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e254431-1614-47a8-af60-1e52a3122cc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:09.412608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254431-1614-47a8-af60-1e52a3122cc5 service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:09.412953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254431-1614-47a8-af60-1e52a3122cc5 service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:09.413296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254431-1614-47a8-af60-1e52a3122cc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:09.423519 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e254431-1614-47a8-af60-1e52a3122cc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:09.425542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e254431-1614-47a8-af60-1e52a3122cc5 service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:09.441847 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1186/2387] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:44:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:44:10.027310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f2d91-dde1-4ce4-ad92-f0028415bfab None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:10.027601 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f2d91-dde1-4ce4-ad92-f0028415bfab None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:10.027880 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f2d91-dde1-4ce4-ad92-f0028415bfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:10.047572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b84f2d91-dde1-4ce4-ad92-f0028415bfab None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:10.048779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b84f2d91-dde1-4ce4-ad92-f0028415bfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:10.055883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1202/2388] 10.222.0.33 () {58 vars in 967 bytes} [Wed Jul 6 20:44:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:44:10.078028 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e254431-1614-47a8-af60-1e52a3122cc5 service swift] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:10.088962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e254431-1614-47a8-af60-1e52a3122cc5 service swift] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:10.094021 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1522d00-7b1e-4ec4-ab48-db0a4546c0e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:10.094654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522d00-7b1e-4ec4-ab48-db0a4546c0e9 service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:10.094937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522d00-7b1e-4ec4-ab48-db0a4546c0e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:10.095240 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522d00-7b1e-4ec4-ab48-db0a4546c0e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:10.103606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1522d00-7b1e-4ec4-ab48-db0a4546c0e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:10.105202 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1522d00-7b1e-4ec4-ab48-db0a4546c0e9 service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:10.114734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1187/2389] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:44:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:44:10.380806 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2158-b892-43ec-ae50-40d869b262e0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:10.381365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2158-b892-43ec-ae50-40d869b262e0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:10.381365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2158-b892-43ec-ae50-40d869b262e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:10.404019 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ad9a2158-b892-43ec-ae50-40d869b262e0 None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:10.405231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ad9a2158-b892-43ec-ae50-40d869b262e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:10.412680 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1203/2390] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:44:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:44:10.430121 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1522d00-7b1e-4ec4-ab48-db0a4546c0e9 service swift] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:10.441192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1522d00-7b1e-4ec4-ab48-db0a4546c0e9 service swift] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:10.446195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464a2f4-c7f2-4651-beb8-f32d8f4ffd27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:10.446828 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464a2f4-c7f2-4651-beb8-f32d8f4ffd27 service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:10.447114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464a2f4-c7f2-4651-beb8-f32d8f4ffd27 service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:10.447428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464a2f4-c7f2-4651-beb8-f32d8f4ffd27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:10.456090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464a2f4-c7f2-4651-beb8-f32d8f4ffd27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:10.457663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464a2f4-c7f2-4651-beb8-f32d8f4ffd27 service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:10.466887 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1188/2391] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:44:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:44:10.658330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac852fa-438b-465a-843d-484299e6be52 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:10.658625 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac852fa-438b-465a-843d-484299e6be52 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:10.658903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac852fa-438b-465a-843d-484299e6be52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:10.680122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0ac852fa-438b-465a-843d-484299e6be52 None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:10.681322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0ac852fa-438b-465a-843d-484299e6be52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:10.690560 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1204/2392] 10.222.0.33 () {58 vars in 967 bytes} [Wed Jul 6 20:44:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:44:10.703836 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464a2f4-c7f2-4651-beb8-f32d8f4ffd27 service swift] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:10.722248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464a2f4-c7f2-4651-beb8-f32d8f4ffd27 service swift] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:10.727636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ad2fe-ffb0-45a8-b43d-d54881bda0f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:10.728410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ad2fe-ffb0-45a8-b43d-d54881bda0f9 service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:10.728762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ad2fe-ffb0-45a8-b43d-d54881bda0f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:10.729115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ad2fe-ffb0-45a8-b43d-d54881bda0f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:10.738855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ad2fe-ffb0-45a8-b43d-d54881bda0f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:10.741001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ad2fe-ffb0-45a8-b43d-d54881bda0f9 service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:10.751785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1189/2393] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:44:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:44:11.319939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dab555-ebca-4df8-aba3-154c1666d1df None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:11.320353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dab555-ebca-4df8-aba3-154c1666d1df None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:11.320741 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dab555-ebca-4df8-aba3-154c1666d1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:11.340701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-04dab555-ebca-4df8-aba3-154c1666d1df None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:11.342115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-04dab555-ebca-4df8-aba3-154c1666d1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:11.350269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1205/2394] 10.222.0.33 () {58 vars in 967 bytes} [Wed Jul 6 20:44:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:44:11.362324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ad2fe-ffb0-45a8-b43d-d54881bda0f9 service swift] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:11.374493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ad2fe-ffb0-45a8-b43d-d54881bda0f9 service swift] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:11.379683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb38fa-3d88-4e1d-a922-42375f2d3afe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:11.380483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb38fa-3d88-4e1d-a922-42375f2d3afe service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:11.380884 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb38fa-3d88-4e1d-a922-42375f2d3afe service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:11.381295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb38fa-3d88-4e1d-a922-42375f2d3afe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:11.391564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb38fa-3d88-4e1d-a922-42375f2d3afe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:11.393965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb38fa-3d88-4e1d-a922-42375f2d3afe service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:11.413670 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1190/2395] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:44:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 20:44:13.001877 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b577a29-f465-4b55-9398-842eeea756e7 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:13.002493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b577a29-f465-4b55-9398-842eeea756e7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:13.002769 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b577a29-f465-4b55-9398-842eeea756e7 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:13.004768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1206/2396] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:44:13.016076 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5db226-fe87-4da0-98fd-1e8dd7d43aa6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:13.016076 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5db226-fe87-4da0-98fd-1e8dd7d43aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:13.016870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5db226-fe87-4da0-98fd-1e8dd7d43aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:13.086425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7d5db226-fe87-4da0-98fd-1e8dd7d43aa6 None None] MFA Rules not processed for user `b98059ebef5d470db684fb78d19a8839`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:13.088143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7d5db226-fe87-4da0-98fd-1e8dd7d43aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:13.126808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b577a29-f465-4b55-9398-842eeea756e7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:13.128827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1b577a29-f465-4b55-9398-842eeea756e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:13.182187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1191/2397] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:44:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:44:13.195330 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5db226-fe87-4da0-98fd-1e8dd7d43aa6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:13.196563 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7d5db226-fe87-4da0-98fd-1e8dd7d43aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:13.210306 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5db226-fe87-4da0-98fd-1e8dd7d43aa6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:13.215902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bda377-f02b-476b-9555-e490c873d08d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98059ebef5d470db684fb78d19a8839', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:13.216452 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bda377-f02b-476b-9555-e490c873d08d service placement] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:13.216734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bda377-f02b-476b-9555-e490c873d08d service placement] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:13.217013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bda377-f02b-476b-9555-e490c873d08d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:13.225846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bda377-f02b-476b-9555-e490c873d08d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:13.227441 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bda377-f02b-476b-9555-e490c873d08d service placement] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:13.238068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1192/2398] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:44:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:44:13.245349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b577a29-f465-4b55-9398-842eeea756e7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:13.250781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24be29-e338-47fc-8436-23d756d00032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:13.251521 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24be29-e338-47fc-8436-23d756d00032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:13.251806 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24be29-e338-47fc-8436-23d756d00032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:13.252198 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24be29-e338-47fc-8436-23d756d00032 admin admin] PATH_INFO: `/v3/users/20391809bbeb425e9cac6f73640ae022` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:13.253600 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24be29-e338-47fc-8436-23d756d00032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20391809bbeb425e9cac6f73640ae022)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:13.255585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24be29-e338-47fc-8436-23d756d00032 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:13.302456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8d24be29-e338-47fc-8436-23d756d00032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20391809bbeb425e9cac6f73640ae022'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:13.309853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8d24be29-e338-47fc-8436-23d756d00032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20391809bbeb425e9cac6f73640ae022'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:13.317047 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8d24be29-e338-47fc-8436-23d756d00032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20391809bbeb425e9cac6f73640ae022'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:13.317690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8d24be29-e338-47fc-8436-23d756d00032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20391809bbeb425e9cac6f73640ae022'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:13.329912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8d24be29-e338-47fc-8436-23d756d00032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20391809bbeb425e9cac6f73640ae022'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:13.335770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1207/2399] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:44:13 2022] DELETE /identity/v3/users/20391809bbeb425e9cac6f73640ae022 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:44:13.552433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bda377-f02b-476b-9555-e490c873d08d service placement] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:13.564664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bda377-f02b-476b-9555-e490c873d08d service placement] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:13.602000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:44:13.631590 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:13.632520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:13.632803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:13.633093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] PATH_INFO: `/v3/projects/5cd904b4315a479a83d3a38b46519764` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:13.634389 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd904b4315a479a83d3a38b46519764)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:13.636385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:13.686616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd904b4315a479a83d3a38b46519764', 'request_id': 'req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:13.694906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd904b4315a479a83d3a38b46519764', 'request_id': 'req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:13.701967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd904b4315a479a83d3a38b46519764', 'request_id': 'req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:13.713561 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] The token cache is being invalidate because project 5cd904b4315a479a83d3a38b46519764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:44:13.713884 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:13.714608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:13.716971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1193/2400] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:44:13 2022] DELETE /identity/v3/projects/5cd904b4315a479a83d3a38b46519764 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:44:13.721965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5a3eb-d37a-4d95-b463-aa84af00f6fc None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:13.722259 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5a3eb-d37a-4d95-b463-aa84af00f6fc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:13.722542 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5a3eb-d37a-4d95-b463-aa84af00f6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:13.734652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:44:13.771696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d4d5a3eb-d37a-4d95-b463-aa84af00f6fc None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:13.772943 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d4d5a3eb-d37a-4d95-b463-aa84af00f6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:13.818483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:13.820854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:13.841865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1208/2401] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:44:13.849713 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4f90d-901a-4aaa-ad7b-f88d572d585d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:13.850011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4f90d-901a-4aaa-ad7b-f88d572d585d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:13.850274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4f90d-901a-4aaa-ad7b-f88d572d585d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:13.870328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6aa4f90d-901a-4aaa-ad7b-f88d572d585d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:13.871646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6aa4f90d-901a-4aaa-ad7b-f88d572d585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:13.883460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1209/2402] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:44:13.884503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4f90d-901a-4aaa-ad7b-f88d572d585d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:13.894636 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4f90d-901a-4aaa-ad7b-f88d572d585d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:13.896836 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bf299-fbac-4df7-9acc-8dc7ac7ec8e3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:13.899777 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94aa02-d0fd-43e7-acdc-e578f883ff34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:13.900516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94aa02-d0fd-43e7-acdc-e578f883ff34 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:13.900866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94aa02-d0fd-43e7-acdc-e578f883ff34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:13.901365 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94aa02-d0fd-43e7-acdc-e578f883ff34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:13.901565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2ef80-6942-4629-9a81-1dda1b555a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:13.902246 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94aa02-d0fd-43e7-acdc-e578f883ff34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:44:13.902430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2ef80-6942-4629-9a81-1dda1b555a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:13.902688 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94aa02-d0fd-43e7-acdc-e578f883ff34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:13.902786 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2ef80-6942-4629-9a81-1dda1b555a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:13.902973 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2ef80-6942-4629-9a81-1dda1b555a0d admin admin] PATH_INFO: `/v3/users/06b07d2f273d433ca9fe9ba86672b5a5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:13.905079 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94aa02-d0fd-43e7-acdc-e578f883ff34 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:13.905232 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2ef80-6942-4629-9a81-1dda1b555a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b07d2f273d433ca9fe9ba86672b5a5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:13.907021 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2ef80-6942-4629-9a81-1dda1b555a0d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:13.919213 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1210/2403] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:44:13.922122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94aa02-d0fd-43e7-acdc-e578f883ff34 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:13.935030 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94aa02-d0fd-43e7-acdc-e578f883ff34 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:13.940307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8695877-bec2-4ca8-9030-09ae2259174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:13.940976 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8695877-bec2-4ca8-9030-09ae2259174e admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:13.941302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8695877-bec2-4ca8-9030-09ae2259174e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:13.941573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8695877-bec2-4ca8-9030-09ae2259174e admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:13.942320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8695877-bec2-4ca8-9030-09ae2259174e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:13.944377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8695877-bec2-4ca8-9030-09ae2259174e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:13.959975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1bc2ef80-6942-4629-9a81-1dda1b555a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b07d2f273d433ca9fe9ba86672b5a5'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:13.960620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1bc2ef80-6942-4629-9a81-1dda1b555a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b07d2f273d433ca9fe9ba86672b5a5'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:13.973306 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1211/2404] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:44:13 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:44:13.977144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8695877-bec2-4ca8-9030-09ae2259174e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:13.978783 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c8695877-bec2-4ca8-9030-09ae2259174e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:13.980269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1bc2ef80-6942-4629-9a81-1dda1b555a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b07d2f273d433ca9fe9ba86672b5a5'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:13.983525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:44:13.990966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1bc2ef80-6942-4629-9a81-1dda1b555a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b07d2f273d433ca9fe9ba86672b5a5'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:14.000687 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1bc2ef80-6942-4629-9a81-1dda1b555a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b07d2f273d433ca9fe9ba86672b5a5'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:14.007455 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1194/2405] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:44:13 2022] DELETE /identity/v3/users/06b07d2f273d433ca9fe9ba86672b5a5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:44:14.011812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b7a21-a792-48e0-b0a2-e1045a900b36 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:14.012148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b7a21-a792-48e0-b0a2-e1045a900b36 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:14.012923 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b7a21-a792-48e0-b0a2-e1045a900b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:14.029833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1a5b7a21-a792-48e0-b0a2-e1045a900b36 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:14.031030 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1a5b7a21-a792-48e0-b0a2-e1045a900b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:14.048593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8695877-bec2-4ca8-9030-09ae2259174e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:14.089700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1195/2406] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:44:14.096182 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:44:14.100303 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b7a21-a792-48e0-b0a2-e1045a900b36 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:14.101826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1a5b7a21-a792-48e0-b0a2-e1045a900b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:14.106861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a498a61-1d21-4802-b60c-add5a919f581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:14.107947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a498a61-1d21-4802-b60c-add5a919f581 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:14.108233 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a498a61-1d21-4802-b60c-add5a919f581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:14.108511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a498a61-1d21-4802-b60c-add5a919f581 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:14.109195 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a498a61-1d21-4802-b60c-add5a919f581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:14.111109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a498a61-1d21-4802-b60c-add5a919f581 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:14.132514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1212/2407] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:44:13 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:44:14.136136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a498a61-1d21-4802-b60c-add5a919f581 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:14.146793 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a498a61-1d21-4802-b60c-add5a919f581 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:14.152050 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5f7a7-2de2-4c14-bc5e-69050d4869f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:14.152765 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5f7a7-2de2-4c14-bc5e-69050d4869f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:14.153618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5f7a7-2de2-4c14-bc5e-69050d4869f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:14.153903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5f7a7-2de2-4c14-bc5e-69050d4869f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:14.154623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5f7a7-2de2-4c14-bc5e-69050d4869f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:14.156374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5f7a7-2de2-4c14-bc5e-69050d4869f2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:14.161932 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b7a21-a792-48e0-b0a2-e1045a900b36 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:14.165553 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56845cd7-b921-4d89-a795-11b4cdae6af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:14.166199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56845cd7-b921-4d89-a795-11b4cdae6af8 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:14.166556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1213/2408] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:44:14.166669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56845cd7-b921-4d89-a795-11b4cdae6af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:14.166776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56845cd7-b921-4d89-a795-11b4cdae6af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:14.170489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5f7a7-2de2-4c14-bc5e-69050d4869f2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:14.176891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56845cd7-b921-4d89-a795-11b4cdae6af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:14.178321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56845cd7-b921-4d89-a795-11b4cdae6af8 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:14.179667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5f7a7-2de2-4c14-bc5e-69050d4869f2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:14.184178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8754a-4890-4d6c-a8aa-86c8017bbc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:14.185510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8754a-4890-4d6c-a8aa-86c8017bbc46 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:14.185773 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8754a-4890-4d6c-a8aa-86c8017bbc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:14.186050 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8754a-4890-4d6c-a8aa-86c8017bbc46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:14.186784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8754a-4890-4d6c-a8aa-86c8017bbc46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:14.188383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8754a-4890-4d6c-a8aa-86c8017bbc46 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:14.189012 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1196/2409] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:44:14.199231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1214/2410] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:44:14.204053 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56845cd7-b921-4d89-a795-11b4cdae6af8 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:14.214676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56845cd7-b921-4d89-a795-11b4cdae6af8 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:14.220739 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680d48a-c3a9-45c8-8339-08b6ef7f23de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:14.221632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680d48a-c3a9-45c8-8339-08b6ef7f23de admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:14.221918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680d48a-c3a9-45c8-8339-08b6ef7f23de admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:14.222198 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680d48a-c3a9-45c8-8339-08b6ef7f23de admin admin] PATH_INFO: `/v3/projects/7f468fb3506943a389342533ca136001/users/3304760bf5e344b8840a28189b79c0fb/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:14.240468 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680d48a-c3a9-45c8-8339-08b6ef7f23de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f468fb3506943a389342533ca136001, user_id=3304760bf5e344b8840a28189b79c0fb, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:14.243191 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680d48a-c3a9-45c8-8339-08b6ef7f23de admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:14.267290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1197/2411] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:44:14 2022] PUT /identity/v3/projects/7f468fb3506943a389342533ca136001/users/3304760bf5e344b8840a28189b79c0fb/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:44:14.274424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a71092-9c02-4c13-9f44-efe4607e4dca None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:14.274715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a71092-9c02-4c13-9f44-efe4607e4dca None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:14.274993 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a71092-9c02-4c13-9f44-efe4607e4dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:14.303037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d3a71092-9c02-4c13-9f44-efe4607e4dca None None] MFA Rules not processed for user `3304760bf5e344b8840a28189b79c0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:14.304299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d3a71092-9c02-4c13-9f44-efe4607e4dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:14.371694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1215/2412] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:44:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:44:14.383646 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680d48a-c3a9-45c8-8339-08b6ef7f23de admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:14.385464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0680d48a-c3a9-45c8-8339-08b6ef7f23de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:14.449629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680d48a-c3a9-45c8-8339-08b6ef7f23de admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:14.455087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f730a99-c85c-4f53-8d12-77c7e6dd1307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:14.455804 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f730a99-c85c-4f53-8d12-77c7e6dd1307 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:14.456092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f730a99-c85c-4f53-8d12-77c7e6dd1307 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:14.456370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f730a99-c85c-4f53-8d12-77c7e6dd1307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:14.461990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a71092-9c02-4c13-9f44-efe4607e4dca None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:14.463587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d3a71092-9c02-4c13-9f44-efe4607e4dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:14.471408 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f730a99-c85c-4f53-8d12-77c7e6dd1307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:14.472856 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f730a99-c85c-4f53-8d12-77c7e6dd1307 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:14.483161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1198/2413] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:44:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:44:14.543700 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a71092-9c02-4c13-9f44-efe4607e4dca None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:14.549015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:14.549884 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:14.550179 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:14.550463 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] PATH_INFO: `/v3/projects/140222cc9b384d6cbd95e996265c6fd1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:14.551690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=140222cc9b384d6cbd95e996265c6fd1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:14.553628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:14.609055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140222cc9b384d6cbd95e996265c6fd1', 'request_id': 'req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:14.611222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:44:14.616478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140222cc9b384d6cbd95e996265c6fd1', 'request_id': 'req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:14.626197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140222cc9b384d6cbd95e996265c6fd1', 'request_id': 'req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:14.639002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] The token cache is being invalidate because project 140222cc9b384d6cbd95e996265c6fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:44:14.639378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:14.639982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:14.641543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1216/2414] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:44:14 2022] DELETE /identity/v3/projects/140222cc9b384d6cbd95e996265c6fd1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:44:21.552552 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0358ab-4321-4051-ad8c-7c75310533b8 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:21.553036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0358ab-4321-4051-ad8c-7c75310533b8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:21.553233 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0358ab-4321-4051-ad8c-7c75310533b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:21.569196 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:44:21.584768 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9c0358ab-4321-4051-ad8c-7c75310533b8 None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:21.588010 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9c0358ab-4321-4051-ad8c-7c75310533b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:21.693633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1199/2415] 10.222.0.33 () {58 vars in 967 bytes} [Wed Jul 6 20:44:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:44:21.710210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:21.711704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:21.833573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65f96-99c1-4d9c-a6d0-e1f885a5a930 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:21.839686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90536113-ce62-4f0e-a93f-22a1267f938c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:21.840336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90536113-ce62-4f0e-a93f-22a1267f938c service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:21.840617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90536113-ce62-4f0e-a93f-22a1267f938c service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:21.840890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90536113-ce62-4f0e-a93f-22a1267f938c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:21.850286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90536113-ce62-4f0e-a93f-22a1267f938c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:21.851946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90536113-ce62-4f0e-a93f-22a1267f938c service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:21.861134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1217/2416] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:44:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 20:44:24.675311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0358ab-4321-4051-ad8c-7c75310533b8 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:24.676725 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9c0358ab-4321-4051-ad8c-7c75310533b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:24.741400 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0358ab-4321-4051-ad8c-7c75310533b8 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:24.745781 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452171e3-f015-4319-b557-f9694484210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:24.746639 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452171e3-f015-4319-b557-f9694484210e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:24.746920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452171e3-f015-4319-b557-f9694484210e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:24.747212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452171e3-f015-4319-b557-f9694484210e admin admin] PATH_INFO: `/v3/users/3304760bf5e344b8840a28189b79c0fb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:24.748398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452171e3-f015-4319-b557-f9694484210e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3304760bf5e344b8840a28189b79c0fb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:24.750800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452171e3-f015-4319-b557-f9694484210e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:24.796883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-452171e3-f015-4319-b557-f9694484210e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3304760bf5e344b8840a28189b79c0fb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:24.797533 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-452171e3-f015-4319-b557-f9694484210e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3304760bf5e344b8840a28189b79c0fb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:24.809518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-452171e3-f015-4319-b557-f9694484210e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3304760bf5e344b8840a28189b79c0fb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:24.817276 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-452171e3-f015-4319-b557-f9694484210e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3304760bf5e344b8840a28189b79c0fb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:24.824056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-452171e3-f015-4319-b557-f9694484210e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3304760bf5e344b8840a28189b79c0fb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:24.830690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1200/2417] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:44:24 2022] DELETE /identity/v3/users/3304760bf5e344b8840a28189b79c0fb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:44:24.835133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf8563-013a-4718-a60f-9b9d3f050425 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:24.835670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf8563-013a-4718-a60f-9b9d3f050425 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:24.835768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf8563-013a-4718-a60f-9b9d3f050425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:24.852901 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3edf8563-013a-4718-a60f-9b9d3f050425 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:24.854120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3edf8563-013a-4718-a60f-9b9d3f050425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:24.914515 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1218/2418] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:44:24.925755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452171e3-f015-4319-b557-f9694484210e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:24.927493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-452171e3-f015-4319-b557-f9694484210e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:24.962921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:44:24.989781 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452171e3-f015-4319-b557-f9694484210e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:24.993487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bee5a-20a4-4548-9ddf-ae7a34d0ea67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:24.994063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bee5a-20a4-4548-9ddf-ae7a34d0ea67 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:24.994343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bee5a-20a4-4548-9ddf-ae7a34d0ea67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:24.994616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bee5a-20a4-4548-9ddf-ae7a34d0ea67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:25.004094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bee5a-20a4-4548-9ddf-ae7a34d0ea67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:25.005543 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bee5a-20a4-4548-9ddf-ae7a34d0ea67 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:25.015056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1201/2419] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:44:25.282903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf8563-013a-4718-a60f-9b9d3f050425 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:44:25.284517 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3edf8563-013a-4718-a60f-9b9d3f050425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:25.297797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf8563-013a-4718-a60f-9b9d3f050425 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:44:25.302376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d91b42-5b15-48b4-8d75-897109a9731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:44:25.303302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91b42-5b15-48b4-8d75-897109a9731e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:25.303587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91b42-5b15-48b4-8d75-897109a9731e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:25.303859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91b42-5b15-48b4-8d75-897109a9731e admin admin] PATH_INFO: `/v3/projects/7f468fb3506943a389342533ca136001` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:25.305039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d91b42-5b15-48b4-8d75-897109a9731e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f468fb3506943a389342533ca136001)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:44:25.306949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d91b42-5b15-48b4-8d75-897109a9731e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:44:25.359710 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-36d91b42-5b15-48b4-8d75-897109a9731e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f468fb3506943a389342533ca136001', 'request_id': 'req-36d91b42-5b15-48b4-8d75-897109a9731e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:25.365952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-36d91b42-5b15-48b4-8d75-897109a9731e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f468fb3506943a389342533ca136001', 'request_id': 'req-36d91b42-5b15-48b4-8d75-897109a9731e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:25.373590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-36d91b42-5b15-48b4-8d75-897109a9731e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f468fb3506943a389342533ca136001', 'request_id': 'req-36d91b42-5b15-48b4-8d75-897109a9731e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:25.377868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:44:25.388466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-36d91b42-5b15-48b4-8d75-897109a9731e admin admin] The token cache is being invalidate because project 7f468fb3506943a389342533ca136001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:44:25.388831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-36d91b42-5b15-48b4-8d75-897109a9731e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:25.389825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-36d91b42-5b15-48b4-8d75-897109a9731e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:44:25.391653 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1219/2420] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:44:25 2022] DELETE /identity/v3/projects/7f468fb3506943a389342533ca136001 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:44:28.075069 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf3d2f-201d-4d20-93fe-d209bd87e3cb None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:28.075597 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf3d2f-201d-4d20-93fe-d209bd87e3cb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:28.075705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf3d2f-201d-4d20-93fe-d209bd87e3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:28.092553 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4baf3d2f-201d-4d20-93fe-d209bd87e3cb None None] MFA Rules not processed for user `be198c485fde404095bb2db07a06d5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:28.093817 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4baf3d2f-201d-4d20-93fe-d209bd87e3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:28.150431 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1202/2421] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:44:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:44:33.967716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95cfe8-2ce2-46a0-a320-684fb54cb731 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:44:33.968209 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95cfe8-2ce2-46a0-a320-684fb54cb731 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:44:33.968328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95cfe8-2ce2-46a0-a320-684fb54cb731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:44:33.986487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ba95cfe8-2ce2-46a0-a320-684fb54cb731 None None] MFA Rules not processed for user `fb6987f34f174552bab9495f3d50ee45`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:44:33.987795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ba95cfe8-2ce2-46a0-a320-684fb54cb731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:44:34.046043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1220/2422] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:44:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:44:38.143272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=40 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:44:44.037739 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=1,keystone:SELECT=27 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:45:08.452300 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf3d2f-201d-4d20-93fe-d209bd87e3cb None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:45:08.453786 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4baf3d2f-201d-4d20-93fe-d209bd87e3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:45:08.527399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf3d2f-201d-4d20-93fe-d209bd87e3cb None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:45:08.532860 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8142437-791c-4888-a50e-965c5950794e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98059ebef5d470db684fb78d19a8839', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:45:08.533516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8142437-791c-4888-a50e-965c5950794e service placement] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:45:08.533796 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8142437-791c-4888-a50e-965c5950794e service placement] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:45:08.534073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8142437-791c-4888-a50e-965c5950794e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:45:08.535989 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b8142437-791c-4888-a50e-965c5950794e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:45:08.549807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8142437-791c-4888-a50e-965c5950794e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:45:08.551425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8142437-791c-4888-a50e-965c5950794e service placement] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:45:08.565906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1203/2423] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:45:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:45:11.581007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6449d91-c6c0-44ef-901e-66afb8a92f55 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:45:11.581511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6449d91-c6c0-44ef-901e-66afb8a92f55 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:45:11.581613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6449d91-c6c0-44ef-901e-66afb8a92f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:45:11.600300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d6449d91-c6c0-44ef-901e-66afb8a92f55 None None] MFA Rules not processed for user `e651c2917c75425fb656dfb145a5bc4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:45:11.601509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d6449d91-c6c0-44ef-901e-66afb8a92f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:45:11.655714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1221/2424] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:45:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:45:18.557275 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=32 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:45:21.648154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=25 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:45:43.160356 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701aae0-3805-4c26-8282-95d1983d4d62 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:45:43.160812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701aae0-3805-4c26-8282-95d1983d4d62 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:45:43.160918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701aae0-3805-4c26-8282-95d1983d4d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:45:43.210322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2701aae0-3805-4c26-8282-95d1983d4d62 None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:45:43.211502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2701aae0-3805-4c26-8282-95d1983d4d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:45:43.276733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1204/2425] 10.222.0.33 () {58 vars in 967 bytes} [Wed Jul 6 20:45:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:45:43.324412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6449d91-c6c0-44ef-901e-66afb8a92f55 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:45:43.325842 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d6449d91-c6c0-44ef-901e-66afb8a92f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:45:43.430842 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6449d91-c6c0-44ef-901e-66afb8a92f55 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:45:43.435972 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cf33a-751e-42df-af7d-c45b510987ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:45:43.436661 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cf33a-751e-42df-af7d-c45b510987ec service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:45:43.436988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cf33a-751e-42df-af7d-c45b510987ec service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:45:43.437277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cf33a-751e-42df-af7d-c45b510987ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:45:43.445770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cf33a-751e-42df-af7d-c45b510987ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:45:43.447416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cf33a-751e-42df-af7d-c45b510987ec service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:45:43.457343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1222/2426] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:45:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:45:45.944635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552171fe-b51a-4190-92b8-6a98f8db45ce None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:45:45.945507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552171fe-b51a-4190-92b8-6a98f8db45ce None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:45:45.945987 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552171fe-b51a-4190-92b8-6a98f8db45ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:45:45.968174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-552171fe-b51a-4190-92b8-6a98f8db45ce None None] MFA Rules not processed for user `fb6987f34f174552bab9495f3d50ee45`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:45:45.969893 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-552171fe-b51a-4190-92b8-6a98f8db45ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:45:45.979224 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1205/2427] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:45:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:45:48.558868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa33a0-fbe0-475e-af81-5692cfee0541 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:45:48.559415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa33a0-fbe0-475e-af81-5692cfee0541 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:45:48.559680 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa33a0-fbe0-475e-af81-5692cfee0541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:45:48.586994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6eaa33a0-fbe0-475e-af81-5692cfee0541 None None] MFA Rules not processed for user `be198c485fde404095bb2db07a06d5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:45:48.588257 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6eaa33a0-fbe0-475e-af81-5692cfee0541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:45:48.597089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1223/2428] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:45:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:45:53.046549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552171fe-b51a-4190-92b8-6a98f8db45ce None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:45:53.048000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-552171fe-b51a-4190-92b8-6a98f8db45ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:45:53.112551 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552171fe-b51a-4190-92b8-6a98f8db45ce None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:45:53.117024 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:45:53.117895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:45:53.118175 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:45:53.118450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] PATH_INFO: `/v3/users/9944667e98934d41aa374f4837ade695` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:45:53.119715 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9944667e98934d41aa374f4837ade695)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:45:53.121642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:45:53.168357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9944667e98934d41aa374f4837ade695'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.169047 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9944667e98934d41aa374f4837ade695'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.182159 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9944667e98934d41aa374f4837ade695'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.185184 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:45:53.196457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9944667e98934d41aa374f4837ade695'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.204866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9944667e98934d41aa374f4837ade695'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.210779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1206/2429] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:45:53 2022] DELETE /identity/v3/users/9944667e98934d41aa374f4837ade695 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:45:53.489461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa33a0-fbe0-475e-af81-5692cfee0541 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:45:53.501154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa33a0-fbe0-475e-af81-5692cfee0541 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:45:53.572914 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:45:53.573777 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:45:53.574076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:45:53.574335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] PATH_INFO: `/v3/projects/3f4952355c424ca3b1c0433d06b0673b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:45:53.575543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4952355c424ca3b1c0433d06b0673b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:45:53.578096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:45:53.627398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4952355c424ca3b1c0433d06b0673b', 'request_id': 'req-ce17fc13-78d0-4814-a976-3389df3ab844'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.633455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4952355c424ca3b1c0433d06b0673b', 'request_id': 'req-ce17fc13-78d0-4814-a976-3389df3ab844'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.641332 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4952355c424ca3b1c0433d06b0673b', 'request_id': 'req-ce17fc13-78d0-4814-a976-3389df3ab844'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.646453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:45:53.656029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] The token cache is being invalidate because project 3f4952355c424ca3b1c0433d06b0673b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:45:53.656572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.657680 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.659870 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1224/2430] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:45:53 2022] DELETE /identity/v3/projects/3f4952355c424ca3b1c0433d06b0673b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:45:53.663465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:45:53.664889 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:45:53.678094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f61092-b5a7-4c3d-9c51-f01eb6f5cbfe admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:45:53.738113 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4a133-34c1-4316-9dcf-5172998d14c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:45:53.738913 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4a133-34c1-4316-9dcf-5172998d14c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:45:53.739222 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4a133-34c1-4316-9dcf-5172998d14c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:45:53.739506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4a133-34c1-4316-9dcf-5172998d14c5 admin admin] PATH_INFO: `/v3/users/77af14475af84082bae70ebb9e895193` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:45:53.740715 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4a133-34c1-4316-9dcf-5172998d14c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77af14475af84082bae70ebb9e895193)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:45:53.742672 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4a133-34c1-4316-9dcf-5172998d14c5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:45:53.793107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cfc4a133-34c1-4316-9dcf-5172998d14c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77af14475af84082bae70ebb9e895193'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.793780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cfc4a133-34c1-4316-9dcf-5172998d14c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77af14475af84082bae70ebb9e895193'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.808717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cfc4a133-34c1-4316-9dcf-5172998d14c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77af14475af84082bae70ebb9e895193'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.818277 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cfc4a133-34c1-4316-9dcf-5172998d14c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77af14475af84082bae70ebb9e895193'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.827038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cfc4a133-34c1-4316-9dcf-5172998d14c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77af14475af84082bae70ebb9e895193'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:53.841313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1207/2431] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:45:53 2022] DELETE /identity/v3/users/77af14475af84082bae70ebb9e895193 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:45:54.300207 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:45:54.302228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:45:54.319393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17fc13-78d0-4814-a976-3389df3ab844 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:45:54.397796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:45:54.400027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:45:54.400575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:45:54.401316 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] PATH_INFO: `/v3/projects/aa49378ed758445c98b2ed64114d9de0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:45:54.403217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa49378ed758445c98b2ed64114d9de0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:45:54.407579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:45:54.468617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa49378ed758445c98b2ed64114d9de0', 'request_id': 'req-c56d7765-4c59-4613-a4af-bec067e18f68'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:54.475264 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa49378ed758445c98b2ed64114d9de0', 'request_id': 'req-c56d7765-4c59-4613-a4af-bec067e18f68'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:54.484531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa49378ed758445c98b2ed64114d9de0', 'request_id': 'req-c56d7765-4c59-4613-a4af-bec067e18f68'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:54.497825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] The token cache is being invalidate because project aa49378ed758445c98b2ed64114d9de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:45:54.498563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:54.499884 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:45:54.503237 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1225/2432] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:45:54 2022] DELETE /identity/v3/projects/aa49378ed758445c98b2ed64114d9de0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:46:03.831565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=11,keystone:SELECT=59,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:46:04.496958 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=8,keystone:SELECT=53,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:46:23.350076 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b448f09-6954-4cd5-8690-e9ca2a79c4e9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:23.350583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b448f09-6954-4cd5-8690-e9ca2a79c4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:23.350681 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b448f09-6954-4cd5-8690-e9ca2a79c4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:23.369058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2b448f09-6954-4cd5-8690-e9ca2a79c4e9 None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:46:23.370331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2b448f09-6954-4cd5-8690-e9ca2a79c4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:23.427364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1208/2433] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:46:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:46:23.440009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:46:23.441474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:23.510746 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d7765-4c59-4613-a4af-bec067e18f68 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:46:23.516412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35ff20-87b9-461e-9876-a16e20b83227 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:46:23.517130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35ff20-87b9-461e-9876-a16e20b83227 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:23.517413 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35ff20-87b9-461e-9876-a16e20b83227 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:23.517684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35ff20-87b9-461e-9876-a16e20b83227 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:23.525923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35ff20-87b9-461e-9876-a16e20b83227 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:46:23.527612 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35ff20-87b9-461e-9876-a16e20b83227 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:46:23.535950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1226/2434] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:46:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:46:30.939705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b448f09-6954-4cd5-8690-e9ca2a79c4e9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:46:30.942281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2b448f09-6954-4cd5-8690-e9ca2a79c4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:31.019365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b448f09-6954-4cd5-8690-e9ca2a79c4e9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:46:31.022988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80f8f8-2023-4f41-8558-2abf0d42d303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:46:31.023940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80f8f8-2023-4f41-8558-2abf0d42d303 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:31.024232 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80f8f8-2023-4f41-8558-2abf0d42d303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:31.025039 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80f8f8-2023-4f41-8558-2abf0d42d303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:31.028247 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8e80f8f8-2023-4f41-8558-2abf0d42d303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:31.137097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80f8f8-2023-4f41-8558-2abf0d42d303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:46:31.138554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80f8f8-2023-4f41-8558-2abf0d42d303 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:46:31.166405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1209/2435] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:46:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:46:32.518301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35ff20-87b9-461e-9876-a16e20b83227 service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:46:32.520460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7b35ff20-87b9-461e-9876-a16e20b83227 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:32.538144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35ff20-87b9-461e-9876-a16e20b83227 service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:46:32.542155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f0bab-a1b2-4f25-9d11-a3282fb64430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:46:32.542949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f0bab-a1b2-4f25-9d11-a3282fb64430 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:32.543415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f0bab-a1b2-4f25-9d11-a3282fb64430 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:32.543768 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f0bab-a1b2-4f25-9d11-a3282fb64430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:32.545673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-594f0bab-a1b2-4f25-9d11-a3282fb64430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:32.561399 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f0bab-a1b2-4f25-9d11-a3282fb64430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:46:32.563571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f0bab-a1b2-4f25-9d11-a3282fb64430 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:46:32.576488 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1227/2436] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:46:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:46:37.404765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f36a8-4dd6-4de4-b1a5-5fc54d685bc9 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:37.405369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f36a8-4dd6-4de4-b1a5-5fc54d685bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:37.405369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f36a8-4dd6-4de4-b1a5-5fc54d685bc9 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:37.407524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1210/2437] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:46:37.414274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cadebe-6cca-406f-a35e-a59993fa21c3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:37.414763 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cadebe-6cca-406f-a35e-a59993fa21c3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:37.414881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cadebe-6cca-406f-a35e-a59993fa21c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:37.455700 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-21cadebe-6cca-406f-a35e-a59993fa21c3 None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:46:37.456922 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-21cadebe-6cca-406f-a35e-a59993fa21c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:37.466333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1228/2438] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:46:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:46:37.478752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f36a8-4dd6-4de4-b1a5-5fc54d685bc9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:46:37.480622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cf5f36a8-4dd6-4de4-b1a5-5fc54d685bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:37.513877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:46:37.565155 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f36a8-4dd6-4de4-b1a5-5fc54d685bc9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:46:37.568773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb2d39-7b8c-4348-8a0d-022921c46664 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f892e618b01a46aaaab4f79aa0c3daa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:46:37.569414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb2d39-7b8c-4348-8a0d-022921c46664 service glance] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:37.569693 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb2d39-7b8c-4348-8a0d-022921c46664 service glance] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:37.569969 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb2d39-7b8c-4348-8a0d-022921c46664 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:37.581113 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb2d39-7b8c-4348-8a0d-022921c46664 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:46:37.582591 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb2d39-7b8c-4348-8a0d-022921c46664 service glance] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:46:37.595784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1211/2439] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:46:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:46:37.664130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f08048-f53d-40f4-842c-8d433b84af20 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:37.664609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f08048-f53d-40f4-842c-8d433b84af20 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:37.664959 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f08048-f53d-40f4-842c-8d433b84af20 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:37.666601 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1229/2440] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:46:37.672679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c30db2-796f-46d6-b9a0-730600f3bd7f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:37.672968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c30db2-796f-46d6-b9a0-730600f3bd7f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:37.673248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c30db2-796f-46d6-b9a0-730600f3bd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:37.692735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d5c30db2-796f-46d6-b9a0-730600f3bd7f None None] MFA Rules not processed for user `d7bb4a244df24a19b4c3ad3d1ad2bc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:46:37.694002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d5c30db2-796f-46d6-b9a0-730600f3bd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:37.701853 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1212/2441] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:46:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:46:37.714122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f08048-f53d-40f4-842c-8d433b84af20 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:46:37.726791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f08048-f53d-40f4-842c-8d433b84af20 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:46:37.730357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd05cf1-819b-4e25-8ba3-9232707516ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:46:37.730997 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd05cf1-819b-4e25-8ba3-9232707516ab service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:37.731354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd05cf1-819b-4e25-8ba3-9232707516ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:37.731640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd05cf1-819b-4e25-8ba3-9232707516ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:37.741256 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd05cf1-819b-4e25-8ba3-9232707516ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:46:37.742706 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd05cf1-819b-4e25-8ba3-9232707516ab service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:46:37.752000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1230/2442] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:46:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:46:37.845953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da483c4a-f5a5-4843-9352-d22d847256a7 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:37.846247 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da483c4a-f5a5-4843-9352-d22d847256a7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:37.846529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da483c4a-f5a5-4843-9352-d22d847256a7 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:37.848056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1213/2443] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jul 6 20:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 20:46:37.853762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29778dc9-280d-40ce-a3e8-7fbcb75f44c7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:37.854055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29778dc9-280d-40ce-a3e8-7fbcb75f44c7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:37.854329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29778dc9-280d-40ce-a3e8-7fbcb75f44c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:37.876012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-29778dc9-280d-40ce-a3e8-7fbcb75f44c7 None None] MFA Rules not processed for user `3d68c8fdb65343b8b2f58070addeaf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:46:37.877858 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-29778dc9-280d-40ce-a3e8-7fbcb75f44c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:37.892165 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1231/2444] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jul 6 20:46:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:46:37.903974 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da483c4a-f5a5-4843-9352-d22d847256a7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:46:37.923706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da483c4a-f5a5-4843-9352-d22d847256a7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:46:37.928057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501800c-b973-4127-8715-37837a99b03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:46:37.929345 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501800c-b973-4127-8715-37837a99b03a service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:37.929656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501800c-b973-4127-8715-37837a99b03a service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:37.929954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501800c-b973-4127-8715-37837a99b03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:37.947708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501800c-b973-4127-8715-37837a99b03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:46:37.949248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501800c-b973-4127-8715-37837a99b03a service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:46:37.963537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1214/2445] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:46:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:46:42.026293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485e66-7990-454e-ac4f-a2fe6f7aaf1c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:42.026782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485e66-7990-454e-ac4f-a2fe6f7aaf1c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:42.026885 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485e66-7990-454e-ac4f-a2fe6f7aaf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:42.045055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2a485e66-7990-454e-ac4f-a2fe6f7aaf1c None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:46:42.047954 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2a485e66-7990-454e-ac4f-a2fe6f7aaf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:42.055056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1232/2446] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jul 6 20:46:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:46:42.066882 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501800c-b973-4127-8715-37837a99b03a service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:46:42.078396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501800c-b973-4127-8715-37837a99b03a service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:46:42.083536 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba36b6-7a78-4dbf-bd87-71a17f52bc5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:46:42.084180 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba36b6-7a78-4dbf-bd87-71a17f52bc5f service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:42.084576 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba36b6-7a78-4dbf-bd87-71a17f52bc5f service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:42.084881 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba36b6-7a78-4dbf-bd87-71a17f52bc5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:42.094194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba36b6-7a78-4dbf-bd87-71a17f52bc5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:46:42.095830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba36b6-7a78-4dbf-bd87-71a17f52bc5f service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:46:42.104247 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1215/2447] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:46:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:46:44.549087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485e66-7990-454e-ac4f-a2fe6f7aaf1c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:46:44.551618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2a485e66-7990-454e-ac4f-a2fe6f7aaf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:44.569794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=60 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:46:44.578456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485e66-7990-454e-ac4f-a2fe6f7aaf1c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:46:44.588405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d40ae1-5834-4eea-b2ca-1c4eea232992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:46:44.589367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d40ae1-5834-4eea-b2ca-1c4eea232992 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:44.589827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d40ae1-5834-4eea-b2ca-1c4eea232992 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:44.590109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d40ae1-5834-4eea-b2ca-1c4eea232992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:44.609888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-78d40ae1-5834-4eea-b2ca-1c4eea232992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:44.698093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d40ae1-5834-4eea-b2ca-1c4eea232992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:46:44.699863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d40ae1-5834-4eea-b2ca-1c4eea232992 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:46:44.710255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1233/2448] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:46:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:46:44.848251 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba36b6-7a78-4dbf-bd87-71a17f52bc5f service swift] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:46:44.852722 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7fba36b6-7a78-4dbf-bd87-71a17f52bc5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:44.885175 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba36b6-7a78-4dbf-bd87-71a17f52bc5f service swift] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:46:44.901769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749573c-735d-4655-9693-6c5b673c3c2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:46:44.902454 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749573c-735d-4655-9693-6c5b673c3c2d service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:44.902738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749573c-735d-4655-9693-6c5b673c3c2d service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:44.903016 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749573c-735d-4655-9693-6c5b673c3c2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:44.904820 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1749573c-735d-4655-9693-6c5b673c3c2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:44.972295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749573c-735d-4655-9693-6c5b673c3c2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:46:44.973908 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749573c-735d-4655-9693-6c5b673c3c2d service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:46:44.983825 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1216/2449] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:46:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:46:54.705680 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=27 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:46:54.979258 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=66 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:46:57.201587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d40ae1-5834-4eea-b2ca-1c4eea232992 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:46:57.214482 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d40ae1-5834-4eea-b2ca-1c4eea232992 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:46:57.219868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0683c8-ca4a-4b5a-8caf-4870f069645d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:46:57.220815 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0683c8-ca4a-4b5a-8caf-4870f069645d service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:57.221391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0683c8-ca4a-4b5a-8caf-4870f069645d service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:57.221780 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0683c8-ca4a-4b5a-8caf-4870f069645d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:57.224844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fc0683c8-ca4a-4b5a-8caf-4870f069645d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:57.246942 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0683c8-ca4a-4b5a-8caf-4870f069645d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:46:57.248628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0683c8-ca4a-4b5a-8caf-4870f069645d service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:46:57.261037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1234/2450] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:46:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:46:58.611054 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb845796-18d8-412b-a731-ed7826993e54 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:58.611619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb845796-18d8-412b-a731-ed7826993e54 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:58.611619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb845796-18d8-412b-a731-ed7826993e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:58.636902 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cb845796-18d8-412b-a731-ed7826993e54 None None] MFA Rules not processed for user `e1c9cdf941294b4190245ed43d219ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:46:58.638298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cb845796-18d8-412b-a731-ed7826993e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:46:58.647377 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1217/2451] 10.222.0.33 () {58 vars in 967 bytes} [Wed Jul 6 20:46:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:46:58.670449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0683c8-ca4a-4b5a-8caf-4870f069645d service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:46:58.687821 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0683c8-ca4a-4b5a-8caf-4870f069645d service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:46:58.696590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66a760-1411-493c-b8a9-5d9c80afc0e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88dff378ccb4497fb305563614ea4caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:46:58.697415 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66a760-1411-493c-b8a9-5d9c80afc0e7 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:46:58.697645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66a760-1411-493c-b8a9-5d9c80afc0e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:46:58.697927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66a760-1411-493c-b8a9-5d9c80afc0e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:46:58.708060 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66a760-1411-493c-b8a9-5d9c80afc0e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:46:58.709834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66a760-1411-493c-b8a9-5d9c80afc0e7 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:46:58.735601 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1235/2452] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jul 6 20:46:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 20:47:00.746634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb845796-18d8-412b-a731-ed7826993e54 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:00.750583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cb845796-18d8-412b-a731-ed7826993e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:00.822854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb845796-18d8-412b-a731-ed7826993e54 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:00.827985 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073c41d-240f-47ed-ab48-518841371578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:00.828991 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073c41d-240f-47ed-ab48-518841371578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:00.829387 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073c41d-240f-47ed-ab48-518841371578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:00.829669 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073c41d-240f-47ed-ab48-518841371578 admin admin] PATH_INFO: `/v3/users/be198c485fde404095bb2db07a06d5fa` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:00.830855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073c41d-240f-47ed-ab48-518841371578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be198c485fde404095bb2db07a06d5fa)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:00.832808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073c41d-240f-47ed-ab48-518841371578 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:00.878454 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c073c41d-240f-47ed-ab48-518841371578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be198c485fde404095bb2db07a06d5fa'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:00.879103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c073c41d-240f-47ed-ab48-518841371578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be198c485fde404095bb2db07a06d5fa'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:00.890929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c073c41d-240f-47ed-ab48-518841371578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be198c485fde404095bb2db07a06d5fa'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:00.898432 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c073c41d-240f-47ed-ab48-518841371578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be198c485fde404095bb2db07a06d5fa'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:00.905716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c073c41d-240f-47ed-ab48-518841371578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be198c485fde404095bb2db07a06d5fa'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:00.912211 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1218/2453] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:00 2022] DELETE /identity/v3/users/be198c485fde404095bb2db07a06d5fa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:01.076985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66a760-1411-493c-b8a9-5d9c80afc0e7 service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:01.089938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66a760-1411-493c-b8a9-5d9c80afc0e7 service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:01.148151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:01.149020 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:01.149301 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:01.149576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70 admin admin] PATH_INFO: `/v3/projects/b00a05b54ba74f18b1773f28d01fb02c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:01.150763 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00a05b54ba74f18b1773f28d01fb02c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:01.152702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:01.197796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00a05b54ba74f18b1773f28d01fb02c', 'request_id': 'req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:01.204325 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00a05b54ba74f18b1773f28d01fb02c', 'request_id': 'req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:01.210882 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00a05b54ba74f18b1773f28d01fb02c', 'request_id': 'req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:01.221115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70 admin admin] The token cache is being invalidate because project b00a05b54ba74f18b1773f28d01fb02c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:01.221402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:01.222023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6a4ecae-c9d9-4dc5-a2fb-15ff4a8e0b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:01.223578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1236/2454] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:01 2022] DELETE /identity/v3/projects/b00a05b54ba74f18b1773f28d01fb02c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:01.228475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af53dd-bbd0-4afc-a75a-033e326d3811 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:01.228773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af53dd-bbd0-4afc-a75a-033e326d3811 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:01.229059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af53dd-bbd0-4afc-a75a-033e326d3811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:01.247518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-52af53dd-bbd0-4afc-a75a-033e326d3811 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:01.248731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-52af53dd-bbd0-4afc-a75a-033e326d3811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:01.306980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1219/2455] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:01.315827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dca9b6-599e-4e9b-adb6-a8cff43dc3f5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:01.316122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dca9b6-599e-4e9b-adb6-a8cff43dc3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:01.316414 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dca9b6-599e-4e9b-adb6-a8cff43dc3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:01.335072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-25dca9b6-599e-4e9b-adb6-a8cff43dc3f5 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:01.336310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-25dca9b6-599e-4e9b-adb6-a8cff43dc3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:01.344254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1237/2456] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:01.348477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af53dd-bbd0-4afc-a75a-033e326d3811 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:01.359205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af53dd-bbd0-4afc-a75a-033e326d3811 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:01.364044 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff9598-5ab3-41a7-96a9-56c7782bd354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:01.364701 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff9598-5ab3-41a7-96a9-56c7782bd354 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:01.365017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff9598-5ab3-41a7-96a9-56c7782bd354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:01.365301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff9598-5ab3-41a7-96a9-56c7782bd354 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:01.366182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff9598-5ab3-41a7-96a9-56c7782bd354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:47:01.366496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff9598-5ab3-41a7-96a9-56c7782bd354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:01.368124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff9598-5ab3-41a7-96a9-56c7782bd354 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:01.378503 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:01.382751 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1220/2457] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:47:01.387135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dca9b6-599e-4e9b-adb6-a8cff43dc3f5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:01.397150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dca9b6-599e-4e9b-adb6-a8cff43dc3f5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:01.402007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed6115-9e6c-45fe-8b9e-d47ecd901ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:01.402667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed6115-9e6c-45fe-8b9e-d47ecd901ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:01.402954 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed6115-9e6c-45fe-8b9e-d47ecd901ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:01.403270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed6115-9e6c-45fe-8b9e-d47ecd901ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:01.403960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed6115-9e6c-45fe-8b9e-d47ecd901ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:01.406090 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed6115-9e6c-45fe-8b9e-d47ecd901ca9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:01.433225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1238/2458] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:01 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:01.437808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff9598-5ab3-41a7-96a9-56c7782bd354 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:01.448446 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff9598-5ab3-41a7-96a9-56c7782bd354 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:01.504105 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213f12c-f6fb-46ff-b4a2-406718d85e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:01.504765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213f12c-f6fb-46ff-b4a2-406718d85e68 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:01.505049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213f12c-f6fb-46ff-b4a2-406718d85e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:01.505326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213f12c-f6fb-46ff-b4a2-406718d85e68 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:01.506001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213f12c-f6fb-46ff-b4a2-406718d85e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:01.507941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213f12c-f6fb-46ff-b4a2-406718d85e68 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:01.528616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1221/2459] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:01 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:01.532657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed6115-9e6c-45fe-8b9e-d47ecd901ca9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:01.543522 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed6115-9e6c-45fe-8b9e-d47ecd901ca9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:01.548990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe60008-b0b4-4996-a98a-16f1f7921dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:01.549657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe60008-b0b4-4996-a98a-16f1f7921dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:01.549945 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe60008-b0b4-4996-a98a-16f1f7921dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:01.550225 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe60008-b0b4-4996-a98a-16f1f7921dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:01.550953 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe60008-b0b4-4996-a98a-16f1f7921dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:01.552599 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe60008-b0b4-4996-a98a-16f1f7921dd4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:01.563844 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1239/2460] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:01.568125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213f12c-f6fb-46ff-b4a2-406718d85e68 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:01.578200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213f12c-f6fb-46ff-b4a2-406718d85e68 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:01.588528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e71dac-6ae6-4d22-ae0d-548ae61e7f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:01.588528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e71dac-6ae6-4d22-ae0d-548ae61e7f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:01.588769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e71dac-6ae6-4d22-ae0d-548ae61e7f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:01.589189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e71dac-6ae6-4d22-ae0d-548ae61e7f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:01.589934 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e71dac-6ae6-4d22-ae0d-548ae61e7f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:01.596428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e71dac-6ae6-4d22-ae0d-548ae61e7f14 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:01.610664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1222/2461] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:01.611899 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe60008-b0b4-4996-a98a-16f1f7921dd4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:01.624468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe60008-b0b4-4996-a98a-16f1f7921dd4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:01.628790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832b53b-9e43-47e4-9920-3c16d9a134e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:01.629773 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b53b-9e43-47e4-9920-3c16d9a134e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:01.630106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b53b-9e43-47e4-9920-3c16d9a134e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:01.630608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b53b-9e43-47e4-9920-3c16d9a134e6 admin admin] PATH_INFO: `/v3/projects/c101cc999ff0473bb6d4c93f6f690674/users/574ac45608a141cdb26700b98bfb9342/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:01.648646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832b53b-9e43-47e4-9920-3c16d9a134e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c101cc999ff0473bb6d4c93f6f690674, user_id=574ac45608a141cdb26700b98bfb9342, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:01.651335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832b53b-9e43-47e4-9920-3c16d9a134e6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:01.661049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:01.666375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1240/2462] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:01 2022] PUT /identity/v3/projects/c101cc999ff0473bb6d4c93f6f690674/users/574ac45608a141cdb26700b98bfb9342/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:01.673082 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49da1c-60f4-4de4-92a8-24f4c11b665f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:01.673939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49da1c-60f4-4de4-92a8-24f4c11b665f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:01.674253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49da1c-60f4-4de4-92a8-24f4c11b665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:01.697133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7e49da1c-60f4-4de4-92a8-24f4c11b665f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:01.698354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7e49da1c-60f4-4de4-92a8-24f4c11b665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:01.760118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1223/2463] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:01.769986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832b53b-9e43-47e4-9920-3c16d9a134e6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:01.771742 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2832b53b-9e43-47e4-9920-3c16d9a134e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:01.829104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832b53b-9e43-47e4-9920-3c16d9a134e6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:01.833015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c8072-f003-4872-8e67-746e99bbbd1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:01.833715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c8072-f003-4872-8e67-746e99bbbd1f service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:01.833990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c8072-f003-4872-8e67-746e99bbbd1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:01.834263 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c8072-f003-4872-8e67-746e99bbbd1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:01.845494 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c8072-f003-4872-8e67-746e99bbbd1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:01.847263 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c8072-f003-4872-8e67-746e99bbbd1f service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:01.857118 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1241/2464] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:02.439246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaa34d-dcf4-4c0c-ae84-a132d1f2648b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:02.439544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaa34d-dcf4-4c0c-ae84-a132d1f2648b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:02.440002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaa34d-dcf4-4c0c-ae84-a132d1f2648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:02.466518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-15aaa34d-dcf4-4c0c-ae84-a132d1f2648b None None] MFA Rules not processed for user `574ac45608a141cdb26700b98bfb9342`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:02.468349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-15aaa34d-dcf4-4c0c-ae84-a132d1f2648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:02.540067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1224/2465] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:02.545485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c8072-f003-4872-8e67-746e99bbbd1f service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:02.556178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c8072-f003-4872-8e67-746e99bbbd1f service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:02.560958 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2d0e1-75eb-459b-8101-ce9d7d765e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:02.562252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2d0e1-75eb-459b-8101-ce9d7d765e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:02.562722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2d0e1-75eb-459b-8101-ce9d7d765e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:02.563010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2d0e1-75eb-459b-8101-ce9d7d765e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:02.563727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2d0e1-75eb-459b-8101-ce9d7d765e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:02.565642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2d0e1-75eb-459b-8101-ce9d7d765e43 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:02.597033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1242/2466] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:02 2022] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:02.601197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aaa34d-dcf4-4c0c-ae84-a132d1f2648b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:02.613603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aaa34d-dcf4-4c0c-ae84-a132d1f2648b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:02.618315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:02.672465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353cd01-3509-4861-98c2-19182f5fde53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:02.673050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353cd01-3509-4861-98c2-19182f5fde53 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:02.673332 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353cd01-3509-4861-98c2-19182f5fde53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:02.673610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353cd01-3509-4861-98c2-19182f5fde53 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:02.674286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353cd01-3509-4861-98c2-19182f5fde53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:02.676248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353cd01-3509-4861-98c2-19182f5fde53 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:02.696931 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1225/2467] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:02 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:47:02.700884 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2d0e1-75eb-459b-8101-ce9d7d765e43 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:02.711122 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2d0e1-75eb-459b-8101-ce9d7d765e43 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:02.716130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390b2e7-fdc8-4213-b9a7-d512e25c83a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:02.716797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390b2e7-fdc8-4213-b9a7-d512e25c83a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:02.717100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390b2e7-fdc8-4213-b9a7-d512e25c83a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:02.717376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390b2e7-fdc8-4213-b9a7-d512e25c83a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:02.718271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390b2e7-fdc8-4213-b9a7-d512e25c83a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:02.719904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390b2e7-fdc8-4213-b9a7-d512e25c83a7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:02.731232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1243/2468] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:02.735394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353cd01-3509-4861-98c2-19182f5fde53 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:02.746424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353cd01-3509-4861-98c2-19182f5fde53 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:02.752195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbecae4-f80f-47a1-9581-694e401324b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:02.752929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbecae4-f80f-47a1-9581-694e401324b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:02.753212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbecae4-f80f-47a1-9581-694e401324b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:02.753484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbecae4-f80f-47a1-9581-694e401324b9 admin admin] PATH_INFO: `/v3/projects/ac3c94b58ec6433da8fd7e14483cd5b3/users/5934193a2fd944ffa567df19202e4c20/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:02.769381 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbecae4-f80f-47a1-9581-694e401324b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac3c94b58ec6433da8fd7e14483cd5b3, user_id=5934193a2fd944ffa567df19202e4c20, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:02.772064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbecae4-f80f-47a1-9581-694e401324b9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:02.786335 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1226/2469] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:02 2022] PUT /identity/v3/projects/ac3c94b58ec6433da8fd7e14483cd5b3/users/5934193a2fd944ffa567df19202e4c20/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:02.791682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390b2e7-fdc8-4213-b9a7-d512e25c83a7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:02.800883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390b2e7-fdc8-4213-b9a7-d512e25c83a7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:02.863455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924af368-5db6-4294-87ad-40647c35a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:02.863455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af368-5db6-4294-87ad-40647c35a6ce admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:02.863455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af368-5db6-4294-87ad-40647c35a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:02.863455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af368-5db6-4294-87ad-40647c35a6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:02.864908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924af368-5db6-4294-87ad-40647c35a6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:02.864908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924af368-5db6-4294-87ad-40647c35a6ce admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:02.875810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1244/2470] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:47:02.879779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbecae4-f80f-47a1-9581-694e401324b9 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:02.890470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbecae4-f80f-47a1-9581-694e401324b9 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:02.895370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3360a4-bbdf-4c2e-8b5f-a297b11de822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:02.896322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3360a4-bbdf-4c2e-8b5f-a297b11de822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:02.896668 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3360a4-bbdf-4c2e-8b5f-a297b11de822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:02.897048 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3360a4-bbdf-4c2e-8b5f-a297b11de822 admin admin] PATH_INFO: `/v3/projects/ac3c94b58ec6433da8fd7e14483cd5b3/users/5934193a2fd944ffa567df19202e4c20/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:02.900853 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3360a4-bbdf-4c2e-8b5f-a297b11de822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac3c94b58ec6433da8fd7e14483cd5b3, user_id=5934193a2fd944ffa567df19202e4c20, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:02.905013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3360a4-bbdf-4c2e-8b5f-a297b11de822 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:02.916821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1227/2471] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:02 2022] PUT /identity/v3/projects/ac3c94b58ec6433da8fd7e14483cd5b3/users/5934193a2fd944ffa567df19202e4c20/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:03.544049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07848a-2aa3-419e-aa51-5f2709400455 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:03.544343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07848a-2aa3-419e-aa51-5f2709400455 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:03.544623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07848a-2aa3-419e-aa51-5f2709400455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:03.574364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0a07848a-2aa3-419e-aa51-5f2709400455 None None] MFA Rules not processed for user `5934193a2fd944ffa567df19202e4c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:03.575613 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0a07848a-2aa3-419e-aa51-5f2709400455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:03.641499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:03.662538 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1245/2472] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:04.114318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3360a4-bbdf-4c2e-8b5f-a297b11de822 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:04.176656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3360a4-bbdf-4c2e-8b5f-a297b11de822 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:04.181499 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2137cc4-13c6-486f-bd26-560f1a0b7c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:04.182143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2137cc4-13c6-486f-bd26-560f1a0b7c7e service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:04.182424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2137cc4-13c6-486f-bd26-560f1a0b7c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:04.182705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2137cc4-13c6-486f-bd26-560f1a0b7c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:04.184547 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a2137cc4-13c6-486f-bd26-560f1a0b7c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:04.259910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2137cc4-13c6-486f-bd26-560f1a0b7c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:04.261375 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2137cc4-13c6-486f-bd26-560f1a0b7c7e service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:04.272659 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1228/2473] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:04.926044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07848a-2aa3-419e-aa51-5f2709400455 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:04.940360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07848a-2aa3-419e-aa51-5f2709400455 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:04.945062 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:04.946017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:04.946370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:04.946654 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] PATH_INFO: `/v3/users/574ac45608a141cdb26700b98bfb9342` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:04.947966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=574ac45608a141cdb26700b98bfb9342)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:04.950058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:05.002359 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574ac45608a141cdb26700b98bfb9342'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.009906 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574ac45608a141cdb26700b98bfb9342'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.018660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574ac45608a141cdb26700b98bfb9342'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.019372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574ac45608a141cdb26700b98bfb9342'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.031955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574ac45608a141cdb26700b98bfb9342'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.037949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1246/2474] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:04 2022] DELETE /identity/v3/users/574ac45608a141cdb26700b98bfb9342 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:05.227308 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2137cc4-13c6-486f-bd26-560f1a0b7c7e service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:05.243019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2137cc4-13c6-486f-bd26-560f1a0b7c7e service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:05.253093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:05.313204 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:05.314097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:05.314765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:05.315348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] PATH_INFO: `/v3/projects/c101cc999ff0473bb6d4c93f6f690674` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:05.318364 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c101cc999ff0473bb6d4c93f6f690674)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:05.324190 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:05.393901 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c101cc999ff0473bb6d4c93f6f690674', 'request_id': 'req-c3403145-ac30-4b42-a549-9dc75fc2b2c1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.402711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c101cc999ff0473bb6d4c93f6f690674', 'request_id': 'req-c3403145-ac30-4b42-a549-9dc75fc2b2c1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.410780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c101cc999ff0473bb6d4c93f6f690674', 'request_id': 'req-c3403145-ac30-4b42-a549-9dc75fc2b2c1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.425217 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] The token cache is being invalidate because project c101cc999ff0473bb6d4c93f6f690674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:05.425531 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.426574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.431131 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1229/2475] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:05 2022] DELETE /identity/v3/projects/c101cc999ff0473bb6d4c93f6f690674 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:05.432631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:05.434897 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:05.451212 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93204f-f3b1-4a45-a10e-e3b3073aa9af admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:05.520266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd324f-fcbc-4a07-89c6-a4cf981e2ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:05.521153 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd324f-fcbc-4a07-89c6-a4cf981e2ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:05.521441 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd324f-fcbc-4a07-89c6-a4cf981e2ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:05.521714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd324f-fcbc-4a07-89c6-a4cf981e2ebd admin admin] PATH_INFO: `/v3/users/5934193a2fd944ffa567df19202e4c20` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:05.522925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd324f-fcbc-4a07-89c6-a4cf981e2ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5934193a2fd944ffa567df19202e4c20)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:05.524932 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd324f-fcbc-4a07-89c6-a4cf981e2ebd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:05.575009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ecdd324f-fcbc-4a07-89c6-a4cf981e2ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5934193a2fd944ffa567df19202e4c20'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.584485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ecdd324f-fcbc-4a07-89c6-a4cf981e2ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5934193a2fd944ffa567df19202e4c20'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.593590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ecdd324f-fcbc-4a07-89c6-a4cf981e2ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5934193a2fd944ffa567df19202e4c20'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.594331 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ecdd324f-fcbc-4a07-89c6-a4cf981e2ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5934193a2fd944ffa567df19202e4c20'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.596919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:05.611370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ecdd324f-fcbc-4a07-89c6-a4cf981e2ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5934193a2fd944ffa567df19202e4c20'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.617756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1247/2476] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:05 2022] DELETE /identity/v3/users/5934193a2fd944ffa567df19202e4c20 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:05.803328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:05.804859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:05.818881 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3403145-ac30-4b42-a549-9dc75fc2b2c1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:05.884589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:05.885465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:05.885741 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:05.886018 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77 admin admin] PATH_INFO: `/v3/projects/ac3c94b58ec6433da8fd7e14483cd5b3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:05.887233 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac3c94b58ec6433da8fd7e14483cd5b3)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:05.889419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:05.934837 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:05.940286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac3c94b58ec6433da8fd7e14483cd5b3', 'request_id': 'req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.948344 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac3c94b58ec6433da8fd7e14483cd5b3', 'request_id': 'req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.955084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac3c94b58ec6433da8fd7e14483cd5b3', 'request_id': 'req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.966103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77 admin admin] The token cache is being invalidate because project ac3c94b58ec6433da8fd7e14483cd5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:05.966395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.967038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a86e2aa4-b053-4fe5-a915-4dd69bab9a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:05.969261 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1230/2477] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:05 2022] DELETE /identity/v3/projects/ac3c94b58ec6433da8fd7e14483cd5b3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:05.974297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf28934-c520-4380-950a-fe52e5dc9e15 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:05.974761 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf28934-c520-4380-950a-fe52e5dc9e15 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:05.974855 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf28934-c520-4380-950a-fe52e5dc9e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:05.993052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bbf28934-c520-4380-950a-fe52e5dc9e15 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:05.994375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bbf28934-c520-4380-950a-fe52e5dc9e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:06.054752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1248/2478] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:06.063916 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b8092-e0e0-4a7e-a1b3-1fef6241a9d0 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:06.064282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b8092-e0e0-4a7e-a1b3-1fef6241a9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:06.064624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b8092-e0e0-4a7e-a1b3-1fef6241a9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:06.086635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-376b8092-e0e0-4a7e-a1b3-1fef6241a9d0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:06.088001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-376b8092-e0e0-4a7e-a1b3-1fef6241a9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:06.097607 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1231/2479] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:06.101812 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf28934-c520-4380-950a-fe52e5dc9e15 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:06.112572 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf28934-c520-4380-950a-fe52e5dc9e15 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:06.117412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89df18a-cc35-44ca-be26-45100d45c958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:06.118152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89df18a-cc35-44ca-be26-45100d45c958 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:06.118531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89df18a-cc35-44ca-be26-45100d45c958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:06.119235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89df18a-cc35-44ca-be26-45100d45c958 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:06.119716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89df18a-cc35-44ca-be26-45100d45c958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:47:06.120097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89df18a-cc35-44ca-be26-45100d45c958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:06.121776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89df18a-cc35-44ca-be26-45100d45c958 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:06.138782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1249/2480] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:47:06.140117 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b8092-e0e0-4a7e-a1b3-1fef6241a9d0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:06.152348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b8092-e0e0-4a7e-a1b3-1fef6241a9d0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:06.159663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca702dc5-290b-4b74-b91b-b1ff5e4ec7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:06.160536 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca702dc5-290b-4b74-b91b-b1ff5e4ec7dd admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:06.160820 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca702dc5-290b-4b74-b91b-b1ff5e4ec7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:06.161111 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca702dc5-290b-4b74-b91b-b1ff5e4ec7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:06.161796 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca702dc5-290b-4b74-b91b-b1ff5e4ec7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:06.163947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca702dc5-290b-4b74-b91b-b1ff5e4ec7dd admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:06.197727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1232/2481] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:06 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:47:06.199220 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89df18a-cc35-44ca-be26-45100d45c958 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:06.210076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89df18a-cc35-44ca-be26-45100d45c958 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:06.300440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10378166-caab-4ab2-ba5d-cd4cb42415bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:06.301134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10378166-caab-4ab2-ba5d-cd4cb42415bb admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:06.301417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10378166-caab-4ab2-ba5d-cd4cb42415bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:06.301685 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10378166-caab-4ab2-ba5d-cd4cb42415bb admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:06.302520 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10378166-caab-4ab2-ba5d-cd4cb42415bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:06.304549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10378166-caab-4ab2-ba5d-cd4cb42415bb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:06.328973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1250/2482] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:06 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:06.330264 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca702dc5-290b-4b74-b91b-b1ff5e4ec7dd admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:06.343911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca702dc5-290b-4b74-b91b-b1ff5e4ec7dd admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:06.349808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f619c-bb4b-408d-92d2-189dc96f35e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:06.350645 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f619c-bb4b-408d-92d2-189dc96f35e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:06.351128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f619c-bb4b-408d-92d2-189dc96f35e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:06.351518 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f619c-bb4b-408d-92d2-189dc96f35e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:06.352532 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f619c-bb4b-408d-92d2-189dc96f35e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:06.354724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f619c-bb4b-408d-92d2-189dc96f35e6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:06.369299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1233/2483] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:06.370728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10378166-caab-4ab2-ba5d-cd4cb42415bb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:06.381185 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10378166-caab-4ab2-ba5d-cd4cb42415bb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:06.386244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a276e6-d088-4349-b417-c75e9806e76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:06.387046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a276e6-d088-4349-b417-c75e9806e76e admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:06.387448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a276e6-d088-4349-b417-c75e9806e76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:06.387836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a276e6-d088-4349-b417-c75e9806e76e admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:06.388777 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a276e6-d088-4349-b417-c75e9806e76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:06.391057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a276e6-d088-4349-b417-c75e9806e76e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:06.403343 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1251/2484] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:06.407069 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f619c-bb4b-408d-92d2-189dc96f35e6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:06.419629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f619c-bb4b-408d-92d2-189dc96f35e6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:06.425808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f44a4-e3bc-4954-9bc6-a69484959718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:06.426773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f44a4-e3bc-4954-9bc6-a69484959718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:06.427061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f44a4-e3bc-4954-9bc6-a69484959718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:06.427398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f44a4-e3bc-4954-9bc6-a69484959718 admin admin] PATH_INFO: `/v3/projects/45f0e9c05c454f3398732a2a2286a618/users/94483b3b79ff48429a26ce1d901299b4/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:06.445157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f44a4-e3bc-4954-9bc6-a69484959718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f0e9c05c454f3398732a2a2286a618, user_id=94483b3b79ff48429a26ce1d901299b4, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:06.448262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f44a4-e3bc-4954-9bc6-a69484959718 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:06.465245 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1234/2485] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:06 2022] PUT /identity/v3/projects/45f0e9c05c454f3398732a2a2286a618/users/94483b3b79ff48429a26ce1d901299b4/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:06.476462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a969b8-ec71-4f88-b185-4107568e53f1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:06.476759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a969b8-ec71-4f88-b185-4107568e53f1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:06.477044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a969b8-ec71-4f88-b185-4107568e53f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:06.509149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f6a969b8-ec71-4f88-b185-4107568e53f1 None None] MFA Rules not processed for user `94483b3b79ff48429a26ce1d901299b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:06.510124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f6a969b8-ec71-4f88-b185-4107568e53f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:06.556548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:06.597331 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1252/2486] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:06.602516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f44a4-e3bc-4954-9bc6-a69484959718 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:06.677945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f44a4-e3bc-4954-9bc6-a69484959718 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:06.682875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5f64d-3c49-4b90-8a09-2c0c44dbf6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:06.683579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5f64d-3c49-4b90-8a09-2c0c44dbf6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:06.683869 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5f64d-3c49-4b90-8a09-2c0c44dbf6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:06.684151 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5f64d-3c49-4b90-8a09-2c0c44dbf6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:06.684893 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5f64d-3c49-4b90-8a09-2c0c44dbf6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:06.687696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5f64d-3c49-4b90-8a09-2c0c44dbf6b1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:06.714600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1235/2487] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:06 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:06.719299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a969b8-ec71-4f88-b185-4107568e53f1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:06.730361 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a969b8-ec71-4f88-b185-4107568e53f1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:06.791545 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efadbb9-71f2-433d-8c41-4b3596cc186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:06.792374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efadbb9-71f2-433d-8c41-4b3596cc186a admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:06.792767 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efadbb9-71f2-433d-8c41-4b3596cc186a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:06.793147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efadbb9-71f2-433d-8c41-4b3596cc186a admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:06.793934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efadbb9-71f2-433d-8c41-4b3596cc186a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:06.797131 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efadbb9-71f2-433d-8c41-4b3596cc186a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:06.817973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1253/2488] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:06 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:06.822025 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5f64d-3c49-4b90-8a09-2c0c44dbf6b1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:06.832648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5f64d-3c49-4b90-8a09-2c0c44dbf6b1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:06.837246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ca004-d973-443d-b66b-1eade05f71ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:06.837916 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ca004-d973-443d-b66b-1eade05f71ed admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:06.838325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ca004-d973-443d-b66b-1eade05f71ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:06.838476 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ca004-d973-443d-b66b-1eade05f71ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:06.839435 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ca004-d973-443d-b66b-1eade05f71ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:06.840844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ca004-d973-443d-b66b-1eade05f71ed admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:06.852462 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1236/2489] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:06.856341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efadbb9-71f2-433d-8c41-4b3596cc186a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:06.867428 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efadbb9-71f2-433d-8c41-4b3596cc186a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:06.872073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29e170-f6b9-4d8e-b7e9-b6ad30b19675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:06.872965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e170-f6b9-4d8e-b7e9-b6ad30b19675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:06.873252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e170-f6b9-4d8e-b7e9-b6ad30b19675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:06.873528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e170-f6b9-4d8e-b7e9-b6ad30b19675 admin admin] PATH_INFO: `/v3/projects/c05a419d6006454ea13b8233b6ed2606/users/559d6dba0a4e47c2a11a788646b4950c/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:06.891381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29e170-f6b9-4d8e-b7e9-b6ad30b19675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05a419d6006454ea13b8233b6ed2606, user_id=559d6dba0a4e47c2a11a788646b4950c, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:06.894350 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29e170-f6b9-4d8e-b7e9-b6ad30b19675 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:06.912826 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1254/2490] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:06 2022] PUT /identity/v3/projects/c05a419d6006454ea13b8233b6ed2606/users/559d6dba0a4e47c2a11a788646b4950c/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:06.917031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ca004-d973-443d-b66b-1eade05f71ed admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:06.928475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ca004-d973-443d-b66b-1eade05f71ed admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:06.973677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:06.995510 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f874742-fc81-4e5b-810e-00e18e3c653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:06.996208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f874742-fc81-4e5b-810e-00e18e3c653c admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:06.996493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f874742-fc81-4e5b-810e-00e18e3c653c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:06.996776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f874742-fc81-4e5b-810e-00e18e3c653c admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:06.997517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f874742-fc81-4e5b-810e-00e18e3c653c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:07.000265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f874742-fc81-4e5b-810e-00e18e3c653c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:07.013034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1237/2491] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:07.017496 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29e170-f6b9-4d8e-b7e9-b6ad30b19675 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:07.031237 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29e170-f6b9-4d8e-b7e9-b6ad30b19675 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:07.036957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dc10c-e64f-4588-a80d-0d44c5034ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:07.037990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dc10c-e64f-4588-a80d-0d44c5034ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:07.038381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dc10c-e64f-4588-a80d-0d44c5034ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:07.038761 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dc10c-e64f-4588-a80d-0d44c5034ce5 admin admin] PATH_INFO: `/v3/projects/c05a419d6006454ea13b8233b6ed2606/users/559d6dba0a4e47c2a11a788646b4950c/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:07.040973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dc10c-e64f-4588-a80d-0d44c5034ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05a419d6006454ea13b8233b6ed2606, user_id=559d6dba0a4e47c2a11a788646b4950c, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:07.046562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dc10c-e64f-4588-a80d-0d44c5034ce5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:07.064999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1255/2492] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:07 2022] PUT /identity/v3/projects/c05a419d6006454ea13b8233b6ed2606/users/559d6dba0a4e47c2a11a788646b4950c/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:07.075263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b1572-8d76-4b6c-8a23-92d9546eada7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:07.075558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b1572-8d76-4b6c-8a23-92d9546eada7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:07.075855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b1572-8d76-4b6c-8a23-92d9546eada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:07.103407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a48b1572-8d76-4b6c-8a23-92d9546eada7 None None] MFA Rules not processed for user `559d6dba0a4e47c2a11a788646b4950c`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:07.104559 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a48b1572-8d76-4b6c-8a23-92d9546eada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:07.182500 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1238/2493] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:07.197803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dc10c-e64f-4588-a80d-0d44c5034ce5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:07.199777 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-822dc10c-e64f-4588-a80d-0d44c5034ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:07.296201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dc10c-e64f-4588-a80d-0d44c5034ce5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:07.300370 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5679f0b-e654-4b99-94b6-dc989d87b343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:07.301035 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5679f0b-e654-4b99-94b6-dc989d87b343 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:07.301321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5679f0b-e654-4b99-94b6-dc989d87b343 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:07.301601 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5679f0b-e654-4b99-94b6-dc989d87b343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:07.311638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5679f0b-e654-4b99-94b6-dc989d87b343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:07.313118 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5679f0b-e654-4b99-94b6-dc989d87b343 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:07.326426 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1256/2494] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:07.421329 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b1572-8d76-4b6c-8a23-92d9546eada7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:07.432475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b1572-8d76-4b6c-8a23-92d9546eada7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:07.437087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39032f89-c51c-446c-90ad-be5c0c711f11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:07.437754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39032f89-c51c-446c-90ad-be5c0c711f11 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:07.438038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39032f89-c51c-446c-90ad-be5c0c711f11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:07.438318 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39032f89-c51c-446c-90ad-be5c0c711f11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:07.514524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39032f89-c51c-446c-90ad-be5c0c711f11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:07.516129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39032f89-c51c-446c-90ad-be5c0c711f11 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:07.531745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1239/2495] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:07.837498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5679f0b-e654-4b99-94b6-dc989d87b343 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:07.838947 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d5679f0b-e654-4b99-94b6-dc989d87b343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:07.855337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:07.908454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5679f0b-e654-4b99-94b6-dc989d87b343 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:07.912870 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae601d-bfe4-4761-9222-95e38b120193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:07.913740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae601d-bfe4-4761-9222-95e38b120193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:07.914026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae601d-bfe4-4761-9222-95e38b120193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:07.914308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae601d-bfe4-4761-9222-95e38b120193 admin admin] PATH_INFO: `/v3/users/fb6987f34f174552bab9495f3d50ee45` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:07.915628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae601d-bfe4-4761-9222-95e38b120193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6987f34f174552bab9495f3d50ee45)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:07.917558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae601d-bfe4-4761-9222-95e38b120193 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:07.962463 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-06ae601d-bfe4-4761-9222-95e38b120193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6987f34f174552bab9495f3d50ee45'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:07.970190 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-06ae601d-bfe4-4761-9222-95e38b120193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6987f34f174552bab9495f3d50ee45'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:07.977367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-06ae601d-bfe4-4761-9222-95e38b120193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6987f34f174552bab9495f3d50ee45'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:07.977997 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-06ae601d-bfe4-4761-9222-95e38b120193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6987f34f174552bab9495f3d50ee45'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:07.989726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-06ae601d-bfe4-4761-9222-95e38b120193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6987f34f174552bab9495f3d50ee45'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:07.995535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1257/2496] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:07 2022] DELETE /identity/v3/users/fb6987f34f174552bab9495f3d50ee45 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:08.164034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39032f89-c51c-446c-90ad-be5c0c711f11 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:08.176252 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39032f89-c51c-446c-90ad-be5c0c711f11 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:08.234842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb706e22-bdb8-45b0-93bf-ac48a705943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:08.235740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb706e22-bdb8-45b0-93bf-ac48a705943d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:08.236026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb706e22-bdb8-45b0-93bf-ac48a705943d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:08.236299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb706e22-bdb8-45b0-93bf-ac48a705943d admin admin] PATH_INFO: `/v3/projects/cdb27a569e3f48a1a7076deb30da8618` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:08.237476 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb706e22-bdb8-45b0-93bf-ac48a705943d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb27a569e3f48a1a7076deb30da8618)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:08.239404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb706e22-bdb8-45b0-93bf-ac48a705943d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:08.241614 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:08.285742 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eb706e22-bdb8-45b0-93bf-ac48a705943d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb27a569e3f48a1a7076deb30da8618', 'request_id': 'req-eb706e22-bdb8-45b0-93bf-ac48a705943d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:08.293312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eb706e22-bdb8-45b0-93bf-ac48a705943d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb27a569e3f48a1a7076deb30da8618', 'request_id': 'req-eb706e22-bdb8-45b0-93bf-ac48a705943d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:08.299004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eb706e22-bdb8-45b0-93bf-ac48a705943d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb27a569e3f48a1a7076deb30da8618', 'request_id': 'req-eb706e22-bdb8-45b0-93bf-ac48a705943d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:08.310034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eb706e22-bdb8-45b0-93bf-ac48a705943d admin admin] The token cache is being invalidate because project cdb27a569e3f48a1a7076deb30da8618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:08.310322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eb706e22-bdb8-45b0-93bf-ac48a705943d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:08.310952 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eb706e22-bdb8-45b0-93bf-ac48a705943d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:08.313128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1240/2497] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:08 2022] DELETE /identity/v3/projects/cdb27a569e3f48a1a7076deb30da8618 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:08.318089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bba83-b2cf-4378-bac4-5feafd2e9eb9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:08.318586 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bba83-b2cf-4378-bac4-5feafd2e9eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:08.318711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bba83-b2cf-4378-bac4-5feafd2e9eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:08.336176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2a4bba83-b2cf-4378-bac4-5feafd2e9eb9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:08.337385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2a4bba83-b2cf-4378-bac4-5feafd2e9eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:08.395039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1258/2498] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:08.402840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557fa82-f547-42b7-b436-c7e2585672bf None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:08.403132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557fa82-f547-42b7-b436-c7e2585672bf None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:08.403456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557fa82-f547-42b7-b436-c7e2585672bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:08.422972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e557fa82-f547-42b7-b436-c7e2585672bf None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:08.424134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e557fa82-f547-42b7-b436-c7e2585672bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:08.432039 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1241/2499] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:47:08.436283 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bba83-b2cf-4378-bac4-5feafd2e9eb9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:08.446302 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bba83-b2cf-4378-bac4-5feafd2e9eb9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:08.450892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d93e84-11ac-41f7-a7f3-c69bf3957ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:08.451594 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d93e84-11ac-41f7-a7f3-c69bf3957ccc admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:08.451933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d93e84-11ac-41f7-a7f3-c69bf3957ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:08.452307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d93e84-11ac-41f7-a7f3-c69bf3957ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:08.453062 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d93e84-11ac-41f7-a7f3-c69bf3957ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:47:08.453374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d93e84-11ac-41f7-a7f3-c69bf3957ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:08.455155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d93e84-11ac-41f7-a7f3-c69bf3957ccc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:08.466620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1259/2500] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:47:08.471700 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557fa82-f547-42b7-b436-c7e2585672bf None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:08.481042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557fa82-f547-42b7-b436-c7e2585672bf None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:08.486544 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fab9b4-6864-446c-97dd-4b8b76672ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:08.487240 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fab9b4-6864-446c-97dd-4b8b76672ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:08.487528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fab9b4-6864-446c-97dd-4b8b76672ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:08.487808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fab9b4-6864-446c-97dd-4b8b76672ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:08.488503 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fab9b4-6864-446c-97dd-4b8b76672ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:08.490406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fab9b4-6864-446c-97dd-4b8b76672ef7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:08.515554 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1242/2501] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:08 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:08.519888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d93e84-11ac-41f7-a7f3-c69bf3957ccc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:08.530666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d93e84-11ac-41f7-a7f3-c69bf3957ccc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:08.548150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:08.591817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40366ff-5a5b-46e7-a59e-71d85cff1c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:08.593070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40366ff-5a5b-46e7-a59e-71d85cff1c52 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:08.593357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40366ff-5a5b-46e7-a59e-71d85cff1c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:08.593734 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40366ff-5a5b-46e7-a59e-71d85cff1c52 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:08.594443 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40366ff-5a5b-46e7-a59e-71d85cff1c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:08.596420 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40366ff-5a5b-46e7-a59e-71d85cff1c52 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:08.617155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1260/2502] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:08 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:08.621720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fab9b4-6864-446c-97dd-4b8b76672ef7 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:08.632373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fab9b4-6864-446c-97dd-4b8b76672ef7 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:08.637056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9015e8-f33b-4b49-9dc2-7f18697baa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:08.637741 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9015e8-f33b-4b49-9dc2-7f18697baa7b admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:08.638026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9015e8-f33b-4b49-9dc2-7f18697baa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:08.638306 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9015e8-f33b-4b49-9dc2-7f18697baa7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:08.639027 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9015e8-f33b-4b49-9dc2-7f18697baa7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:08.641327 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9015e8-f33b-4b49-9dc2-7f18697baa7b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:08.652281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1243/2503] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:08.656696 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40366ff-5a5b-46e7-a59e-71d85cff1c52 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:08.666586 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40366ff-5a5b-46e7-a59e-71d85cff1c52 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:08.671714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f233c3-9a8a-4072-bcc1-130db3b1539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:08.672396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f233c3-9a8a-4072-bcc1-130db3b1539d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:08.672682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f233c3-9a8a-4072-bcc1-130db3b1539d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:08.672960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f233c3-9a8a-4072-bcc1-130db3b1539d admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:08.673757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f233c3-9a8a-4072-bcc1-130db3b1539d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:08.675300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f233c3-9a8a-4072-bcc1-130db3b1539d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:08.685196 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1261/2504] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:08.689216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9015e8-f33b-4b49-9dc2-7f18697baa7b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:08.699257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9015e8-f33b-4b49-9dc2-7f18697baa7b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:08.704642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc9a42-0402-448e-be3a-dec435600e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:08.705553 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc9a42-0402-448e-be3a-dec435600e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:08.705839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc9a42-0402-448e-be3a-dec435600e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:08.706123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc9a42-0402-448e-be3a-dec435600e10 admin admin] PATH_INFO: `/v3/projects/9be4058b712546a6a77be752a69b8639/users/16c79192d32e4e4d8a70e13b0c22f1fb/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:08.721684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc9a42-0402-448e-be3a-dec435600e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be4058b712546a6a77be752a69b8639, user_id=16c79192d32e4e4d8a70e13b0c22f1fb, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:08.724370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc9a42-0402-448e-be3a-dec435600e10 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:08.738291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1244/2505] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:08 2022] PUT /identity/v3/projects/9be4058b712546a6a77be752a69b8639/users/16c79192d32e4e4d8a70e13b0c22f1fb/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:47:08.753314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc45e0-1682-42b9-bb93-8d40d5e48f2c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:08.753314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc45e0-1682-42b9-bb93-8d40d5e48f2c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:08.753314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc45e0-1682-42b9-bb93-8d40d5e48f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:08.777870 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0ffc45e0-1682-42b9-bb93-8d40d5e48f2c None None] MFA Rules not processed for user `16c79192d32e4e4d8a70e13b0c22f1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:08.779099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0ffc45e0-1682-42b9-bb93-8d40d5e48f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:08.855067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1262/2506] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:08.859959 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc9a42-0402-448e-be3a-dec435600e10 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:08.927970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc9a42-0402-448e-be3a-dec435600e10 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:08.932710 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5ad49-c80c-44f6-906f-1188379fda21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:08.933390 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5ad49-c80c-44f6-906f-1188379fda21 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:08.933639 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5ad49-c80c-44f6-906f-1188379fda21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:08.933929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5ad49-c80c-44f6-906f-1188379fda21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:08.934607 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5ad49-c80c-44f6-906f-1188379fda21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:08.936852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5ad49-c80c-44f6-906f-1188379fda21 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:08.966089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1245/2507] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:08 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:08.969062 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc45e0-1682-42b9-bb93-8d40d5e48f2c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:08.981823 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc45e0-1682-42b9-bb93-8d40d5e48f2c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:09.043677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6730f-de44-4365-8cc1-197a67a9ba68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:09.044358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6730f-de44-4365-8cc1-197a67a9ba68 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:09.044673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6730f-de44-4365-8cc1-197a67a9ba68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:09.044951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6730f-de44-4365-8cc1-197a67a9ba68 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:09.045674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6730f-de44-4365-8cc1-197a67a9ba68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:09.048004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6730f-de44-4365-8cc1-197a67a9ba68 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:09.079104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1263/2508] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:08 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:09.080527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5ad49-c80c-44f6-906f-1188379fda21 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:09.092388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5ad49-c80c-44f6-906f-1188379fda21 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:09.097305 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207e5c4-641a-4348-9198-5e44b486de88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:09.097980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207e5c4-641a-4348-9198-5e44b486de88 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:09.098270 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207e5c4-641a-4348-9198-5e44b486de88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:09.098552 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207e5c4-641a-4348-9198-5e44b486de88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:09.099317 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207e5c4-641a-4348-9198-5e44b486de88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:09.100929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207e5c4-641a-4348-9198-5e44b486de88 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:09.114285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1246/2509] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:09.118397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6730f-de44-4365-8cc1-197a67a9ba68 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:09.129091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6730f-de44-4365-8cc1-197a67a9ba68 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:09.133850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d163b-ae9c-469f-919b-061a18530b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:09.134839 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d163b-ae9c-469f-919b-061a18530b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:09.135232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d163b-ae9c-469f-919b-061a18530b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:09.135474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d163b-ae9c-469f-919b-061a18530b4b admin admin] PATH_INFO: `/v3/projects/a42bbdba7583447a8b801baf4ffcfee6/users/e2acffd2dd6c40629329a632a3b520a0/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:09.150949 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d163b-ae9c-469f-919b-061a18530b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42bbdba7583447a8b801baf4ffcfee6, user_id=e2acffd2dd6c40629329a632a3b520a0, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:09.153616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d163b-ae9c-469f-919b-061a18530b4b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:09.156359 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:09.167231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1264/2510] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:09 2022] PUT /identity/v3/projects/a42bbdba7583447a8b801baf4ffcfee6/users/e2acffd2dd6c40629329a632a3b520a0/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:09.171838 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207e5c4-641a-4348-9198-5e44b486de88 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:09.178083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:09.184641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207e5c4-641a-4348-9198-5e44b486de88 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:09.242455 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ffce9-f085-4a04-be94-ed8724339ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:09.243124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ffce9-f085-4a04-be94-ed8724339ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:09.243440 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ffce9-f085-4a04-be94-ed8724339ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:09.243724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ffce9-f085-4a04-be94-ed8724339ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:09.244442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ffce9-f085-4a04-be94-ed8724339ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:09.246031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ffce9-f085-4a04-be94-ed8724339ea4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:09.255787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1247/2511] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:09.259956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d163b-ae9c-469f-919b-061a18530b4b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:09.270506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d163b-ae9c-469f-919b-061a18530b4b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:09.275061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27dd41-e448-4567-b540-62f4db2f42d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:09.275969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27dd41-e448-4567-b540-62f4db2f42d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:09.276254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27dd41-e448-4567-b540-62f4db2f42d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:09.276528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27dd41-e448-4567-b540-62f4db2f42d2 admin admin] PATH_INFO: `/v3/projects/a42bbdba7583447a8b801baf4ffcfee6/users/e2acffd2dd6c40629329a632a3b520a0/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:09.278486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27dd41-e448-4567-b540-62f4db2f42d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42bbdba7583447a8b801baf4ffcfee6, user_id=e2acffd2dd6c40629329a632a3b520a0, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:09.281699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27dd41-e448-4567-b540-62f4db2f42d2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:09.291710 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1265/2512] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:09 2022] PUT /identity/v3/projects/a42bbdba7583447a8b801baf4ffcfee6/users/e2acffd2dd6c40629329a632a3b520a0/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:09.302501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26975dbe-8b46-447c-883c-4cd28a63050b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:09.302791 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26975dbe-8b46-447c-883c-4cd28a63050b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:09.303070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26975dbe-8b46-447c-883c-4cd28a63050b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:09.328932 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-26975dbe-8b46-447c-883c-4cd28a63050b None None] MFA Rules not processed for user `e2acffd2dd6c40629329a632a3b520a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:09.330930 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-26975dbe-8b46-447c-883c-4cd28a63050b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:09.399565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1248/2513] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:09.412424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27dd41-e448-4567-b540-62f4db2f42d2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:09.414192 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1d27dd41-e448-4567-b540-62f4db2f42d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:09.473257 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27dd41-e448-4567-b540-62f4db2f42d2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:09.477100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fed1e3-6deb-451d-a76b-af00cd81799a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:09.477999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fed1e3-6deb-451d-a76b-af00cd81799a service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:09.478283 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fed1e3-6deb-451d-a76b-af00cd81799a service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:09.478559 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fed1e3-6deb-451d-a76b-af00cd81799a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:09.488020 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fed1e3-6deb-451d-a76b-af00cd81799a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:09.489449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fed1e3-6deb-451d-a76b-af00cd81799a service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:09.498751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1266/2514] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:09.570237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26975dbe-8b46-447c-883c-4cd28a63050b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:09.580451 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26975dbe-8b46-447c-883c-4cd28a63050b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:09.584073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9616c-fe7a-46b0-ad9a-7ea99416fc8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:09.584715 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9616c-fe7a-46b0-ad9a-7ea99416fc8e service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:09.584999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9616c-fe7a-46b0-ad9a-7ea99416fc8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:09.585323 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9616c-fe7a-46b0-ad9a-7ea99416fc8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:09.645498 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9616c-fe7a-46b0-ad9a-7ea99416fc8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:09.646916 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9616c-fe7a-46b0-ad9a-7ea99416fc8e service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:09.656385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1249/2515] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:16.596521 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fed1e3-6deb-451d-a76b-af00cd81799a service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:16.658432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fed1e3-6deb-451d-a76b-af00cd81799a service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:16.662990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:16.663892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:16.664180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:16.664460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] PATH_INFO: `/v3/users/16c79192d32e4e4d8a70e13b0c22f1fb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:16.665646 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16c79192d32e4e4d8a70e13b0c22f1fb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:16.667629 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:16.713273 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16c79192d32e4e4d8a70e13b0c22f1fb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:16.720795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16c79192d32e4e4d8a70e13b0c22f1fb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:16.728469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16c79192d32e4e4d8a70e13b0c22f1fb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:16.729178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16c79192d32e4e4d8a70e13b0c22f1fb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:16.741688 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16c79192d32e4e4d8a70e13b0c22f1fb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:16.747549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1267/2516] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:16 2022] DELETE /identity/v3/users/16c79192d32e4e4d8a70e13b0c22f1fb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:16.752304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702bd0-0f7f-4e78-abdc-8b8a9706db52 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:16.752785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702bd0-0f7f-4e78-abdc-8b8a9706db52 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:16.752935 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702bd0-0f7f-4e78-abdc-8b8a9706db52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:16.769744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3f702bd0-0f7f-4e78-abdc-8b8a9706db52 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:16.770925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3f702bd0-0f7f-4e78-abdc-8b8a9706db52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:16.787502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:16.829412 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1250/2517] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:16.839015 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:16.840471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:16.846023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:16.900256 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da481b-68fb-40d4-9d7c-82fe01bdb37d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:16.903814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c3331-ce15-44ae-bb5a-c89dee8281e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:16.904463 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c3331-ce15-44ae-bb5a-c89dee8281e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:16.904746 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c3331-ce15-44ae-bb5a-c89dee8281e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:16.905023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c3331-ce15-44ae-bb5a-c89dee8281e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:16.914378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c3331-ce15-44ae-bb5a-c89dee8281e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:16.915841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c3331-ce15-44ae-bb5a-c89dee8281e9 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:16.925743 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1268/2518] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:17.216320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f702bd0-0f7f-4e78-abdc-8b8a9706db52 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:17.217777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3f702bd0-0f7f-4e78-abdc-8b8a9706db52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:17.232820 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f702bd0-0f7f-4e78-abdc-8b8a9706db52 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:17.240681 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:17.241553 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:17.241857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:17.242122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] PATH_INFO: `/v3/projects/9be4058b712546a6a77be752a69b8639` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:17.243395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be4058b712546a6a77be752a69b8639)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:17.245375 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:17.292754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be4058b712546a6a77be752a69b8639', 'request_id': 'req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.300510 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be4058b712546a6a77be752a69b8639', 'request_id': 'req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.306251 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be4058b712546a6a77be752a69b8639', 'request_id': 'req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.317859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] The token cache is being invalidate because project 9be4058b712546a6a77be752a69b8639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:17.318149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.318781 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.320370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1251/2519] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:17 2022] DELETE /identity/v3/projects/9be4058b712546a6a77be752a69b8639 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:47:17.324405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c3331-ce15-44ae-bb5a-c89dee8281e9 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:17.335132 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c3331-ce15-44ae-bb5a-c89dee8281e9 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:17.391145 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fbbd8-2019-4a4d-89ac-d5ab8940728a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:17.393380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fbbd8-2019-4a4d-89ac-d5ab8940728a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:17.393676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fbbd8-2019-4a4d-89ac-d5ab8940728a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:17.393957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fbbd8-2019-4a4d-89ac-d5ab8940728a admin admin] PATH_INFO: `/v3/users/e2acffd2dd6c40629329a632a3b520a0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:17.395142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fbbd8-2019-4a4d-89ac-d5ab8940728a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2acffd2dd6c40629329a632a3b520a0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:17.397111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fbbd8-2019-4a4d-89ac-d5ab8940728a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:17.447146 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8f3fbbd8-2019-4a4d-89ac-d5ab8940728a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2acffd2dd6c40629329a632a3b520a0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.454236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8f3fbbd8-2019-4a4d-89ac-d5ab8940728a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2acffd2dd6c40629329a632a3b520a0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.461034 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8f3fbbd8-2019-4a4d-89ac-d5ab8940728a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2acffd2dd6c40629329a632a3b520a0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.461656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8f3fbbd8-2019-4a4d-89ac-d5ab8940728a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2acffd2dd6c40629329a632a3b520a0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.473754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8f3fbbd8-2019-4a4d-89ac-d5ab8940728a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2acffd2dd6c40629329a632a3b520a0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.479608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1269/2520] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:17 2022] DELETE /identity/v3/users/e2acffd2dd6c40629329a632a3b520a0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:47:17.744385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:17.745820 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:17.760173 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1fbf8-c035-4c1f-a50c-2e67b1ea4323 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:17.817148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768112f9-4793-4159-ba87-ae8317ed19f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:17.818012 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768112f9-4793-4159-ba87-ae8317ed19f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:17.818293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768112f9-4793-4159-ba87-ae8317ed19f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:17.818842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768112f9-4793-4159-ba87-ae8317ed19f2 admin admin] PATH_INFO: `/v3/projects/a42bbdba7583447a8b801baf4ffcfee6` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:17.820055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768112f9-4793-4159-ba87-ae8317ed19f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42bbdba7583447a8b801baf4ffcfee6)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:17.821950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768112f9-4793-4159-ba87-ae8317ed19f2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:17.865703 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:17.867039 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-768112f9-4793-4159-ba87-ae8317ed19f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42bbdba7583447a8b801baf4ffcfee6', 'request_id': 'req-768112f9-4793-4159-ba87-ae8317ed19f2'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.874626 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-768112f9-4793-4159-ba87-ae8317ed19f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42bbdba7583447a8b801baf4ffcfee6', 'request_id': 'req-768112f9-4793-4159-ba87-ae8317ed19f2'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.881094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-768112f9-4793-4159-ba87-ae8317ed19f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42bbdba7583447a8b801baf4ffcfee6', 'request_id': 'req-768112f9-4793-4159-ba87-ae8317ed19f2'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.892218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-768112f9-4793-4159-ba87-ae8317ed19f2 admin admin] The token cache is being invalidate because project a42bbdba7583447a8b801baf4ffcfee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:17.892503 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-768112f9-4793-4159-ba87-ae8317ed19f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.893125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-768112f9-4793-4159-ba87-ae8317ed19f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:17.894635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1252/2521] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:17 2022] DELETE /identity/v3/projects/a42bbdba7583447a8b801baf4ffcfee6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:17.899530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f4fd-64b0-4ee6-9aa7-4c3c452949b5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:17.899975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f4fd-64b0-4ee6-9aa7-4c3c452949b5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:17.900084 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f4fd-64b0-4ee6-9aa7-4c3c452949b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:17.917731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d563f4fd-64b0-4ee6-9aa7-4c3c452949b5 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:17.918927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d563f4fd-64b0-4ee6-9aa7-4c3c452949b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:17.938203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:17.978469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1270/2522] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:17.986696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1c92c-3ade-46d4-af74-fd41a54e1679 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:17.987013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1c92c-3ade-46d4-af74-fd41a54e1679 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:17.987378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1c92c-3ade-46d4-af74-fd41a54e1679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.005461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8ed1c92c-3ade-46d4-af74-fd41a54e1679 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:18.006651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8ed1c92c-3ade-46d4-af74-fd41a54e1679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:18.014396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1253/2523] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:18.018729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563f4fd-64b0-4ee6-9aa7-4c3c452949b5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:18.028408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563f4fd-64b0-4ee6-9aa7-4c3c452949b5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:18.033454 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa6b56-d0c4-49ed-91f2-abbce618c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:18.034105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa6b56-d0c4-49ed-91f2-abbce618c1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.034390 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa6b56-d0c4-49ed-91f2-abbce618c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.034670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa6b56-d0c4-49ed-91f2-abbce618c1f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.035444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa6b56-d0c4-49ed-91f2-abbce618c1f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:47:18.035758 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa6b56-d0c4-49ed-91f2-abbce618c1f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:18.037355 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa6b56-d0c4-49ed-91f2-abbce618c1f5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:18.049324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1271/2524] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:47:18.053432 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1c92c-3ade-46d4-af74-fd41a54e1679 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:18.062526 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1c92c-3ade-46d4-af74-fd41a54e1679 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:18.067390 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce878b43-cbd4-44f6-91d6-452a402c6b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:18.068024 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce878b43-cbd4-44f6-91d6-452a402c6b46 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.068305 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce878b43-cbd4-44f6-91d6-452a402c6b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.068583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce878b43-cbd4-44f6-91d6-452a402c6b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.069257 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce878b43-cbd4-44f6-91d6-452a402c6b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:18.071149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce878b43-cbd4-44f6-91d6-452a402c6b46 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:18.097101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1254/2525] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:18 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:18.101269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa6b56-d0c4-49ed-91f2-abbce618c1f5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:18.111742 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa6b56-d0c4-49ed-91f2-abbce618c1f5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:18.166721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9726e-3c5b-445b-8c78-f4d22eb31472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:18.167420 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9726e-3c5b-445b-8c78-f4d22eb31472 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.167711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9726e-3c5b-445b-8c78-f4d22eb31472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.167990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9726e-3c5b-445b-8c78-f4d22eb31472 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.168663 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9726e-3c5b-445b-8c78-f4d22eb31472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:18.170581 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9726e-3c5b-445b-8c78-f4d22eb31472 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:18.193250 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1272/2526] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:18 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:18.194445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce878b43-cbd4-44f6-91d6-452a402c6b46 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:18.204714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce878b43-cbd4-44f6-91d6-452a402c6b46 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:18.209394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879865a-f229-4594-8842-74666fc81a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:18.210047 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879865a-f229-4594-8842-74666fc81a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.210335 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879865a-f229-4594-8842-74666fc81a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.210616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879865a-f229-4594-8842-74666fc81a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.211373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879865a-f229-4594-8842-74666fc81a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:18.212949 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879865a-f229-4594-8842-74666fc81a41 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:18.225084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1255/2527] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:18.229166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9726e-3c5b-445b-8c78-f4d22eb31472 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:18.240889 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9726e-3c5b-445b-8c78-f4d22eb31472 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:18.245598 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975680a3-1549-4cde-9f1e-866f9c9b5aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:18.246263 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975680a3-1549-4cde-9f1e-866f9c9b5aeb admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.246550 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975680a3-1549-4cde-9f1e-866f9c9b5aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.246833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975680a3-1549-4cde-9f1e-866f9c9b5aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.247596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975680a3-1549-4cde-9f1e-866f9c9b5aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:18.249185 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975680a3-1549-4cde-9f1e-866f9c9b5aeb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:18.259708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1273/2528] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:18.263840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879865a-f229-4594-8842-74666fc81a41 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:18.274733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879865a-f229-4594-8842-74666fc81a41 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:18.279647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e420d-787a-42bc-810e-ee8b93bf6e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:18.280565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e420d-787a-42bc-810e-ee8b93bf6e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.280847 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e420d-787a-42bc-810e-ee8b93bf6e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.281130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e420d-787a-42bc-810e-ee8b93bf6e0d admin admin] PATH_INFO: `/v3/projects/562c7cfbec84464dbf698371a4bad3bc/users/a6101d23986243f29c642bec841cccdc/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.298326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e420d-787a-42bc-810e-ee8b93bf6e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=562c7cfbec84464dbf698371a4bad3bc, user_id=a6101d23986243f29c642bec841cccdc, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:18.301098 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e420d-787a-42bc-810e-ee8b93bf6e0d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:18.314982 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1256/2529] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:18 2022] PUT /identity/v3/projects/562c7cfbec84464dbf698371a4bad3bc/users/a6101d23986243f29c642bec841cccdc/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:18.326492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d65e-06b9-4b2b-8332-a31c51b39c24 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.326784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d65e-06b9-4b2b-8332-a31c51b39c24 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.327061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d65e-06b9-4b2b-8332-a31c51b39c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.355788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b827d65e-06b9-4b2b-8332-a31c51b39c24 None None] MFA Rules not processed for user `a6101d23986243f29c642bec841cccdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:18.357093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b827d65e-06b9-4b2b-8332-a31c51b39c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:18.428850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1274/2530] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:18.434251 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e420d-787a-42bc-810e-ee8b93bf6e0d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:18.518776 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e420d-787a-42bc-810e-ee8b93bf6e0d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:18.523761 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a5f99-d4fd-44d8-b0d6-7840c9ff745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:18.524433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a5f99-d4fd-44d8-b0d6-7840c9ff745e admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.524863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a5f99-d4fd-44d8-b0d6-7840c9ff745e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.525151 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a5f99-d4fd-44d8-b0d6-7840c9ff745e admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.526143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a5f99-d4fd-44d8-b0d6-7840c9ff745e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:18.528892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a5f99-d4fd-44d8-b0d6-7840c9ff745e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:18.562415 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1257/2531] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:18 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:47:18.566551 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827d65e-06b9-4b2b-8332-a31c51b39c24 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:18.577698 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827d65e-06b9-4b2b-8332-a31c51b39c24 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:18.605656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:18.647856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ba77b-664d-45eb-9a91-399079d5f256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:18.648532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ba77b-664d-45eb-9a91-399079d5f256 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.648819 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ba77b-664d-45eb-9a91-399079d5f256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.649099 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ba77b-664d-45eb-9a91-399079d5f256 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.649807 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ba77b-664d-45eb-9a91-399079d5f256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:18.651865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ba77b-664d-45eb-9a91-399079d5f256 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:18.671010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1275/2532] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:18 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:18.675505 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a5f99-d4fd-44d8-b0d6-7840c9ff745e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:18.685609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a5f99-d4fd-44d8-b0d6-7840c9ff745e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:18.690656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5845b-fa06-45a4-bbb5-260127909a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:18.691354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5845b-fa06-45a4-bbb5-260127909a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.691638 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5845b-fa06-45a4-bbb5-260127909a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.691942 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5845b-fa06-45a4-bbb5-260127909a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.692666 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5845b-fa06-45a4-bbb5-260127909a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:18.694277 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5845b-fa06-45a4-bbb5-260127909a5e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:18.704757 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1258/2533] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:18.708704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ba77b-664d-45eb-9a91-399079d5f256 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:18.718551 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ba77b-664d-45eb-9a91-399079d5f256 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:18.724281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ba0d6-ef45-4cf7-9c93-fbdf86c98d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:18.725164 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ba0d6-ef45-4cf7-9c93-fbdf86c98d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.725450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ba0d6-ef45-4cf7-9c93-fbdf86c98d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.725726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ba0d6-ef45-4cf7-9c93-fbdf86c98d5d admin admin] PATH_INFO: `/v3/projects/080f6aa633944844a2f3d2e92a84266d/users/7e92cb58ab5e4f2fba4fb1c4e0fa1f48/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.740307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ba0d6-ef45-4cf7-9c93-fbdf86c98d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=080f6aa633944844a2f3d2e92a84266d, user_id=7e92cb58ab5e4f2fba4fb1c4e0fa1f48, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:18.743249 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ba0d6-ef45-4cf7-9c93-fbdf86c98d5d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:18.756117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1276/2534] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:18 2022] PUT /identity/v3/projects/080f6aa633944844a2f3d2e92a84266d/users/7e92cb58ab5e4f2fba4fb1c4e0fa1f48/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:47:18.760064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5845b-fa06-45a4-bbb5-260127909a5e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:18.770416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5845b-fa06-45a4-bbb5-260127909a5e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:18.813637 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:18.827580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6319ab-983e-4e8f-9d95-92f55907cfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:18.828242 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6319ab-983e-4e8f-9d95-92f55907cfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.828529 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6319ab-983e-4e8f-9d95-92f55907cfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.828918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6319ab-983e-4e8f-9d95-92f55907cfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.829787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6319ab-983e-4e8f-9d95-92f55907cfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:18.831409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6319ab-983e-4e8f-9d95-92f55907cfa2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:18.841356 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1259/2535] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:18.846534 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ba0d6-ef45-4cf7-9c93-fbdf86c98d5d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:18.856985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ba0d6-ef45-4cf7-9c93-fbdf86c98d5d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:18.862012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2b32-aa37-4e87-9e6c-839c5c339c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:18.862892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2b32-aa37-4e87-9e6c-839c5c339c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.863236 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2b32-aa37-4e87-9e6c-839c5c339c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.863511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2b32-aa37-4e87-9e6c-839c5c339c77 admin admin] PATH_INFO: `/v3/projects/080f6aa633944844a2f3d2e92a84266d/users/7e92cb58ab5e4f2fba4fb1c4e0fa1f48/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.865477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2b32-aa37-4e87-9e6c-839c5c339c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=080f6aa633944844a2f3d2e92a84266d, user_id=7e92cb58ab5e4f2fba4fb1c4e0fa1f48, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:18.868155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2b32-aa37-4e87-9e6c-839c5c339c77 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:18.878716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1277/2536] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:18 2022] PUT /identity/v3/projects/080f6aa633944844a2f3d2e92a84266d/users/7e92cb58ab5e4f2fba4fb1c4e0fa1f48/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:18.889292 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810ec29-8544-4b10-8a3a-1d988442b713 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:18.889592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810ec29-8544-4b10-8a3a-1d988442b713 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:18.889873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810ec29-8544-4b10-8a3a-1d988442b713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:18.916464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-6810ec29-8544-4b10-8a3a-1d988442b713 None None] MFA Rules not processed for user `7e92cb58ab5e4f2fba4fb1c4e0fa1f48`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:18.917658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6810ec29-8544-4b10-8a3a-1d988442b713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:18.990961 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1260/2537] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:47:19.001867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2b32-aa37-4e87-9e6c-839c5c339c77 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:19.003698 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bbba2b32-aa37-4e87-9e6c-839c5c339c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:19.062375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2b32-aa37-4e87-9e6c-839c5c339c77 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:19.066299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b459b8-e72e-4290-8334-d24a1880be5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:19.066981 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b459b8-e72e-4290-8334-d24a1880be5c service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:19.067294 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b459b8-e72e-4290-8334-d24a1880be5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:19.067579 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b459b8-e72e-4290-8334-d24a1880be5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:19.076708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b459b8-e72e-4290-8334-d24a1880be5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:19.078177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b459b8-e72e-4290-8334-d24a1880be5c service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:19.088239 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1278/2538] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:20.444192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810ec29-8544-4b10-8a3a-1d988442b713 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:20.505378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810ec29-8544-4b10-8a3a-1d988442b713 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:20.509821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:20.510682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:20.510962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:20.511265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] PATH_INFO: `/v3/users/a6101d23986243f29c642bec841cccdc` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:20.512437 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6101d23986243f29c642bec841cccdc)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:20.514339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:20.561729 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6101d23986243f29c642bec841cccdc'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:20.562373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6101d23986243f29c642bec841cccdc'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:20.574220 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6101d23986243f29c642bec841cccdc'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:20.579068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:20.583696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6101d23986243f29c642bec841cccdc'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:20.591884 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6101d23986243f29c642bec841cccdc'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:20.598495 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1261/2539] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:20 2022] DELETE /identity/v3/users/a6101d23986243f29c642bec841cccdc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:20.602953 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5652-3eba-4ad9-aa4c-b4b03e00946f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:20.603453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5652-3eba-4ad9-aa4c-b4b03e00946f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:20.603551 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5652-3eba-4ad9-aa4c-b4b03e00946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:20.621408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a18d5652-3eba-4ad9-aa4c-b4b03e00946f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:20.622536 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a18d5652-3eba-4ad9-aa4c-b4b03e00946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:20.681272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1279/2540] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:20.691588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:20.692962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:20.748093 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243b2fc-4a3d-46be-bfd4-8cd7f1e329f7 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:20.752450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d23b49-0e0a-4e25-8d1d-66a3664843e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:20.753081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d23b49-0e0a-4e25-8d1d-66a3664843e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:20.753360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d23b49-0e0a-4e25-8d1d-66a3664843e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:20.753633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d23b49-0e0a-4e25-8d1d-66a3664843e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:20.762378 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d23b49-0e0a-4e25-8d1d-66a3664843e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:20.763811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d23b49-0e0a-4e25-8d1d-66a3664843e0 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:20.773359 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1262/2541] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:21.039202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d5652-3eba-4ad9-aa4c-b4b03e00946f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:21.041387 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a18d5652-3eba-4ad9-aa4c-b4b03e00946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:21.055021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d5652-3eba-4ad9-aa4c-b4b03e00946f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:21.059662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:21.060531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:21.060817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:21.061094 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] PATH_INFO: `/v3/projects/562c7cfbec84464dbf698371a4bad3bc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:21.062406 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=562c7cfbec84464dbf698371a4bad3bc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:21.064389 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:21.075963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:21.118014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562c7cfbec84464dbf698371a4bad3bc', 'request_id': 'req-0524c361-105a-4fc7-8653-d47859e0ab19'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.124373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562c7cfbec84464dbf698371a4bad3bc', 'request_id': 'req-0524c361-105a-4fc7-8653-d47859e0ab19'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.135636 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562c7cfbec84464dbf698371a4bad3bc', 'request_id': 'req-0524c361-105a-4fc7-8653-d47859e0ab19'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.148983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] The token cache is being invalidate because project 562c7cfbec84464dbf698371a4bad3bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:21.150318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.150318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.154923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1280/2542] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:21 2022] DELETE /identity/v3/projects/562c7cfbec84464dbf698371a4bad3bc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:21.156283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d23b49-0e0a-4e25-8d1d-66a3664843e0 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:21.167747 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d23b49-0e0a-4e25-8d1d-66a3664843e0 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:21.227807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe1956-c096-4587-81a0-7ba35aab51c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:21.228674 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1956-c096-4587-81a0-7ba35aab51c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:21.228954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1956-c096-4587-81a0-7ba35aab51c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:21.229230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1956-c096-4587-81a0-7ba35aab51c5 admin admin] PATH_INFO: `/v3/users/7e92cb58ab5e4f2fba4fb1c4e0fa1f48` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:21.230409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe1956-c096-4587-81a0-7ba35aab51c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e92cb58ab5e4f2fba4fb1c4e0fa1f48)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:21.232380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe1956-c096-4587-81a0-7ba35aab51c5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:21.277430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9bfe1956-c096-4587-81a0-7ba35aab51c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e92cb58ab5e4f2fba4fb1c4e0fa1f48'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.278071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9bfe1956-c096-4587-81a0-7ba35aab51c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e92cb58ab5e4f2fba4fb1c4e0fa1f48'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.290029 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9bfe1956-c096-4587-81a0-7ba35aab51c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e92cb58ab5e4f2fba4fb1c4e0fa1f48'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.297071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9bfe1956-c096-4587-81a0-7ba35aab51c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e92cb58ab5e4f2fba4fb1c4e0fa1f48'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.304342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9bfe1956-c096-4587-81a0-7ba35aab51c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e92cb58ab5e4f2fba4fb1c4e0fa1f48'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.310106 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1263/2543] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:21 2022] DELETE /identity/v3/users/7e92cb58ab5e4f2fba4fb1c4e0fa1f48 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:47:21.582170 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:21.583740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:21.606523 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524c361-105a-4fc7-8653-d47859e0ab19 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:21.668274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:21.669105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:21.669391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:21.669667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5 admin admin] PATH_INFO: `/v3/projects/080f6aa633944844a2f3d2e92a84266d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:21.670868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=080f6aa633944844a2f3d2e92a84266d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:21.673292 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:21.718862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080f6aa633944844a2f3d2e92a84266d', 'request_id': 'req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.728470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080f6aa633944844a2f3d2e92a84266d', 'request_id': 'req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.736382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080f6aa633944844a2f3d2e92a84266d', 'request_id': 'req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.748381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5 admin admin] The token cache is being invalidate because project 080f6aa633944844a2f3d2e92a84266d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:21.748603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.749227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e7b179c4-b0a2-4c95-a0c5-1540aae262a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:21.751338 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1281/2544] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:21 2022] DELETE /identity/v3/projects/080f6aa633944844a2f3d2e92a84266d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:21.756354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386da2b-56e2-493a-bde0-ee9e570e30d9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:21.756822 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386da2b-56e2-493a-bde0-ee9e570e30d9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:21.756926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386da2b-56e2-493a-bde0-ee9e570e30d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:21.775392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a386da2b-56e2-493a-bde0-ee9e570e30d9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:21.776572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a386da2b-56e2-493a-bde0-ee9e570e30d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:21.780656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:21.837517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1264/2545] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:21.846866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26656968-ad31-4a15-80b3-21e2cca613a7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:21.847153 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26656968-ad31-4a15-80b3-21e2cca613a7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:21.847489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26656968-ad31-4a15-80b3-21e2cca613a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:21.866382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-26656968-ad31-4a15-80b3-21e2cca613a7 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:21.867667 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-26656968-ad31-4a15-80b3-21e2cca613a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:21.875739 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1282/2546] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:21.879936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386da2b-56e2-493a-bde0-ee9e570e30d9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:21.890031 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386da2b-56e2-493a-bde0-ee9e570e30d9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:21.895087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bea884-368d-438e-9ca8-e8ce2ebacec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:21.895772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea884-368d-438e-9ca8-e8ce2ebacec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:21.896058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea884-368d-438e-9ca8-e8ce2ebacec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:21.896337 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea884-368d-438e-9ca8-e8ce2ebacec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:21.897061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bea884-368d-438e-9ca8-e8ce2ebacec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:47:21.897370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bea884-368d-438e-9ca8-e8ce2ebacec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:21.898965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bea884-368d-438e-9ca8-e8ce2ebacec0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:21.911030 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1265/2547] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:47:21.915235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26656968-ad31-4a15-80b3-21e2cca613a7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:21.925187 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26656968-ad31-4a15-80b3-21e2cca613a7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:21.929762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55de19-d51d-4488-acb9-7a5755dff957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:21.930411 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55de19-d51d-4488-acb9-7a5755dff957 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:21.930702 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55de19-d51d-4488-acb9-7a5755dff957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:21.930983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55de19-d51d-4488-acb9-7a5755dff957 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:21.931731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55de19-d51d-4488-acb9-7a5755dff957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:21.933634 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55de19-d51d-4488-acb9-7a5755dff957 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:21.952528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:21.960465 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1283/2548] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:21 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:21.964359 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bea884-368d-438e-9ca8-e8ce2ebacec0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:21.975164 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bea884-368d-438e-9ca8-e8ce2ebacec0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:22.030721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ede366-510d-4ccf-b7ec-b5f0cf5bc329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:22.031405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ede366-510d-4ccf-b7ec-b5f0cf5bc329 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.032211 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ede366-510d-4ccf-b7ec-b5f0cf5bc329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.032504 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ede366-510d-4ccf-b7ec-b5f0cf5bc329 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.033209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ede366-510d-4ccf-b7ec-b5f0cf5bc329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:22.035103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ede366-510d-4ccf-b7ec-b5f0cf5bc329 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:22.054326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1266/2549] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:21 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:22.058326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55de19-d51d-4488-acb9-7a5755dff957 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:22.068313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55de19-d51d-4488-acb9-7a5755dff957 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:22.072794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0433e3-8d52-4fb9-a8aa-e83dbf408fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:22.073445 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0433e3-8d52-4fb9-a8aa-e83dbf408fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.073740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0433e3-8d52-4fb9-a8aa-e83dbf408fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.074017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0433e3-8d52-4fb9-a8aa-e83dbf408fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.074728 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0433e3-8d52-4fb9-a8aa-e83dbf408fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:22.076355 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0433e3-8d52-4fb9-a8aa-e83dbf408fc1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:22.087326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1284/2550] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:47:22.091083 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ede366-510d-4ccf-b7ec-b5f0cf5bc329 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:22.101872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ede366-510d-4ccf-b7ec-b5f0cf5bc329 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:22.106343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee8e59-cf94-4e1c-a380-a46c7e3e7e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:22.106985 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee8e59-cf94-4e1c-a380-a46c7e3e7e0c admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.107309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee8e59-cf94-4e1c-a380-a46c7e3e7e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.107588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee8e59-cf94-4e1c-a380-a46c7e3e7e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.108301 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee8e59-cf94-4e1c-a380-a46c7e3e7e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:22.110373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee8e59-cf94-4e1c-a380-a46c7e3e7e0c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:22.120574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1267/2551] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:22.124482 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0433e3-8d52-4fb9-a8aa-e83dbf408fc1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:22.136126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0433e3-8d52-4fb9-a8aa-e83dbf408fc1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:22.140985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8c7d6-47e3-4f1d-8d31-5025c44ec1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:22.142256 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8c7d6-47e3-4f1d-8d31-5025c44ec1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.142570 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8c7d6-47e3-4f1d-8d31-5025c44ec1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.142847 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8c7d6-47e3-4f1d-8d31-5025c44ec1bc admin admin] PATH_INFO: `/v3/projects/6933b64afab74742b8adabd6d7e6dfba/users/afa8691aecac4a31baf911e18da0e4cb/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.157782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8c7d6-47e3-4f1d-8d31-5025c44ec1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6933b64afab74742b8adabd6d7e6dfba, user_id=afa8691aecac4a31baf911e18da0e4cb, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:22.160482 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8c7d6-47e3-4f1d-8d31-5025c44ec1bc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:22.174041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1285/2552] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:22 2022] PUT /identity/v3/projects/6933b64afab74742b8adabd6d7e6dfba/users/afa8691aecac4a31baf911e18da0e4cb/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:22.184277 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960829e-4eac-470e-ba10-19c9756ce546 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.184570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960829e-4eac-470e-ba10-19c9756ce546 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.184850 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960829e-4eac-470e-ba10-19c9756ce546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.213445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4960829e-4eac-470e-ba10-19c9756ce546 None None] MFA Rules not processed for user `afa8691aecac4a31baf911e18da0e4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:22.214650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4960829e-4eac-470e-ba10-19c9756ce546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:22.285676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1268/2553] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:22.290253 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8c7d6-47e3-4f1d-8d31-5025c44ec1bc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:22.354297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8c7d6-47e3-4f1d-8d31-5025c44ec1bc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:22.359177 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cab09-85c5-47d5-a329-c4ad3cb4c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:22.359987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cab09-85c5-47d5-a329-c4ad3cb4c1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.360275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cab09-85c5-47d5-a329-c4ad3cb4c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.360553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cab09-85c5-47d5-a329-c4ad3cb4c1d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.361246 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cab09-85c5-47d5-a329-c4ad3cb4c1d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:22.363160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cab09-85c5-47d5-a329-c4ad3cb4c1d5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:22.387131 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1286/2554] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:22 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:22.391815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960829e-4eac-470e-ba10-19c9756ce546 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:22.398413 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:22.403617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960829e-4eac-470e-ba10-19c9756ce546 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:22.465076 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bb41e-dee3-4509-9923-a24837256a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:22.465660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bb41e-dee3-4509-9923-a24837256a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.465945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bb41e-dee3-4509-9923-a24837256a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.466222 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bb41e-dee3-4509-9923-a24837256a3b admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.466924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bb41e-dee3-4509-9923-a24837256a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:22.468852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bb41e-dee3-4509-9923-a24837256a3b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:22.488140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1269/2555] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:22 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:22.492271 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cab09-85c5-47d5-a329-c4ad3cb4c1d5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:22.503330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cab09-85c5-47d5-a329-c4ad3cb4c1d5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:22.507968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0820d66-7ae3-498d-97d9-13c243ea30cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:22.508616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0820d66-7ae3-498d-97d9-13c243ea30cb admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.508900 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0820d66-7ae3-498d-97d9-13c243ea30cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.509178 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0820d66-7ae3-498d-97d9-13c243ea30cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.509895 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0820d66-7ae3-498d-97d9-13c243ea30cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:22.511527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0820d66-7ae3-498d-97d9-13c243ea30cb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:22.523182 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1287/2556] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:22.527014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bb41e-dee3-4509-9923-a24837256a3b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:22.537244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bb41e-dee3-4509-9923-a24837256a3b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:22.542059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4ba1-223d-4bcd-b349-acde8693d17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:22.542714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4ba1-223d-4bcd-b349-acde8693d17b admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.542998 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4ba1-223d-4bcd-b349-acde8693d17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.543307 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4ba1-223d-4bcd-b349-acde8693d17b admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.544032 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c4ba1-223d-4bcd-b349-acde8693d17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:22.545637 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c4ba1-223d-4bcd-b349-acde8693d17b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:22.555662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1270/2557] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:22.559818 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0820d66-7ae3-498d-97d9-13c243ea30cb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:22.570542 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0820d66-7ae3-498d-97d9-13c243ea30cb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:22.575136 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38fefa-0388-4019-a4b0-1e1aea68cd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:22.576037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38fefa-0388-4019-a4b0-1e1aea68cd95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.576320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38fefa-0388-4019-a4b0-1e1aea68cd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.576598 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38fefa-0388-4019-a4b0-1e1aea68cd95 admin admin] PATH_INFO: `/v3/projects/8c16008db2f448d2af78c1216d1bee4d/users/4d863bdac24f4285957a21bae0af3bb5/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.592541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38fefa-0388-4019-a4b0-1e1aea68cd95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c16008db2f448d2af78c1216d1bee4d, user_id=4d863bdac24f4285957a21bae0af3bb5, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:22.596396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38fefa-0388-4019-a4b0-1e1aea68cd95 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:22.609184 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1288/2558] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:22 2022] PUT /identity/v3/projects/8c16008db2f448d2af78c1216d1bee4d/users/4d863bdac24f4285957a21bae0af3bb5/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:22.619446 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797843e-d1f4-43b7-a848-943391a55fba None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.619737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797843e-d1f4-43b7-a848-943391a55fba None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.620018 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797843e-d1f4-43b7-a848-943391a55fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.647251 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7797843e-d1f4-43b7-a848-943391a55fba None None] MFA Rules not processed for user `4d863bdac24f4285957a21bae0af3bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:22.648451 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7797843e-d1f4-43b7-a848-943391a55fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:22.710037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1271/2559] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:22.714609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38fefa-0388-4019-a4b0-1e1aea68cd95 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:22.776716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38fefa-0388-4019-a4b0-1e1aea68cd95 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:22.781362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8966d12-764f-47f5-943f-dc8532d2b933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:22.782549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8966d12-764f-47f5-943f-dc8532d2b933 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.782833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8966d12-764f-47f5-943f-dc8532d2b933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.783113 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8966d12-764f-47f5-943f-dc8532d2b933 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.783826 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8966d12-764f-47f5-943f-dc8532d2b933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:22.785750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8966d12-764f-47f5-943f-dc8532d2b933 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:22.805241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:22.812241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1289/2560] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:22 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:22.816255 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797843e-d1f4-43b7-a848-943391a55fba None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:22.827017 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797843e-d1f4-43b7-a848-943391a55fba None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:22.888229 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3996-9358-4ba6-800c-3c77c46e708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:22.888899 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3996-9358-4ba6-800c-3c77c46e708b admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.889186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3996-9358-4ba6-800c-3c77c46e708b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.889467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3996-9358-4ba6-800c-3c77c46e708b admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.890162 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3996-9358-4ba6-800c-3c77c46e708b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:22.892888 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3996-9358-4ba6-800c-3c77c46e708b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:22.912556 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1272/2561] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:22 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:22.916523 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8966d12-764f-47f5-943f-dc8532d2b933 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:22.926769 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8966d12-764f-47f5-943f-dc8532d2b933 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:22.931316 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e325e-69be-4086-b3b3-c3847d096459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:22.931969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e325e-69be-4086-b3b3-c3847d096459 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.932252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e325e-69be-4086-b3b3-c3847d096459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.932530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e325e-69be-4086-b3b3-c3847d096459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.933312 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e325e-69be-4086-b3b3-c3847d096459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:22.935124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e325e-69be-4086-b3b3-c3847d096459 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:22.945459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1290/2562] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:22.949526 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3996-9358-4ba6-800c-3c77c46e708b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:22.955198 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:22.961366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3996-9358-4ba6-800c-3c77c46e708b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:22.966545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed8465-8982-4ce7-a311-25d77b2cc8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:22.967430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed8465-8982-4ce7-a311-25d77b2cc8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:22.967713 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed8465-8982-4ce7-a311-25d77b2cc8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:22.967988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed8465-8982-4ce7-a311-25d77b2cc8b0 admin admin] PATH_INFO: `/v3/projects/0f5beaf8c20d4019bf6fbe0d78badf9b/users/d64aebe5a6f440739c047b9345cb1641/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:22.983673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed8465-8982-4ce7-a311-25d77b2cc8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5beaf8c20d4019bf6fbe0d78badf9b, user_id=d64aebe5a6f440739c047b9345cb1641, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:22.987007 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed8465-8982-4ce7-a311-25d77b2cc8b0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:22.999545 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1273/2563] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:22 2022] PUT /identity/v3/projects/0f5beaf8c20d4019bf6fbe0d78badf9b/users/d64aebe5a6f440739c047b9345cb1641/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:23.004197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e325e-69be-4086-b3b3-c3847d096459 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:23.014063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e325e-69be-4086-b3b3-c3847d096459 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:23.069776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36513210-6129-4550-b91f-21c434651e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:23.070439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513210-6129-4550-b91f-21c434651e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:23.070725 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513210-6129-4550-b91f-21c434651e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:23.071008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36513210-6129-4550-b91f-21c434651e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:23.071747 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36513210-6129-4550-b91f-21c434651e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:23.073340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36513210-6129-4550-b91f-21c434651e5a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:23.083120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1291/2564] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:23.087076 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed8465-8982-4ce7-a311-25d77b2cc8b0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:23.097195 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed8465-8982-4ce7-a311-25d77b2cc8b0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:23.101712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ad7f6-b865-4a82-ac6b-aa3a45812e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:23.102581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ad7f6-b865-4a82-ac6b-aa3a45812e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:23.102865 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ad7f6-b865-4a82-ac6b-aa3a45812e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:23.103143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ad7f6-b865-4a82-ac6b-aa3a45812e0d admin admin] PATH_INFO: `/v3/projects/0f5beaf8c20d4019bf6fbe0d78badf9b/users/d64aebe5a6f440739c047b9345cb1641/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:23.105385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ad7f6-b865-4a82-ac6b-aa3a45812e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5beaf8c20d4019bf6fbe0d78badf9b, user_id=d64aebe5a6f440739c047b9345cb1641, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:23.108041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ad7f6-b865-4a82-ac6b-aa3a45812e0d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:23.118644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1274/2565] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:23 2022] PUT /identity/v3/projects/0f5beaf8c20d4019bf6fbe0d78badf9b/users/d64aebe5a6f440739c047b9345cb1641/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:47:23.130126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348559c7-a7e5-4beb-8a0a-f9b33acf8853 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:23.130420 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348559c7-a7e5-4beb-8a0a-f9b33acf8853 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:23.131113 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348559c7-a7e5-4beb-8a0a-f9b33acf8853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:23.159753 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-348559c7-a7e5-4beb-8a0a-f9b33acf8853 None None] MFA Rules not processed for user `d64aebe5a6f440739c047b9345cb1641`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:23.160974 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-348559c7-a7e5-4beb-8a0a-f9b33acf8853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:23.227458 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1292/2566] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:23.238506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ad7f6-b865-4a82-ac6b-aa3a45812e0d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:23.240204 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-db9ad7f6-b865-4a82-ac6b-aa3a45812e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:23.295686 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ad7f6-b865-4a82-ac6b-aa3a45812e0d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:23.299909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36629494-5d23-4142-ab8d-310650c6c4a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:23.300541 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36629494-5d23-4142-ab8d-310650c6c4a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:23.300820 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36629494-5d23-4142-ab8d-310650c6c4a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:23.301095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36629494-5d23-4142-ab8d-310650c6c4a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:23.309987 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36629494-5d23-4142-ab8d-310650c6c4a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:23.311433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36629494-5d23-4142-ab8d-310650c6c4a0 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:23.321659 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1275/2567] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:23.840677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348559c7-a7e5-4beb-8a0a-f9b33acf8853 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:23.842078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-348559c7-a7e5-4beb-8a0a-f9b33acf8853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:23.853722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348559c7-a7e5-4beb-8a0a-f9b33acf8853 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:23.857222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8c76e-997b-43f7-801e-fbabda1a2ca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:23.857853 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8c76e-997b-43f7-801e-fbabda1a2ca8 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:23.858133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8c76e-997b-43f7-801e-fbabda1a2ca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:23.858405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8c76e-997b-43f7-801e-fbabda1a2ca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:23.916388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8c76e-997b-43f7-801e-fbabda1a2ca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:23.917809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8c76e-997b-43f7-801e-fbabda1a2ca8 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:23.926974 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1293/2568] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:27.923146 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36629494-5d23-4142-ab8d-310650c6c4a0 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:27.931866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36629494-5d23-4142-ab8d-310650c6c4a0 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:27.935570 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d8744-bc38-4ae7-9ff1-7abf0c4e0460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:27.936203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d8744-bc38-4ae7-9ff1-7abf0c4e0460 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:27.936487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d8744-bc38-4ae7-9ff1-7abf0c4e0460 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:27.936767 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d8744-bc38-4ae7-9ff1-7abf0c4e0460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:27.994494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d8744-bc38-4ae7-9ff1-7abf0c4e0460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:27.995949 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d8744-bc38-4ae7-9ff1-7abf0c4e0460 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:28.004947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1276/2569] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:30.217048 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8c76e-997b-43f7-801e-fbabda1a2ca8 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:30.227622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:30.280822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8c76e-997b-43f7-801e-fbabda1a2ca8 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:30.286035 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:30.286900 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:30.287193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:30.287478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] PATH_INFO: `/v3/users/afa8691aecac4a31baf911e18da0e4cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:30.288644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa8691aecac4a31baf911e18da0e4cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:30.290556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:30.339425 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa8691aecac4a31baf911e18da0e4cb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:30.348396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa8691aecac4a31baf911e18da0e4cb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:30.356218 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa8691aecac4a31baf911e18da0e4cb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:30.356988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa8691aecac4a31baf911e18da0e4cb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:30.369564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa8691aecac4a31baf911e18da0e4cb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:30.376058 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1294/2570] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:30 2022] DELETE /identity/v3/users/afa8691aecac4a31baf911e18da0e4cb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:30.380606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43c145-e3c7-486c-9935-3aae724a7982 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:30.381073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43c145-e3c7-486c-9935-3aae724a7982 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:30.381190 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43c145-e3c7-486c-9935-3aae724a7982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:30.399291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-0e43c145-e3c7-486c-9935-3aae724a7982 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:30.400508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0e43c145-e3c7-486c-9935-3aae724a7982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:30.464226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1277/2571] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:30.474416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:30.475871 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:30.540431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b18fef-4b8e-4d13-8a61-002c0029f3cc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:30.544115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f2f3e-b937-453c-b667-668d2c9cc39a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:30.545051 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f2f3e-b937-453c-b667-668d2c9cc39a service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:30.545339 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f2f3e-b937-453c-b667-668d2c9cc39a service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:30.545609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f2f3e-b937-453c-b667-668d2c9cc39a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:30.554976 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f2f3e-b937-453c-b667-668d2c9cc39a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:30.556441 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f2f3e-b937-453c-b667-668d2c9cc39a service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:30.566592 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1295/2572] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:30.851754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43c145-e3c7-486c-9935-3aae724a7982 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:30.853250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0e43c145-e3c7-486c-9935-3aae724a7982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:30.869320 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43c145-e3c7-486c-9935-3aae724a7982 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:30.877049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:30.878303 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:30.878694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:30.879152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] PATH_INFO: `/v3/projects/6933b64afab74742b8adabd6d7e6dfba` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:30.881222 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6933b64afab74742b8adabd6d7e6dfba)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:30.883879 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:30.885684 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:30.942662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6933b64afab74742b8adabd6d7e6dfba', 'request_id': 'req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:30.952192 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6933b64afab74742b8adabd6d7e6dfba', 'request_id': 'req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:30.959491 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6933b64afab74742b8adabd6d7e6dfba', 'request_id': 'req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:30.972470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] The token cache is being invalidate because project 6933b64afab74742b8adabd6d7e6dfba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:30.972794 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:30.973508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:30.975058 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1278/2573] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:30 2022] DELETE /identity/v3/projects/6933b64afab74742b8adabd6d7e6dfba => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:30.979056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f2f3e-b937-453c-b667-668d2c9cc39a service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:30.989568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f2f3e-b937-453c-b667-668d2c9cc39a service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:31.026291 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:31.062489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:31.063561 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:31.063861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:31.064134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] PATH_INFO: `/v3/users/4d863bdac24f4285957a21bae0af3bb5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:31.065342 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d863bdac24f4285957a21bae0af3bb5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:31.067324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:31.125359 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d863bdac24f4285957a21bae0af3bb5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:31.149230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d863bdac24f4285957a21bae0af3bb5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:31.159898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d863bdac24f4285957a21bae0af3bb5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:31.160952 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d863bdac24f4285957a21bae0af3bb5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:31.180651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d863bdac24f4285957a21bae0af3bb5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:31.190984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1296/2574] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:30 2022] DELETE /identity/v3/users/4d863bdac24f4285957a21bae0af3bb5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:31.219238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:31.220806 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:31.524027 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe866f-b2e6-4b4d-8a44-276cf8a9f3f8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:31.697064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7503142-6a40-4e89-b0d1-cd842a2781a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:31.697758 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7503142-6a40-4e89-b0d1-cd842a2781a2 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:31.698044 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7503142-6a40-4e89-b0d1-cd842a2781a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:31.698323 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7503142-6a40-4e89-b0d1-cd842a2781a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:31.700198 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e7503142-6a40-4e89-b0d1-cd842a2781a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:31.714063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7503142-6a40-4e89-b0d1-cd842a2781a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:31.715725 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7503142-6a40-4e89-b0d1-cd842a2781a2 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:31.729006 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1279/2575] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:31.795226 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:31.797546 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:31.887751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c83b7e-2ba7-4583-ac7b-e9ea8becb427 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:31.894143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:31.895144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:31.895602 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:31.895875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] PATH_INFO: `/v3/projects/8c16008db2f448d2af78c1216d1bee4d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:31.897119 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c16008db2f448d2af78c1216d1bee4d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:31.899038 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:31.951931 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c16008db2f448d2af78c1216d1bee4d', 'request_id': 'req-6fcf25e9-ca20-448e-a05d-43d51ad189ca'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:31.954582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:31.962021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c16008db2f448d2af78c1216d1bee4d', 'request_id': 'req-6fcf25e9-ca20-448e-a05d-43d51ad189ca'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:31.970996 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c16008db2f448d2af78c1216d1bee4d', 'request_id': 'req-6fcf25e9-ca20-448e-a05d-43d51ad189ca'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:31.982406 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] The token cache is being invalidate because project 8c16008db2f448d2af78c1216d1bee4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:31.982695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:31.983444 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:31.985724 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1297/2576] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:31 2022] DELETE /identity/v3/projects/8c16008db2f448d2af78c1216d1bee4d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:31.989672 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7503142-6a40-4e89-b0d1-cd842a2781a2 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:32.003343 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7503142-6a40-4e89-b0d1-cd842a2781a2 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:32.013971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:32.067829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49a95a-048c-40fe-af9a-51ce875565fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:32.068717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49a95a-048c-40fe-af9a-51ce875565fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:32.069005 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49a95a-048c-40fe-af9a-51ce875565fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:32.069282 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49a95a-048c-40fe-af9a-51ce875565fd admin admin] PATH_INFO: `/v3/users/d64aebe5a6f440739c047b9345cb1641` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:32.070502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49a95a-048c-40fe-af9a-51ce875565fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64aebe5a6f440739c047b9345cb1641)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:32.072483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49a95a-048c-40fe-af9a-51ce875565fd admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:32.125501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-de49a95a-048c-40fe-af9a-51ce875565fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64aebe5a6f440739c047b9345cb1641'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:32.126326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-de49a95a-048c-40fe-af9a-51ce875565fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64aebe5a6f440739c047b9345cb1641'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:32.139649 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-de49a95a-048c-40fe-af9a-51ce875565fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64aebe5a6f440739c047b9345cb1641'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:32.148765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-de49a95a-048c-40fe-af9a-51ce875565fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64aebe5a6f440739c047b9345cb1641'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:32.156839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-de49a95a-048c-40fe-af9a-51ce875565fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64aebe5a6f440739c047b9345cb1641'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:32.162985 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1280/2577] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:31 2022] DELETE /identity/v3/users/d64aebe5a6f440739c047b9345cb1641 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:32.452611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:32.454944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:32.472101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf25e9-ca20-448e-a05d-43d51ad189ca admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:32.534851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ad2fe-231e-4990-8a4f-7f0951def9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:32.535915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ad2fe-231e-4990-8a4f-7f0951def9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:32.536322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ad2fe-231e-4990-8a4f-7f0951def9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:32.536703 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ad2fe-231e-4990-8a4f-7f0951def9a6 admin admin] PATH_INFO: `/v3/projects/0f5beaf8c20d4019bf6fbe0d78badf9b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:32.538057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ad2fe-231e-4990-8a4f-7f0951def9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f5beaf8c20d4019bf6fbe0d78badf9b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:32.540340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ad2fe-231e-4990-8a4f-7f0951def9a6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:32.602690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-213ad2fe-231e-4990-8a4f-7f0951def9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5beaf8c20d4019bf6fbe0d78badf9b', 'request_id': 'req-213ad2fe-231e-4990-8a4f-7f0951def9a6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:32.613828 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-213ad2fe-231e-4990-8a4f-7f0951def9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5beaf8c20d4019bf6fbe0d78badf9b', 'request_id': 'req-213ad2fe-231e-4990-8a4f-7f0951def9a6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:32.622615 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-213ad2fe-231e-4990-8a4f-7f0951def9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5beaf8c20d4019bf6fbe0d78badf9b', 'request_id': 'req-213ad2fe-231e-4990-8a4f-7f0951def9a6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:32.635809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-213ad2fe-231e-4990-8a4f-7f0951def9a6 admin admin] The token cache is being invalidate because project 0f5beaf8c20d4019bf6fbe0d78badf9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:32.636105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-213ad2fe-231e-4990-8a4f-7f0951def9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:32.636782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-213ad2fe-231e-4990-8a4f-7f0951def9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:32.638972 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1298/2578] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:32 2022] DELETE /identity/v3/projects/0f5beaf8c20d4019bf6fbe0d78badf9b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:32.646228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1d110-78b6-4313-947a-4e2de8a5cae9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:32.646805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1d110-78b6-4313-947a-4e2de8a5cae9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:32.646805 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1d110-78b6-4313-947a-4e2de8a5cae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:32.667654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c1b1d110-78b6-4313-947a-4e2de8a5cae9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:32.669037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c1b1d110-78b6-4313-947a-4e2de8a5cae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:32.760840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1281/2579] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:32.774705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09a5a1-53ad-4c9b-9bb4-7b326ea06375 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:32.775107 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09a5a1-53ad-4c9b-9bb4-7b326ea06375 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:32.775513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09a5a1-53ad-4c9b-9bb4-7b326ea06375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:32.806808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-af09a5a1-53ad-4c9b-9bb4-7b326ea06375 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:32.808083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-af09a5a1-53ad-4c9b-9bb4-7b326ea06375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:32.824289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1299/2580] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:32.825650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1d110-78b6-4313-947a-4e2de8a5cae9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:32.838495 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1d110-78b6-4313-947a-4e2de8a5cae9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:32.846349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22c7cb-fb47-4c6a-81c1-1fdd7908097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:32.847049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22c7cb-fb47-4c6a-81c1-1fdd7908097a admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:32.847386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22c7cb-fb47-4c6a-81c1-1fdd7908097a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:32.847859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22c7cb-fb47-4c6a-81c1-1fdd7908097a admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:32.848703 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22c7cb-fb47-4c6a-81c1-1fdd7908097a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:47:32.849134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22c7cb-fb47-4c6a-81c1-1fdd7908097a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:32.851410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22c7cb-fb47-4c6a-81c1-1fdd7908097a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:32.867238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1282/2581] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:47:32.871831 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09a5a1-53ad-4c9b-9bb4-7b326ea06375 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:32.884210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09a5a1-53ad-4c9b-9bb4-7b326ea06375 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:32.889965 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716b2ee-d466-493c-b880-6ec33d32bb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:32.892409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716b2ee-d466-493c-b880-6ec33d32bb60 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:32.892727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716b2ee-d466-493c-b880-6ec33d32bb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:32.893001 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716b2ee-d466-493c-b880-6ec33d32bb60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:32.893738 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716b2ee-d466-493c-b880-6ec33d32bb60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:32.896117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716b2ee-d466-493c-b880-6ec33d32bb60 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:32.931810 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1300/2582] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:32 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:32.933785 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22c7cb-fb47-4c6a-81c1-1fdd7908097a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:32.949770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22c7cb-fb47-4c6a-81c1-1fdd7908097a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:32.979332 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:33.026683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ed53c-613e-4569-bd82-30d33ccabce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:33.027398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ed53c-613e-4569-bd82-30d33ccabce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:33.027689 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ed53c-613e-4569-bd82-30d33ccabce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:33.027965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ed53c-613e-4569-bd82-30d33ccabce6 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:33.028664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ed53c-613e-4569-bd82-30d33ccabce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:33.030592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ed53c-613e-4569-bd82-30d33ccabce6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:33.056232 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1283/2583] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:32 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:33.057651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716b2ee-d466-493c-b880-6ec33d32bb60 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:33.069226 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716b2ee-d466-493c-b880-6ec33d32bb60 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:33.074762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23415201-48ad-4cf1-9735-13268e218ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:33.075727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23415201-48ad-4cf1-9735-13268e218ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:33.076057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23415201-48ad-4cf1-9735-13268e218ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:33.076357 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23415201-48ad-4cf1-9735-13268e218ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:33.077189 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23415201-48ad-4cf1-9735-13268e218ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:33.079700 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23415201-48ad-4cf1-9735-13268e218ae6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:33.092039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1301/2584] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:33.096203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ed53c-613e-4569-bd82-30d33ccabce6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:33.108209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ed53c-613e-4569-bd82-30d33ccabce6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:33.113464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df041877-3416-446b-a71b-a446bb799d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:33.114266 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df041877-3416-446b-a71b-a446bb799d8d admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:33.114549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df041877-3416-446b-a71b-a446bb799d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:33.114869 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df041877-3416-446b-a71b-a446bb799d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:33.115634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df041877-3416-446b-a71b-a446bb799d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:33.117231 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df041877-3416-446b-a71b-a446bb799d8d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:33.129524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1284/2585] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:33.133868 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23415201-48ad-4cf1-9735-13268e218ae6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:33.144382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23415201-48ad-4cf1-9735-13268e218ae6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:33.150468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cee01-f3f6-4150-a8ca-00ac256c2113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:33.151597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cee01-f3f6-4150-a8ca-00ac256c2113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:33.151933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cee01-f3f6-4150-a8ca-00ac256c2113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:33.152276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cee01-f3f6-4150-a8ca-00ac256c2113 admin admin] PATH_INFO: `/v3/projects/67b851a8c51e4fa0b77042fc22bd5123/users/16d5e04511e2489c933c713e2b4399de/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:33.171233 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cee01-f3f6-4150-a8ca-00ac256c2113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b851a8c51e4fa0b77042fc22bd5123, user_id=16d5e04511e2489c933c713e2b4399de, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:33.174468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cee01-f3f6-4150-a8ca-00ac256c2113 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:33.189543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1302/2586] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:33 2022] PUT /identity/v3/projects/67b851a8c51e4fa0b77042fc22bd5123/users/16d5e04511e2489c933c713e2b4399de/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:33.201757 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b852f4-9563-4d25-aa6f-5ee2928f736e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:33.202048 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b852f4-9563-4d25-aa6f-5ee2928f736e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:33.202331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b852f4-9563-4d25-aa6f-5ee2928f736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:33.230109 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-45b852f4-9563-4d25-aa6f-5ee2928f736e None None] MFA Rules not processed for user `16d5e04511e2489c933c713e2b4399de`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:33.231360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-45b852f4-9563-4d25-aa6f-5ee2928f736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:33.299548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1285/2587] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:33.311379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cee01-f3f6-4150-a8ca-00ac256c2113 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:33.313067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-db8cee01-f3f6-4150-a8ca-00ac256c2113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:33.322549 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:33.373008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cee01-f3f6-4150-a8ca-00ac256c2113 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:33.376790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b361b-43d6-402f-913a-960b364c32eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f892e618b01a46aaaab4f79aa0c3daa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:33.377446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b361b-43d6-402f-913a-960b364c32eb service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:33.377730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b361b-43d6-402f-913a-960b364c32eb service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:33.378007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b361b-43d6-402f-913a-960b364c32eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:33.386547 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b361b-43d6-402f-913a-960b364c32eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:33.388031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b361b-43d6-402f-913a-960b364c32eb service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:33.397814 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1303/2588] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:35.951073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b852f4-9563-4d25-aa6f-5ee2928f736e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:35.952508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-45b852f4-9563-4d25-aa6f-5ee2928f736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:36.010620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b852f4-9563-4d25-aa6f-5ee2928f736e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:36.015025 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942dfd3-c4ef-43fa-9dd0-042a5abd50b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:36.015867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942dfd3-c4ef-43fa-9dd0-042a5abd50b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:36.016506 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942dfd3-c4ef-43fa-9dd0-042a5abd50b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:36.016840 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942dfd3-c4ef-43fa-9dd0-042a5abd50b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:36.018758 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7942dfd3-c4ef-43fa-9dd0-042a5abd50b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:36.062078 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:36.083769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942dfd3-c4ef-43fa-9dd0-042a5abd50b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:36.085206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942dfd3-c4ef-43fa-9dd0-042a5abd50b1 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:36.095588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1286/2589] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:37.120528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b361b-43d6-402f-913a-960b364c32eb service glance] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:37.122286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-852b361b-43d6-402f-913a-960b364c32eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:37.143580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b361b-43d6-402f-913a-960b364c32eb service glance] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:37.149933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:37.150860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:37.151318 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:37.151648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] PATH_INFO: `/v3/users/94483b3b79ff48429a26ce1d901299b4` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:37.153656 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94483b3b79ff48429a26ce1d901299b4)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:37.155036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:37.227673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94483b3b79ff48429a26ce1d901299b4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:37.238437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94483b3b79ff48429a26ce1d901299b4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:37.245986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94483b3b79ff48429a26ce1d901299b4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:37.246659 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94483b3b79ff48429a26ce1d901299b4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:37.260565 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94483b3b79ff48429a26ce1d901299b4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:37.268537 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1304/2590] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:37 2022] DELETE /identity/v3/users/94483b3b79ff48429a26ce1d901299b4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:37.273304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235c4a1-9d21-45d4-95e4-8f7dfa983e20 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:37.273816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235c4a1-9d21-45d4-95e4-8f7dfa983e20 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:37.273816 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235c4a1-9d21-45d4-95e4-8f7dfa983e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:37.293352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8235c4a1-9d21-45d4-95e4-8f7dfa983e20 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:37.294577 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8235c4a1-9d21-45d4-95e4-8f7dfa983e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:37.363427 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1287/2591] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:47:37.373593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:37.375114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:37.442552 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413373e8-d81b-4410-871e-6792cc246f53 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:37.446275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80e7d0-c3b1-4bf8-86b2-9b85223dd478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:37.446932 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80e7d0-c3b1-4bf8-86b2-9b85223dd478 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:37.447248 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80e7d0-c3b1-4bf8-86b2-9b85223dd478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:37.447535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80e7d0-c3b1-4bf8-86b2-9b85223dd478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:37.457564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80e7d0-c3b1-4bf8-86b2-9b85223dd478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:37.459013 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80e7d0-c3b1-4bf8-86b2-9b85223dd478 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:37.470769 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1305/2592] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:37.822546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235c4a1-9d21-45d4-95e4-8f7dfa983e20 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:37.824345 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8235c4a1-9d21-45d4-95e4-8f7dfa983e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:37.867941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235c4a1-9d21-45d4-95e4-8f7dfa983e20 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:37.873219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:37.874197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:37.875314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:37.875735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] PATH_INFO: `/v3/projects/45f0e9c05c454f3398732a2a2286a618` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:37.877206 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f0e9c05c454f3398732a2a2286a618)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:37.879246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:37.941906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f0e9c05c454f3398732a2a2286a618', 'request_id': 'req-681b6802-55f1-4def-a650-f1daf718041f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:37.960400 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f0e9c05c454f3398732a2a2286a618', 'request_id': 'req-681b6802-55f1-4def-a650-f1daf718041f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:37.966694 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f0e9c05c454f3398732a2a2286a618', 'request_id': 'req-681b6802-55f1-4def-a650-f1daf718041f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:37.979363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] The token cache is being invalidate because project 45f0e9c05c454f3398732a2a2286a618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:37.979731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:37.980557 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:37.982437 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1288/2593] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:37 2022] DELETE /identity/v3/projects/45f0e9c05c454f3398732a2a2286a618 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:37.987390 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80e7d0-c3b1-4bf8-86b2-9b85223dd478 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:38.001780 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80e7d0-c3b1-4bf8-86b2-9b85223dd478 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:38.025837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:38.089403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d99937-6f36-4242-a39b-2eb88449eaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:38.089403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d99937-6f36-4242-a39b-2eb88449eaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:38.089403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d99937-6f36-4242-a39b-2eb88449eaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:38.089403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d99937-6f36-4242-a39b-2eb88449eaf5 admin admin] PATH_INFO: `/v3/users/559d6dba0a4e47c2a11a788646b4950c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:38.089878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d99937-6f36-4242-a39b-2eb88449eaf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=559d6dba0a4e47c2a11a788646b4950c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:38.089878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d99937-6f36-4242-a39b-2eb88449eaf5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:38.161485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-06d99937-6f36-4242-a39b-2eb88449eaf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559d6dba0a4e47c2a11a788646b4950c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:38.170142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-06d99937-6f36-4242-a39b-2eb88449eaf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559d6dba0a4e47c2a11a788646b4950c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:38.178184 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-06d99937-6f36-4242-a39b-2eb88449eaf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559d6dba0a4e47c2a11a788646b4950c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:38.178878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-06d99937-6f36-4242-a39b-2eb88449eaf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559d6dba0a4e47c2a11a788646b4950c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:38.200204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-06d99937-6f36-4242-a39b-2eb88449eaf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559d6dba0a4e47c2a11a788646b4950c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:38.208026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1306/2594] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:37 2022] DELETE /identity/v3/users/559d6dba0a4e47c2a11a788646b4950c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:38.666103 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:38.667599 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:38.681302 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b6802-55f1-4def-a650-f1daf718041f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:38.750445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:38.751363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:38.751635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:38.751911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7 admin admin] PATH_INFO: `/v3/projects/c05a419d6006454ea13b8233b6ed2606` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:38.753197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05a419d6006454ea13b8233b6ed2606)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:38.755139 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:38.757635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:38.809126 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05a419d6006454ea13b8233b6ed2606', 'request_id': 'req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:38.823916 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05a419d6006454ea13b8233b6ed2606', 'request_id': 'req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:38.831219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05a419d6006454ea13b8233b6ed2606', 'request_id': 'req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:38.843664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7 admin admin] The token cache is being invalidate because project c05a419d6006454ea13b8233b6ed2606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:38.843857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:38.844621 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3ae5f6ca-f3cc-4ecc-b429-520a5f2d3cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:38.846305 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1289/2595] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:38 2022] DELETE /identity/v3/projects/c05a419d6006454ea13b8233b6ed2606 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:38.854899 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3a88f-599d-480a-9efd-987e1fc3c9c0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:38.855208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3a88f-599d-480a-9efd-987e1fc3c9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:38.855505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3a88f-599d-480a-9efd-987e1fc3c9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:38.887558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1aa3a88f-599d-480a-9efd-987e1fc3c9c0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:38.890092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1aa3a88f-599d-480a-9efd-987e1fc3c9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:38.981942 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1307/2596] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:38.996712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb265c-2417-4335-bd0b-005213e6e150 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:38.997073 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb265c-2417-4335-bd0b-005213e6e150 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:38.997439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb265c-2417-4335-bd0b-005213e6e150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.018920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-16eb265c-2417-4335-bd0b-005213e6e150 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:39.020296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-16eb265c-2417-4335-bd0b-005213e6e150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:39.028901 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1290/2597] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:39.034041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3a88f-599d-480a-9efd-987e1fc3c9c0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:39.046144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3a88f-599d-480a-9efd-987e1fc3c9c0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:39.055759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2c564-e23b-4c6b-be50-113c9f27c66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:39.056532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2c564-e23b-4c6b-be50-113c9f27c66e admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:39.056972 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2c564-e23b-4c6b-be50-113c9f27c66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:39.057263 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2c564-e23b-4c6b-be50-113c9f27c66e admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.058066 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2c564-e23b-4c6b-be50-113c9f27c66e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:47:39.058440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2c564-e23b-4c6b-be50-113c9f27c66e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:39.061460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2c564-e23b-4c6b-be50-113c9f27c66e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:39.083391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1308/2598] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:47:39.087475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb265c-2417-4335-bd0b-005213e6e150 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:39.107502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb265c-2417-4335-bd0b-005213e6e150 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:39.119484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805481f-eecd-4e82-a9af-2cbed01a3f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:39.120166 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805481f-eecd-4e82-a9af-2cbed01a3f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:39.120462 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805481f-eecd-4e82-a9af-2cbed01a3f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:39.120743 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805481f-eecd-4e82-a9af-2cbed01a3f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.121449 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805481f-eecd-4e82-a9af-2cbed01a3f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:39.133236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805481f-eecd-4e82-a9af-2cbed01a3f70 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:39.182096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1291/2599] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:39 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:39.186383 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2c564-e23b-4c6b-be50-113c9f27c66e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:39.201942 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2c564-e23b-4c6b-be50-113c9f27c66e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:39.255969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:39.301505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f283a-bd3e-4346-8f7a-f140e256390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:39.301820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f283a-bd3e-4346-8f7a-f140e256390e admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:39.302114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f283a-bd3e-4346-8f7a-f140e256390e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:39.302396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f283a-bd3e-4346-8f7a-f140e256390e admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.304016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f283a-bd3e-4346-8f7a-f140e256390e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:39.306183 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f283a-bd3e-4346-8f7a-f140e256390e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:39.336332 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1309/2600] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:39 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:47:39.340443 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805481f-eecd-4e82-a9af-2cbed01a3f70 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:39.354975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805481f-eecd-4e82-a9af-2cbed01a3f70 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:39.366321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c40ae-badd-4f5b-a718-d40f0559c07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:39.366989 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c40ae-badd-4f5b-a718-d40f0559c07e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:39.367310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c40ae-badd-4f5b-a718-d40f0559c07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:39.367588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c40ae-badd-4f5b-a718-d40f0559c07e admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.368553 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c40ae-badd-4f5b-a718-d40f0559c07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:39.370651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c40ae-badd-4f5b-a718-d40f0559c07e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:39.389498 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1292/2601] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:39.395115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f283a-bd3e-4346-8f7a-f140e256390e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:39.410160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f283a-bd3e-4346-8f7a-f140e256390e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:39.416115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4633cb-7641-46b1-bab4-211ac74e45a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:39.416829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4633cb-7641-46b1-bab4-211ac74e45a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:39.417164 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4633cb-7641-46b1-bab4-211ac74e45a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:39.417455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4633cb-7641-46b1-bab4-211ac74e45a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.418300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4633cb-7641-46b1-bab4-211ac74e45a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:39.420045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4633cb-7641-46b1-bab4-211ac74e45a9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:39.435235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1310/2602] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:39.441290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c40ae-badd-4f5b-a718-d40f0559c07e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:39.457283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c40ae-badd-4f5b-a718-d40f0559c07e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:39.463062 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e8909-1f42-442b-a027-ce256e4419b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:39.464239 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e8909-1f42-442b-a027-ce256e4419b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:39.464625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e8909-1f42-442b-a027-ce256e4419b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:39.465001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e8909-1f42-442b-a027-ce256e4419b4 admin admin] PATH_INFO: `/v3/projects/3c70a02419be429cbba2697bab908dfd/users/96466682024f474598e3a8f3b1fab8f1/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.489134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e8909-1f42-442b-a027-ce256e4419b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c70a02419be429cbba2697bab908dfd, user_id=96466682024f474598e3a8f3b1fab8f1, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:39.493992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e8909-1f42-442b-a027-ce256e4419b4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:39.518064 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1293/2603] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:39 2022] PUT /identity/v3/projects/3c70a02419be429cbba2697bab908dfd/users/96466682024f474598e3a8f3b1fab8f1/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:39.528603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4633cb-7641-46b1-bab4-211ac74e45a9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:39.531489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fd4633cb-7641-46b1-bab4-211ac74e45a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:39.533177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49799923-edea-458f-8549-e0db673c1846 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:39.533476 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49799923-edea-458f-8549-e0db673c1846 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:39.533761 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49799923-edea-458f-8549-e0db673c1846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.550762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4633cb-7641-46b1-bab4-211ac74e45a9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:39.572398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-49799923-edea-458f-8549-e0db673c1846 None None] MFA Rules not processed for user `96466682024f474598e3a8f3b1fab8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:39.573654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-49799923-edea-458f-8549-e0db673c1846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:39.622440 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ae6c0-8e1d-4f9e-94a5-17367f3e2364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:39.623358 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ae6c0-8e1d-4f9e-94a5-17367f3e2364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:39.623640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ae6c0-8e1d-4f9e-94a5-17367f3e2364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:39.623921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ae6c0-8e1d-4f9e-94a5-17367f3e2364 admin admin] PATH_INFO: `/v3/users/e651c2917c75425fb656dfb145a5bc4a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.626471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ae6c0-8e1d-4f9e-94a5-17367f3e2364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e651c2917c75425fb656dfb145a5bc4a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:39.628202 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ae6c0-8e1d-4f9e-94a5-17367f3e2364 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:39.649287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1294/2604] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:39.653362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49799923-edea-458f-8549-e0db673c1846 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:39.665634 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49799923-edea-458f-8549-e0db673c1846 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:39.671407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0650b4-8963-420f-9f14-7b3849e2a466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:39.672194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0650b4-8963-420f-9f14-7b3849e2a466 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:39.672643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0650b4-8963-420f-9f14-7b3849e2a466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:39.672919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0650b4-8963-420f-9f14-7b3849e2a466 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.673620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0650b4-8963-420f-9f14-7b3849e2a466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:39.675549 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0650b4-8963-420f-9f14-7b3849e2a466 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:39.685448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c05ae6c0-8e1d-4f9e-94a5-17367f3e2364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e651c2917c75425fb656dfb145a5bc4a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:39.690492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:39.693599 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c05ae6c0-8e1d-4f9e-94a5-17367f3e2364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e651c2917c75425fb656dfb145a5bc4a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:39.705856 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1295/2605] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:39 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:47:39.708441 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c05ae6c0-8e1d-4f9e-94a5-17367f3e2364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e651c2917c75425fb656dfb145a5bc4a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:39.709317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c05ae6c0-8e1d-4f9e-94a5-17367f3e2364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e651c2917c75425fb656dfb145a5bc4a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:39.709910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0650b4-8963-420f-9f14-7b3849e2a466 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:39.711612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-bf0650b4-8963-420f-9f14-7b3849e2a466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:39.722449 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c05ae6c0-8e1d-4f9e-94a5-17367f3e2364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e651c2917c75425fb656dfb145a5bc4a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:39.728609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1311/2606] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:39 2022] DELETE /identity/v3/users/e651c2917c75425fb656dfb145a5bc4a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:39.781659 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0650b4-8963-420f-9f14-7b3849e2a466 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:39.845827 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c96b-1825-48ec-86a5-48bd029c3ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:39.846509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c96b-1825-48ec-86a5-48bd029c3ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:39.846795 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c96b-1825-48ec-86a5-48bd029c3ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:39.847079 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c96b-1825-48ec-86a5-48bd029c3ebd admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.847798 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3c96b-1825-48ec-86a5-48bd029c3ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:39.853618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3c96b-1825-48ec-86a5-48bd029c3ebd admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:39.880784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1296/2607] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:39 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:47:39.881931 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ae6c0-8e1d-4f9e-94a5-17367f3e2364 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:39.892268 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ae6c0-8e1d-4f9e-94a5-17367f3e2364 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:39.897531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d700fe0-b4ba-43c0-9425-b09871dcc2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:39.898251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d700fe0-b4ba-43c0-9425-b09871dcc2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:39.898539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d700fe0-b4ba-43c0-9425-b09871dcc2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:39.898888 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d700fe0-b4ba-43c0-9425-b09871dcc2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.899652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d700fe0-b4ba-43c0-9425-b09871dcc2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:39.901367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d700fe0-b4ba-43c0-9425-b09871dcc2f4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:39.915205 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1312/2608] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:39.917963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c96b-1825-48ec-86a5-48bd029c3ebd admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:39.929101 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d700fe0-b4ba-43c0-9425-b09871dcc2f4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:39.929933 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c96b-1825-48ec-86a5-48bd029c3ebd admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:39.931230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9d700fe0-b4ba-43c0-9425-b09871dcc2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:39.935188 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b5f2d-6202-43b5-b9a2-3ed004247b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:39.936157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b5f2d-6202-43b5-b9a2-3ed004247b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:39.936375 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b5f2d-6202-43b5-b9a2-3ed004247b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:39.936650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b5f2d-6202-43b5-b9a2-3ed004247b28 admin admin] PATH_INFO: `/v3/projects/65da8f61810745bfaac5be50191aa3bf/users/33f53fab6486459499488a3947352548/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.947485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d700fe0-b4ba-43c0-9425-b09871dcc2f4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:39.959717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cf03d-0b61-42db-a3e9-e387bc39b936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:39.960605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cf03d-0b61-42db-a3e9-e387bc39b936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:39.960976 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cf03d-0b61-42db-a3e9-e387bc39b936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:39.961189 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cf03d-0b61-42db-a3e9-e387bc39b936 admin admin] PATH_INFO: `/v3/projects/20a47e2671b14b769bd4bb8aaf2449ab` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:39.962409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cf03d-0b61-42db-a3e9-e387bc39b936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a47e2671b14b769bd4bb8aaf2449ab)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:39.964359 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cf03d-0b61-42db-a3e9-e387bc39b936 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:39.964581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b5f2d-6202-43b5-b9a2-3ed004247b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65da8f61810745bfaac5be50191aa3bf, user_id=33f53fab6486459499488a3947352548, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:39.967325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b5f2d-6202-43b5-b9a2-3ed004247b28 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:39.979490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:39.981643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1297/2609] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:39 2022] PUT /identity/v3/projects/65da8f61810745bfaac5be50191aa3bf/users/33f53fab6486459499488a3947352548/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:39.987533 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b5f2d-6202-43b5-b9a2-3ed004247b28 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:40.020017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b90cf03d-0b61-42db-a3e9-e387bc39b936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a47e2671b14b769bd4bb8aaf2449ab', 'request_id': 'req-b90cf03d-0b61-42db-a3e9-e387bc39b936'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:40.026642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b90cf03d-0b61-42db-a3e9-e387bc39b936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a47e2671b14b769bd4bb8aaf2449ab', 'request_id': 'req-b90cf03d-0b61-42db-a3e9-e387bc39b936'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:40.039351 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b90cf03d-0b61-42db-a3e9-e387bc39b936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a47e2671b14b769bd4bb8aaf2449ab', 'request_id': 'req-b90cf03d-0b61-42db-a3e9-e387bc39b936'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:40.052704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b90cf03d-0b61-42db-a3e9-e387bc39b936 admin admin] The token cache is being invalidate because project 20a47e2671b14b769bd4bb8aaf2449ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:40.052997 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b90cf03d-0b61-42db-a3e9-e387bc39b936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:40.053649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b90cf03d-0b61-42db-a3e9-e387bc39b936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:40.055241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1313/2610] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:39 2022] DELETE /identity/v3/projects/20a47e2671b14b769bd4bb8aaf2449ab => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:40.059884 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b5f2d-6202-43b5-b9a2-3ed004247b28 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:40.060049 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d3ad6-1719-4b6d-b2ba-578f1e2c535b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.060195 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d3ad6-1719-4b6d-b2ba-578f1e2c535b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.060456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d3ad6-1719-4b6d-b2ba-578f1e2c535b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.072572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:40.080933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f22d3ad6-1719-4b6d-b2ba-578f1e2c535b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:40.082360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f22d3ad6-1719-4b6d-b2ba-578f1e2c535b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:40.129311 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4715c-4638-4d7e-9849-a73897d86019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:40.130220 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4715c-4638-4d7e-9849-a73897d86019 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.130394 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4715c-4638-4d7e-9849-a73897d86019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.130772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4715c-4638-4d7e-9849-a73897d86019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.131923 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4715c-4638-4d7e-9849-a73897d86019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:40.133938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4715c-4638-4d7e-9849-a73897d86019 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:40.147482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1298/2611] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:47:40.152575 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4715c-4638-4d7e-9849-a73897d86019 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:40.152848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1314/2612] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:40.162430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b2f4715c-4638-4d7e-9849-a73897d86019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:40.163393 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc32b79-2a0c-4c66-9cc8-e4bad6f28324 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.163685 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc32b79-2a0c-4c66-9cc8-e4bad6f28324 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.163993 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc32b79-2a0c-4c66-9cc8-e4bad6f28324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.177228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4715c-4638-4d7e-9849-a73897d86019 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:40.182511 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ce675-bc13-4b0c-9948-635604e29306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:40.183405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ce675-bc13-4b0c-9948-635604e29306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.183693 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ce675-bc13-4b0c-9948-635604e29306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.183975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ce675-bc13-4b0c-9948-635604e29306 admin admin] PATH_INFO: `/v3/projects/65da8f61810745bfaac5be50191aa3bf/users/33f53fab6486459499488a3947352548/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.185372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ecc32b79-2a0c-4c66-9cc8-e4bad6f28324 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:40.185999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ce675-bc13-4b0c-9948-635604e29306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65da8f61810745bfaac5be50191aa3bf, user_id=33f53fab6486459499488a3947352548, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:40.186632 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ecc32b79-2a0c-4c66-9cc8-e4bad6f28324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:40.189475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ce675-bc13-4b0c-9948-635604e29306 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:40.199686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1315/2613] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:40.204569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc32b79-2a0c-4c66-9cc8-e4bad6f28324 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:40.214201 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1299/2614] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:40 2022] PUT /identity/v3/projects/65da8f61810745bfaac5be50191aa3bf/users/33f53fab6486459499488a3947352548/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:47:40.214369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc32b79-2a0c-4c66-9cc8-e4bad6f28324 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:40.215900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b27840-36f3-4421-a1f0-d046d02de0ea None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.216199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b27840-36f3-4421-a1f0-d046d02de0ea None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.216483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b27840-36f3-4421-a1f0-d046d02de0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.246283 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a2b27840-36f3-4421-a1f0-d046d02de0ea None None] MFA Rules not processed for user `33f53fab6486459499488a3947352548`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:40.247671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a2b27840-36f3-4421-a1f0-d046d02de0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:40.280671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd9951-cb84-4f85-9d3f-070fea8a7253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:40.281491 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9951-cb84-4f85-9d3f-070fea8a7253 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.281745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9951-cb84-4f85-9d3f-070fea8a7253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.282025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9951-cb84-4f85-9d3f-070fea8a7253 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.282788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd9951-cb84-4f85-9d3f-070fea8a7253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:47:40.283259 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd9951-cb84-4f85-9d3f-070fea8a7253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:40.284880 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd9951-cb84-4f85-9d3f-070fea8a7253 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:40.297735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1316/2615] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:47:40.302125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd9951-cb84-4f85-9d3f-070fea8a7253 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:40.313576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd9951-cb84-4f85-9d3f-070fea8a7253 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:40.318472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a626b38-4e64-49ed-a590-a5262ee9caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:40.319148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a626b38-4e64-49ed-a590-a5262ee9caa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.319659 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a626b38-4e64-49ed-a590-a5262ee9caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.319776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a626b38-4e64-49ed-a590-a5262ee9caa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.320427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a626b38-4e64-49ed-a590-a5262ee9caa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:40.322489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a626b38-4e64-49ed-a590-a5262ee9caa7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:40.323737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1300/2616] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:47:40.335381 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b27840-36f3-4421-a1f0-d046d02de0ea None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:40.336845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a2b27840-36f3-4421-a1f0-d046d02de0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:40.355231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1317/2617] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:40 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:47:40.356894 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a626b38-4e64-49ed-a590-a5262ee9caa7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:40.367296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:40.408755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b27840-36f3-4421-a1f0-d046d02de0ea None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:40.430235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a626b38-4e64-49ed-a590-a5262ee9caa7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:40.435740 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326132be-fd17-4cbb-a495-c2cbe195ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:40.436428 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326132be-fd17-4cbb-a495-c2cbe195ecfc admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.437262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326132be-fd17-4cbb-a495-c2cbe195ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.437541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326132be-fd17-4cbb-a495-c2cbe195ecfc admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.438462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326132be-fd17-4cbb-a495-c2cbe195ecfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:40.440430 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326132be-fd17-4cbb-a495-c2cbe195ecfc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:40.454094 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:40.462501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1318/2618] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:40 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:47:40.466605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326132be-fd17-4cbb-a495-c2cbe195ecfc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:40.472296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c070d5-bb16-442c-a1cc-5643263683ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:40.472924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c070d5-bb16-442c-a1cc-5643263683ad service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.473263 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c070d5-bb16-442c-a1cc-5643263683ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.473687 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c070d5-bb16-442c-a1cc-5643263683ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.482629 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326132be-fd17-4cbb-a495-c2cbe195ecfc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:40.488086 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a8a13-58dd-42fd-9b21-bc031c1e4a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:40.488862 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a8a13-58dd-42fd-9b21-bc031c1e4a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.489149 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a8a13-58dd-42fd-9b21-bc031c1e4a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.489431 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a8a13-58dd-42fd-9b21-bc031c1e4a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.490185 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a8a13-58dd-42fd-9b21-bc031c1e4a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:40.491913 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a8a13-58dd-42fd-9b21-bc031c1e4a2b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:40.505879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1319/2619] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:47:40.506990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a8a13-58dd-42fd-9b21-bc031c1e4a2b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:40.518017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a8a13-58dd-42fd-9b21-bc031c1e4a2b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:40.522858 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4060b1-ac1a-432b-a0c4-262dd9f9fc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:40.523576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4060b1-ac1a-432b-a0c4-262dd9f9fc98 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.523870 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4060b1-ac1a-432b-a0c4-262dd9f9fc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.524152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4060b1-ac1a-432b-a0c4-262dd9f9fc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.524880 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4060b1-ac1a-432b-a0c4-262dd9f9fc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:40.526520 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4060b1-ac1a-432b-a0c4-262dd9f9fc98 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:40.541233 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1320/2620] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:40.542437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4060b1-ac1a-432b-a0c4-262dd9f9fc98 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:40.551989 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c070d5-bb16-442c-a1cc-5643263683ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:40.553488 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c070d5-bb16-442c-a1cc-5643263683ad service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:40.554228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4060b1-ac1a-432b-a0c4-262dd9f9fc98 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:40.558964 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b8457-7d4f-42e3-9d68-5e30f4151b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:40.559880 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b8457-7d4f-42e3-9d68-5e30f4151b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.560160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b8457-7d4f-42e3-9d68-5e30f4151b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.560427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b8457-7d4f-42e3-9d68-5e30f4151b81 admin admin] PATH_INFO: `/v3/projects/329c53ec98ce4574acfe47a2b1ea87ad/users/1663768f5e734624896ba98db07bb45d/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.564181 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1301/2621] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:40.576017 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b8457-7d4f-42e3-9d68-5e30f4151b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=329c53ec98ce4574acfe47a2b1ea87ad, user_id=1663768f5e734624896ba98db07bb45d, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:40.579528 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b8457-7d4f-42e3-9d68-5e30f4151b81 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:40.595641 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1321/2622] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:40 2022] PUT /identity/v3/projects/329c53ec98ce4574acfe47a2b1ea87ad/users/1663768f5e734624896ba98db07bb45d/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:40.596868 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c070d5-bb16-442c-a1cc-5643263683ad service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:40.601531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4305b-cd04-4cfe-9878-8eff2f020e93 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.601887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4305b-cd04-4cfe-9878-8eff2f020e93 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.602013 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4305b-cd04-4cfe-9878-8eff2f020e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.611261 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c070d5-bb16-442c-a1cc-5643263683ad service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:40.619268 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-74f4305b-cd04-4cfe-9878-8eff2f020e93 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:40.620587 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-74f4305b-cd04-4cfe-9878-8eff2f020e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:40.675910 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe3c2-e83e-46ad-b8e2-1036f0579e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:40.676789 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe3c2-e83e-46ad-b8e2-1036f0579e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.677034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe3c2-e83e-46ad-b8e2-1036f0579e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.677432 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe3c2-e83e-46ad-b8e2-1036f0579e33 admin admin] PATH_INFO: `/v3/users/96466682024f474598e3a8f3b1fab8f1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.678651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fe3c2-e83e-46ad-b8e2-1036f0579e33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96466682024f474598e3a8f3b1fab8f1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:40.681050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fe3c2-e83e-46ad-b8e2-1036f0579e33 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:40.685237 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1322/2623] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:47:40.695432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4305b-cd04-4cfe-9878-8eff2f020e93 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:40.696928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-74f4305b-cd04-4cfe-9878-8eff2f020e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:40.731041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bd1fe3c2-e83e-46ad-b8e2-1036f0579e33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96466682024f474598e3a8f3b1fab8f1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:40.731747 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bd1fe3c2-e83e-46ad-b8e2-1036f0579e33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96466682024f474598e3a8f3b1fab8f1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:40.745579 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bd1fe3c2-e83e-46ad-b8e2-1036f0579e33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96466682024f474598e3a8f3b1fab8f1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:40.757392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bd1fe3c2-e83e-46ad-b8e2-1036f0579e33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96466682024f474598e3a8f3b1fab8f1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:40.762663 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4305b-cd04-4cfe-9878-8eff2f020e93 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:40.765609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bd1fe3c2-e83e-46ad-b8e2-1036f0579e33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96466682024f474598e3a8f3b1fab8f1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:40.766864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7338251-ff13-48f4-ab51-d8da6bf53e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:40.767610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7338251-ff13-48f4-ab51-d8da6bf53e5f service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.767885 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7338251-ff13-48f4-ab51-d8da6bf53e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.768293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7338251-ff13-48f4-ab51-d8da6bf53e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.769948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f7338251-ff13-48f4-ab51-d8da6bf53e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:40.772403 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1302/2624] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:40 2022] DELETE /identity/v3/users/96466682024f474598e3a8f3b1fab8f1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:40.776775 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae2796-1330-4bc8-bf9a-375115f109b9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.777049 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae2796-1330-4bc8-bf9a-375115f109b9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.777331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae2796-1330-4bc8-bf9a-375115f109b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.779072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:40.783580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7338251-ff13-48f4-ab51-d8da6bf53e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:40.786169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7338251-ff13-48f4-ab51-d8da6bf53e5f service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:40.797720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1323/2625] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:47:40.800019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-bdae2796-1330-4bc8-bf9a-375115f109b9 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:40.801244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-bdae2796-1330-4bc8-bf9a-375115f109b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:40.805654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:40.875717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1303/2626] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:47:40.886489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7338251-ff13-48f4-ab51-d8da6bf53e5f service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:40.887972 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f7338251-ff13-48f4-ab51-d8da6bf53e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:40.900507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7338251-ff13-48f4-ab51-d8da6bf53e5f service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:40.956912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89383d-8608-40e6-9bd5-838d2c7458e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:40.957790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89383d-8608-40e6-9bd5-838d2c7458e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:40.958053 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89383d-8608-40e6-9bd5-838d2c7458e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:40.958329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89383d-8608-40e6-9bd5-838d2c7458e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:40.970070 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89383d-8608-40e6-9bd5-838d2c7458e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:40.971556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89383d-8608-40e6-9bd5-838d2c7458e6 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:40.982071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1324/2627] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:41.447733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae2796-1330-4bc8-bf9a-375115f109b9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:41.449236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-bdae2796-1330-4bc8-bf9a-375115f109b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:41.462190 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae2796-1330-4bc8-bf9a-375115f109b9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:41.467965 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:41.469142 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:41.471923 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:41.472213 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] PATH_INFO: `/v3/projects/3c70a02419be429cbba2697bab908dfd` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:41.474428 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c70a02419be429cbba2697bab908dfd)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:41.476424 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:41.535486 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c70a02419be429cbba2697bab908dfd', 'request_id': 'req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:41.545025 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c70a02419be429cbba2697bab908dfd', 'request_id': 'req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:41.555650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c70a02419be429cbba2697bab908dfd', 'request_id': 'req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:41.572553 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] The token cache is being invalidate because project 3c70a02419be429cbba2697bab908dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:41.572901 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:41.573854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:41.575664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1304/2628] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:41 2022] DELETE /identity/v3/projects/3c70a02419be429cbba2697bab908dfd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:41.580199 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89383d-8608-40e6-9bd5-838d2c7458e6 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:41.603490 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89383d-8608-40e6-9bd5-838d2c7458e6 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:41.681389 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8714e-4239-4461-b7ca-18111193da5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:41.682378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8714e-4239-4461-b7ca-18111193da5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:41.682738 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8714e-4239-4461-b7ca-18111193da5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:41.683118 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8714e-4239-4461-b7ca-18111193da5f admin admin] PATH_INFO: `/v3/users/33f53fab6486459499488a3947352548` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:41.684416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8714e-4239-4461-b7ca-18111193da5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f53fab6486459499488a3947352548)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:41.687638 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8714e-4239-4461-b7ca-18111193da5f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:41.756634 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-59a8714e-4239-4461-b7ca-18111193da5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f53fab6486459499488a3947352548'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:41.766251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-59a8714e-4239-4461-b7ca-18111193da5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f53fab6486459499488a3947352548'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:41.774168 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-59a8714e-4239-4461-b7ca-18111193da5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f53fab6486459499488a3947352548'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:41.774865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-59a8714e-4239-4461-b7ca-18111193da5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f53fab6486459499488a3947352548'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:41.787851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-59a8714e-4239-4461-b7ca-18111193da5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f53fab6486459499488a3947352548'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:41.794252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1325/2629] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:41 2022] DELETE /identity/v3/users/33f53fab6486459499488a3947352548 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:42.129059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:42.131105 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:42.157085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce409b6-dbf0-4ae6-9994-5b9a34f9033d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:42.247362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:42.248223 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:42.248511 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:42.248783 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca admin admin] PATH_INFO: `/v3/projects/65da8f61810745bfaac5be50191aa3bf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:42.250294 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=65da8f61810745bfaac5be50191aa3bf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:42.252292 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:42.324622 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:42.341065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65da8f61810745bfaac5be50191aa3bf', 'request_id': 'req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:42.350604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65da8f61810745bfaac5be50191aa3bf', 'request_id': 'req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:42.357349 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65da8f61810745bfaac5be50191aa3bf', 'request_id': 'req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:42.372878 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca admin admin] The token cache is being invalidate because project 65da8f61810745bfaac5be50191aa3bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:42.373292 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:42.373977 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-def248ee-c3f5-46cd-8f76-dcc6534fd2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:42.376847 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1305/2630] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:42 2022] DELETE /identity/v3/projects/65da8f61810745bfaac5be50191aa3bf => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:42.381950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb92c0-058c-405a-a43a-9250f00b94eb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:42.382317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb92c0-058c-405a-a43a-9250f00b94eb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:42.382686 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb92c0-058c-405a-a43a-9250f00b94eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:42.409043 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-32fb92c0-058c-405a-a43a-9250f00b94eb None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:42.410664 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-32fb92c0-058c-405a-a43a-9250f00b94eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:42.427756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:42.528129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1326/2631] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:42.536285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e367-91e7-40a8-a5d2-3cb59b89312a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:42.537272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e367-91e7-40a8-a5d2-3cb59b89312a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:42.537832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e367-91e7-40a8-a5d2-3cb59b89312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:42.564453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2fb1e367-91e7-40a8-a5d2-3cb59b89312a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:42.566197 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2fb1e367-91e7-40a8-a5d2-3cb59b89312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:42.584557 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1306/2632] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:42.594827 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb92c0-058c-405a-a43a-9250f00b94eb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:42.610999 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb92c0-058c-405a-a43a-9250f00b94eb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:42.617275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb25f3-2e6f-428a-8ce5-86096b744644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:42.618051 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb25f3-2e6f-428a-8ce5-86096b744644 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:42.618335 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb25f3-2e6f-428a-8ce5-86096b744644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:42.618608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb25f3-2e6f-428a-8ce5-86096b744644 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:42.619447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb25f3-2e6f-428a-8ce5-86096b744644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:47:42.619691 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb25f3-2e6f-428a-8ce5-86096b744644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:42.621546 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb25f3-2e6f-428a-8ce5-86096b744644 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:42.636864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1327/2633] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:47:42.642297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e367-91e7-40a8-a5d2-3cb59b89312a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:42.652499 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e367-91e7-40a8-a5d2-3cb59b89312a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:42.671200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52df94a-8442-4ac7-bd96-de330640b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:42.673346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52df94a-8442-4ac7-bd96-de330640b077 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:42.673658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52df94a-8442-4ac7-bd96-de330640b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:42.673931 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52df94a-8442-4ac7-bd96-de330640b077 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:42.674672 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52df94a-8442-4ac7-bd96-de330640b077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:42.676692 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52df94a-8442-4ac7-bd96-de330640b077 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:42.722765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1307/2634] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:42 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:42.727050 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb25f3-2e6f-428a-8ce5-86096b744644 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:42.739578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb25f3-2e6f-428a-8ce5-86096b744644 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:42.814405 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c573d0-c008-44b2-91c5-9182fa9449db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:42.815100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c573d0-c008-44b2-91c5-9182fa9449db admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:42.815429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c573d0-c008-44b2-91c5-9182fa9449db admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:42.815711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c573d0-c008-44b2-91c5-9182fa9449db admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:42.816422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c573d0-c008-44b2-91c5-9182fa9449db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:42.818400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c573d0-c008-44b2-91c5-9182fa9449db admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:42.846446 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1328/2635] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:42 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:47:42.850650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52df94a-8442-4ac7-bd96-de330640b077 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:42.863035 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52df94a-8442-4ac7-bd96-de330640b077 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:42.868534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3033aa-e88f-49e1-8c12-94cc2d8215a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:42.869329 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3033aa-e88f-49e1-8c12-94cc2d8215a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:42.869681 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3033aa-e88f-49e1-8c12-94cc2d8215a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:42.870026 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3033aa-e88f-49e1-8c12-94cc2d8215a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:42.870868 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3033aa-e88f-49e1-8c12-94cc2d8215a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:42.872627 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3033aa-e88f-49e1-8c12-94cc2d8215a5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:42.885363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1308/2636] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:42.889541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c573d0-c008-44b2-91c5-9182fa9449db admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:42.901621 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c573d0-c008-44b2-91c5-9182fa9449db admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:42.907327 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c352670-24c8-4177-9a1c-75e6452dc6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:42.908011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c352670-24c8-4177-9a1c-75e6452dc6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:42.908296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c352670-24c8-4177-9a1c-75e6452dc6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:42.908575 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c352670-24c8-4177-9a1c-75e6452dc6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:42.909305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c352670-24c8-4177-9a1c-75e6452dc6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:42.911198 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c352670-24c8-4177-9a1c-75e6452dc6f1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:42.924884 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1329/2637] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:42.930485 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3033aa-e88f-49e1-8c12-94cc2d8215a5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:42.941597 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3033aa-e88f-49e1-8c12-94cc2d8215a5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:42.946537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846632b-51ae-4684-8cc4-315e5897beaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:42.947557 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846632b-51ae-4684-8cc4-315e5897beaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:42.947909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846632b-51ae-4684-8cc4-315e5897beaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:42.948328 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846632b-51ae-4684-8cc4-315e5897beaa admin admin] PATH_INFO: `/v3/projects/ffd24393ebfe425094f5436a544a8e80/users/6f3fc6701b8149d697ab0c806b5f8ea2/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:42.966221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846632b-51ae-4684-8cc4-315e5897beaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd24393ebfe425094f5436a544a8e80, user_id=6f3fc6701b8149d697ab0c806b5f8ea2, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:42.969537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846632b-51ae-4684-8cc4-315e5897beaa admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:42.984143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1309/2638] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:42 2022] PUT /identity/v3/projects/ffd24393ebfe425094f5436a544a8e80/users/6f3fc6701b8149d697ab0c806b5f8ea2/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:43.054739 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ae06-d588-4c28-9bcb-fc11d37792ab None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:43.055027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ae06-d588-4c28-9bcb-fc11d37792ab None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:43.055639 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ae06-d588-4c28-9bcb-fc11d37792ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:43.085677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fd87ae06-d588-4c28-9bcb-fc11d37792ab None None] MFA Rules not processed for user `6f3fc6701b8149d697ab0c806b5f8ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:43.087369 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fd87ae06-d588-4c28-9bcb-fc11d37792ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:43.164896 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1330/2639] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:43.169406 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846632b-51ae-4684-8cc4-315e5897beaa admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:43.247948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846632b-51ae-4684-8cc4-315e5897beaa admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:43.253856 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55196c-095f-4182-9afe-b9e59bbc3e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:43.254538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55196c-095f-4182-9afe-b9e59bbc3e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:43.254829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55196c-095f-4182-9afe-b9e59bbc3e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:43.255112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55196c-095f-4182-9afe-b9e59bbc3e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:43.255861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55196c-095f-4182-9afe-b9e59bbc3e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:43.257786 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55196c-095f-4182-9afe-b9e59bbc3e84 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:43.287569 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1310/2640] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:43 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:43.291906 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87ae06-d588-4c28-9bcb-fc11d37792ab None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:43.304601 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87ae06-d588-4c28-9bcb-fc11d37792ab None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:43.313934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:43.407111 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e85446-9446-423c-9685-259172c973a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:43.408152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e85446-9446-423c-9685-259172c973a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:43.408870 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e85446-9446-423c-9685-259172c973a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:43.409333 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e85446-9446-423c-9685-259172c973a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:43.429234 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e85446-9446-423c-9685-259172c973a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:43.432056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e85446-9446-423c-9685-259172c973a7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:43.463227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1331/2641] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:43 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:43.467255 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55196c-095f-4182-9afe-b9e59bbc3e84 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:43.480664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55196c-095f-4182-9afe-b9e59bbc3e84 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:43.486014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea7fbb-b594-4d93-9ff3-c31baa67862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:43.486369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea7fbb-b594-4d93-9ff3-c31baa67862d admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:43.486655 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea7fbb-b594-4d93-9ff3-c31baa67862d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:43.486934 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea7fbb-b594-4d93-9ff3-c31baa67862d admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:43.487731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea7fbb-b594-4d93-9ff3-c31baa67862d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:43.489350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea7fbb-b594-4d93-9ff3-c31baa67862d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:43.501521 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1311/2642] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:47:43.505822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e85446-9446-423c-9685-259172c973a7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:43.518460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e85446-9446-423c-9685-259172c973a7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:43.524001 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f6a70-8d13-4643-8c9d-0a08ce3abbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:43.524945 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f6a70-8d13-4643-8c9d-0a08ce3abbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:43.525394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f6a70-8d13-4643-8c9d-0a08ce3abbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:43.525682 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f6a70-8d13-4643-8c9d-0a08ce3abbbf admin admin] PATH_INFO: `/v3/projects/de58a53991ae4bdbafc4688e6f6802f7/users/3344754137404d99b0109e9f34e58d29/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:43.550926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f6a70-8d13-4643-8c9d-0a08ce3abbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=de58a53991ae4bdbafc4688e6f6802f7, user_id=3344754137404d99b0109e9f34e58d29, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:43.553779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f6a70-8d13-4643-8c9d-0a08ce3abbbf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:43.571096 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1332/2643] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:43 2022] PUT /identity/v3/projects/de58a53991ae4bdbafc4688e6f6802f7/users/3344754137404d99b0109e9f34e58d29/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:43.575248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea7fbb-b594-4d93-9ff3-c31baa67862d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:43.587215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea7fbb-b594-4d93-9ff3-c31baa67862d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:43.615210 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:43.659892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea27a9-9708-4f48-a441-07c8fade14ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:43.660567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea27a9-9708-4f48-a441-07c8fade14ec admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:43.660852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea27a9-9708-4f48-a441-07c8fade14ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:43.661130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea27a9-9708-4f48-a441-07c8fade14ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:43.661863 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea27a9-9708-4f48-a441-07c8fade14ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:43.663769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea27a9-9708-4f48-a441-07c8fade14ec admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:43.677986 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1312/2644] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:47:43.679622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f6a70-8d13-4643-8c9d-0a08ce3abbbf admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:43.693346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f6a70-8d13-4643-8c9d-0a08ce3abbbf admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:43.698576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea9f3e-21c6-41b0-bc0a-aae2a581dace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:43.700001 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9f3e-21c6-41b0-bc0a-aae2a581dace admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:43.700366 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9f3e-21c6-41b0-bc0a-aae2a581dace admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:43.700726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9f3e-21c6-41b0-bc0a-aae2a581dace admin admin] PATH_INFO: `/v3/projects/de58a53991ae4bdbafc4688e6f6802f7/users/3344754137404d99b0109e9f34e58d29/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:43.703389 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea9f3e-21c6-41b0-bc0a-aae2a581dace admin admin] RBAC: Authorizing `identity:create_grant(project_id=de58a53991ae4bdbafc4688e6f6802f7, user_id=3344754137404d99b0109e9f34e58d29, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:43.706073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea9f3e-21c6-41b0-bc0a-aae2a581dace admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:43.729564 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1333/2645] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:43 2022] PUT /identity/v3/projects/de58a53991ae4bdbafc4688e6f6802f7/users/3344754137404d99b0109e9f34e58d29/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:43.730945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea22f1-48d9-4274-8866-bd79f91cf7b5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:43.731326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea22f1-48d9-4274-8866-bd79f91cf7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:43.731567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea22f1-48d9-4274-8866-bd79f91cf7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:43.770779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-82ea22f1-48d9-4274-8866-bd79f91cf7b5 None None] MFA Rules not processed for user `3344754137404d99b0109e9f34e58d29`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:43.772417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-82ea22f1-48d9-4274-8866-bd79f91cf7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:43.878665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1313/2646] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:47:43.886307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea9f3e-21c6-41b0-bc0a-aae2a581dace admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:43.888095 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6eea9f3e-21c6-41b0-bc0a-aae2a581dace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:43.974798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea9f3e-21c6-41b0-bc0a-aae2a581dace admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:43.978630 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c932b-6bb9-42d5-9c35-6921311066af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:43.979866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c932b-6bb9-42d5-9c35-6921311066af service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:43.979866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c932b-6bb9-42d5-9c35-6921311066af service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:43.980091 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c932b-6bb9-42d5-9c35-6921311066af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:43.992179 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c932b-6bb9-42d5-9c35-6921311066af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:43.993655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c932b-6bb9-42d5-9c35-6921311066af service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:44.005604 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1334/2647] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:44.115396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea22f1-48d9-4274-8866-bd79f91cf7b5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:44.125665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea22f1-48d9-4274-8866-bd79f91cf7b5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:44.129994 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c70099-e199-46a3-8de0-96c534b3da71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:44.130656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c70099-e199-46a3-8de0-96c534b3da71 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:44.130943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c70099-e199-46a3-8de0-96c534b3da71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:44.131265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c70099-e199-46a3-8de0-96c534b3da71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:44.208390 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c70099-e199-46a3-8de0-96c534b3da71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:44.210326 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c70099-e199-46a3-8de0-96c534b3da71 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:44.221633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1314/2648] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:45.331566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfae8f-4180-49a8-a17e-9489e0bdcf80 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:45.332078 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfae8f-4180-49a8-a17e-9489e0bdcf80 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:45.332211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfae8f-4180-49a8-a17e-9489e0bdcf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:45.368618 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b6cfae8f-4180-49a8-a17e-9489e0bdcf80 None None] MFA Rules not processed for user `1663768f5e734624896ba98db07bb45d`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:45.369835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b6cfae8f-4180-49a8-a17e-9489e0bdcf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:45.445669 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:45.456715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1335/2649] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:47:45.470676 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c70099-e199-46a3-8de0-96c534b3da71 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:45.472157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-51c70099-e199-46a3-8de0-96c534b3da71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:45.524420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:45.561186 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c70099-e199-46a3-8de0-96c534b3da71 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:45.572887 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1d94f-a0db-40c5-bbe0-7bba0a1c0951 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:45.573726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1d94f-a0db-40c5-bbe0-7bba0a1c0951 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:45.574198 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1d94f-a0db-40c5-bbe0-7bba0a1c0951 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:45.574542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1d94f-a0db-40c5-bbe0-7bba0a1c0951 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:45.585040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1d94f-a0db-40c5-bbe0-7bba0a1c0951 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:45.586651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1d94f-a0db-40c5-bbe0-7bba0a1c0951 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:45.601594 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1315/2650] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:47.002437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfae8f-4180-49a8-a17e-9489e0bdcf80 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:47.072127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfae8f-4180-49a8-a17e-9489e0bdcf80 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:47.076776 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78937614-b203-4f84-a8f3-84ec947fbc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:47.078466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78937614-b203-4f84-a8f3-84ec947fbc34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:47.078794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78937614-b203-4f84-a8f3-84ec947fbc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:47.079137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78937614-b203-4f84-a8f3-84ec947fbc34 admin admin] PATH_INFO: `/v3/users/6f3fc6701b8149d697ab0c806b5f8ea2` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:47.080463 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78937614-b203-4f84-a8f3-84ec947fbc34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f3fc6701b8149d697ab0c806b5f8ea2)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:47.082460 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78937614-b203-4f84-a8f3-84ec947fbc34 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:47.135364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-78937614-b203-4f84-a8f3-84ec947fbc34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f3fc6701b8149d697ab0c806b5f8ea2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:47.145501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-78937614-b203-4f84-a8f3-84ec947fbc34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f3fc6701b8149d697ab0c806b5f8ea2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:47.153189 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-78937614-b203-4f84-a8f3-84ec947fbc34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f3fc6701b8149d697ab0c806b5f8ea2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:47.153962 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-78937614-b203-4f84-a8f3-84ec947fbc34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f3fc6701b8149d697ab0c806b5f8ea2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:47.166311 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-78937614-b203-4f84-a8f3-84ec947fbc34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f3fc6701b8149d697ab0c806b5f8ea2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:47.172894 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1336/2651] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:47 2022] DELETE /identity/v3/users/6f3fc6701b8149d697ab0c806b5f8ea2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:47.178385 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0ab96-062d-468e-b962-82ccf611590c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:47.178914 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0ab96-062d-468e-b962-82ccf611590c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:47.178914 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0ab96-062d-468e-b962-82ccf611590c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:47.199312 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-93b0ab96-062d-468e-b962-82ccf611590c None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:47.200601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-93b0ab96-062d-468e-b962-82ccf611590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:47.258154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e6fee-8f0a-4dbc-992d-f4f94bb35dc1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:47.258445 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e6fee-8f0a-4dbc-992d-f4f94bb35dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:47.258809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e6fee-8f0a-4dbc-992d-f4f94bb35dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:47.272391 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1316/2652] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:47.279698 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b57e6fee-8f0a-4dbc-992d-f4f94bb35dc1 None None] MFA Rules not processed for user `1663768f5e734624896ba98db07bb45d`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:47.281857 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b57e6fee-8f0a-4dbc-992d-f4f94bb35dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:47.282813 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0ab96-062d-468e-b962-82ccf611590c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:47.284179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-93b0ab96-062d-468e-b962-82ccf611590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:47.344994 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0ab96-062d-468e-b962-82ccf611590c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:47.346574 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1337/2653] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:47.348869 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d515c-d1ed-464d-910e-094d893eea65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:47.349609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d515c-d1ed-464d-910e-094d893eea65 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:47.350075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d515c-d1ed-464d-910e-094d893eea65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:47.350218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d515c-d1ed-464d-910e-094d893eea65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:47.362463 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d515c-d1ed-464d-910e-094d893eea65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:47.364122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d515c-d1ed-464d-910e-094d893eea65 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:47.375331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1317/2654] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:47.720961 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e6fee-8f0a-4dbc-992d-f4f94bb35dc1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:47.722657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b57e6fee-8f0a-4dbc-992d-f4f94bb35dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:47.741094 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e6fee-8f0a-4dbc-992d-f4f94bb35dc1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:47.750793 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:47.752281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:47.752281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:47.755660 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] PATH_INFO: `/v3/projects/ffd24393ebfe425094f5436a544a8e80` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:47.757121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd24393ebfe425094f5436a544a8e80)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:47.758617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d515c-d1ed-464d-910e-094d893eea65 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:47.760256 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e12d515c-d1ed-464d-910e-094d893eea65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:47.761010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:47.775592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d515c-d1ed-464d-910e-094d893eea65 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:47.779482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27408883-8693-4f20-9e81-f07a16db8829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:47.780290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408883-8693-4f20-9e81-f07a16db8829 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:47.780675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408883-8693-4f20-9e81-f07a16db8829 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:47.781055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408883-8693-4f20-9e81-f07a16db8829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:47.783448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-27408883-8693-4f20-9e81-f07a16db8829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:47.787557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:47.797310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408883-8693-4f20-9e81-f07a16db8829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:47.799695 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408883-8693-4f20-9e81-f07a16db8829 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:47.810188 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1318/2655] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:47:47.827673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd24393ebfe425094f5436a544a8e80', 'request_id': 'req-df834f57-6b91-4c1c-baf1-de02fe6e2a27'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:47.836014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd24393ebfe425094f5436a544a8e80', 'request_id': 'req-df834f57-6b91-4c1c-baf1-de02fe6e2a27'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:47.846863 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd24393ebfe425094f5436a544a8e80', 'request_id': 'req-df834f57-6b91-4c1c-baf1-de02fe6e2a27'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:47.861611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] The token cache is being invalidate because project ffd24393ebfe425094f5436a544a8e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:47.861998 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:47.862774 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:47.864511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1338/2656] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:47 2022] DELETE /identity/v3/projects/ffd24393ebfe425094f5436a544a8e80 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:47.868636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27408883-8693-4f20-9e81-f07a16db8829 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:47.884218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27408883-8693-4f20-9e81-f07a16db8829 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:47.980838 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:47.981952 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:47.982310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:47.982662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] PATH_INFO: `/v3/users/3344754137404d99b0109e9f34e58d29` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:47.984956 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3344754137404d99b0109e9f34e58d29)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:47.987782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:47.989347 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:48.052232 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3344754137404d99b0109e9f34e58d29'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:48.053000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3344754137404d99b0109e9f34e58d29'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:48.068751 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3344754137404d99b0109e9f34e58d29'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:48.081119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3344754137404d99b0109e9f34e58d29'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:48.089936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3344754137404d99b0109e9f34e58d29'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:48.103930 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1319/2657] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:47 2022] DELETE /identity/v3/users/3344754137404d99b0109e9f34e58d29 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:48.245281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:48.246808 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:48.394509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df834f57-6b91-4c1c-baf1-de02fe6e2a27 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:48.485384 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77753c-ce09-4ce4-93d4-27b5dbed0268 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98059ebef5d470db684fb78d19a8839', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:48.486487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77753c-ce09-4ce4-93d4-27b5dbed0268 service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:48.486876 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77753c-ce09-4ce4-93d4-27b5dbed0268 service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:48.487160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77753c-ce09-4ce4-93d4-27b5dbed0268 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:48.489670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fd77753c-ce09-4ce4-93d4-27b5dbed0268 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:48.503963 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77753c-ce09-4ce4-93d4-27b5dbed0268 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:48.505567 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77753c-ce09-4ce4-93d4-27b5dbed0268 service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:48.520498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1339/2658] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:48.613824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:48.615950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:48.741934 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d0e29-ce3d-4626-b20b-a53ab2f8a79f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:48.749350 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651f4ea-1496-47bd-9293-e68a99cc19d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:48.750613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651f4ea-1496-47bd-9293-e68a99cc19d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:48.751157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651f4ea-1496-47bd-9293-e68a99cc19d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:48.751548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651f4ea-1496-47bd-9293-e68a99cc19d6 admin admin] PATH_INFO: `/v3/projects/de58a53991ae4bdbafc4688e6f6802f7` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:48.753174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651f4ea-1496-47bd-9293-e68a99cc19d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de58a53991ae4bdbafc4688e6f6802f7)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:48.755906 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651f4ea-1496-47bd-9293-e68a99cc19d6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:48.831101 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9651f4ea-1496-47bd-9293-e68a99cc19d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de58a53991ae4bdbafc4688e6f6802f7', 'request_id': 'req-9651f4ea-1496-47bd-9293-e68a99cc19d6'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:48.844546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9651f4ea-1496-47bd-9293-e68a99cc19d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de58a53991ae4bdbafc4688e6f6802f7', 'request_id': 'req-9651f4ea-1496-47bd-9293-e68a99cc19d6'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:48.853116 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9651f4ea-1496-47bd-9293-e68a99cc19d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de58a53991ae4bdbafc4688e6f6802f7', 'request_id': 'req-9651f4ea-1496-47bd-9293-e68a99cc19d6'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:48.868703 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9651f4ea-1496-47bd-9293-e68a99cc19d6 admin admin] The token cache is being invalidate because project de58a53991ae4bdbafc4688e6f6802f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:48.869190 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9651f4ea-1496-47bd-9293-e68a99cc19d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:48.870137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9651f4ea-1496-47bd-9293-e68a99cc19d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:48.875381 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1320/2659] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:48 2022] DELETE /identity/v3/projects/de58a53991ae4bdbafc4688e6f6802f7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:48.881269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac3f2-39a4-4dd4-ade0-48f5a9554248 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:48.881269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac3f2-39a4-4dd4-ade0-48f5a9554248 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:48.881543 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac3f2-39a4-4dd4-ade0-48f5a9554248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:48.915160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bf7ac3f2-39a4-4dd4-ade0-48f5a9554248 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:48.916954 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bf7ac3f2-39a4-4dd4-ade0-48f5a9554248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:48.977897 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:49.053705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1340/2660] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:49.065490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759c14e-de15-4acc-8afb-7e3d7d8cc266 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:49.065989 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759c14e-de15-4acc-8afb-7e3d7d8cc266 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:49.066494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759c14e-de15-4acc-8afb-7e3d7d8cc266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:49.100574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-0759c14e-de15-4acc-8afb-7e3d7d8cc266 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:49.101905 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0759c14e-de15-4acc-8afb-7e3d7d8cc266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:49.119055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1321/2661] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:49.123259 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ac3f2-39a4-4dd4-ade0-48f5a9554248 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:49.154832 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ac3f2-39a4-4dd4-ade0-48f5a9554248 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:49.166554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188e792-e16d-4ee7-9e52-68f052c7189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:49.170127 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188e792-e16d-4ee7-9e52-68f052c7189b admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:49.170498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188e792-e16d-4ee7-9e52-68f052c7189b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:49.171561 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188e792-e16d-4ee7-9e52-68f052c7189b admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:49.176926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188e792-e16d-4ee7-9e52-68f052c7189b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:47:49.177338 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188e792-e16d-4ee7-9e52-68f052c7189b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:49.179035 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188e792-e16d-4ee7-9e52-68f052c7189b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:49.226915 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1341/2662] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:47:49.231250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759c14e-de15-4acc-8afb-7e3d7d8cc266 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:49.237516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:49.261839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759c14e-de15-4acc-8afb-7e3d7d8cc266 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:49.269644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab987d0-da54-4984-b849-db794a3fd124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:49.270330 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab987d0-da54-4984-b849-db794a3fd124 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:49.270616 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab987d0-da54-4984-b849-db794a3fd124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:49.270895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab987d0-da54-4984-b849-db794a3fd124 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:49.272056 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab987d0-da54-4984-b849-db794a3fd124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:49.274658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab987d0-da54-4984-b849-db794a3fd124 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:49.310574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1322/2663] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:49 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:49.316505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188e792-e16d-4ee7-9e52-68f052c7189b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:49.329984 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188e792-e16d-4ee7-9e52-68f052c7189b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:49.524012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c648553-86c6-4e5d-8e97-8dc4ea01ee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:49.524720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c648553-86c6-4e5d-8e97-8dc4ea01ee30 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:49.525009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c648553-86c6-4e5d-8e97-8dc4ea01ee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:49.525297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c648553-86c6-4e5d-8e97-8dc4ea01ee30 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:49.526042 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c648553-86c6-4e5d-8e97-8dc4ea01ee30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:49.528289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c648553-86c6-4e5d-8e97-8dc4ea01ee30 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:49.559459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1342/2664] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:49 2022] POST /identity/v3/users => generated 284 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:47:49.563811 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab987d0-da54-4984-b849-db794a3fd124 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:49.577945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab987d0-da54-4984-b849-db794a3fd124 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:49.583511 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbde5b-d355-48d7-9734-59205bec6553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:49.583937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbde5b-d355-48d7-9734-59205bec6553 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:49.584296 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbde5b-d355-48d7-9734-59205bec6553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:49.589361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbde5b-d355-48d7-9734-59205bec6553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:49.589361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbde5b-d355-48d7-9734-59205bec6553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:49.589361 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbde5b-d355-48d7-9734-59205bec6553 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:49.611236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1323/2665] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:49.615349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c648553-86c6-4e5d-8e97-8dc4ea01ee30 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:49.632594 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c648553-86c6-4e5d-8e97-8dc4ea01ee30 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:49.639604 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8f6bd-c448-4b40-b231-1835e512a27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:49.640979 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8f6bd-c448-4b40-b231-1835e512a27b admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:49.641270 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8f6bd-c448-4b40-b231-1835e512a27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:49.641573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8f6bd-c448-4b40-b231-1835e512a27b admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:49.642438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8f6bd-c448-4b40-b231-1835e512a27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:49.644108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8f6bd-c448-4b40-b231-1835e512a27b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:49.660128 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1343/2666] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:49.664619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbde5b-d355-48d7-9734-59205bec6553 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:49.678943 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbde5b-d355-48d7-9734-59205bec6553 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:49.690894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e928d-7a37-478a-9dea-2de4d8a990b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:49.692226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e928d-7a37-478a-9dea-2de4d8a990b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:49.692859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e928d-7a37-478a-9dea-2de4d8a990b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:49.693287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e928d-7a37-478a-9dea-2de4d8a990b5 admin admin] PATH_INFO: `/v3/projects/9910fe8b4e6a4da6b9cfd44f3b5ffb87/users/a0a73b8f26f54430aa221999e358bfdb/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:49.712445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e928d-7a37-478a-9dea-2de4d8a990b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9910fe8b4e6a4da6b9cfd44f3b5ffb87, user_id=a0a73b8f26f54430aa221999e358bfdb, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:49.715749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e928d-7a37-478a-9dea-2de4d8a990b5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:49.772957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1324/2667] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:49 2022] PUT /identity/v3/projects/9910fe8b4e6a4da6b9cfd44f3b5ffb87/users/a0a73b8f26f54430aa221999e358bfdb/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:49.786008 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf3df5-dbdb-49a8-956d-f96ede7a7fd0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:49.786800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf3df5-dbdb-49a8-956d-f96ede7a7fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:49.787067 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf3df5-dbdb-49a8-956d-f96ede7a7fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:49.819833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-67bf3df5-dbdb-49a8-956d-f96ede7a7fd0 None None] MFA Rules not processed for user `a0a73b8f26f54430aa221999e358bfdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:49.821642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-67bf3df5-dbdb-49a8-956d-f96ede7a7fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:49.935288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1344/2668] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:49.940731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e928d-7a37-478a-9dea-2de4d8a990b5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:50.032123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e928d-7a37-478a-9dea-2de4d8a990b5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:50.037207 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa804c-876e-4410-aba6-62c578fe7d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:50.037870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa804c-876e-4410-aba6-62c578fe7d5d admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:50.038159 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa804c-876e-4410-aba6-62c578fe7d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:50.038437 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa804c-876e-4410-aba6-62c578fe7d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:50.039143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa804c-876e-4410-aba6-62c578fe7d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:50.041082 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa804c-876e-4410-aba6-62c578fe7d5d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:50.077721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1325/2669] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:49 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:50.081866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf3df5-dbdb-49a8-956d-f96ede7a7fd0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:50.094530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf3df5-dbdb-49a8-956d-f96ede7a7fd0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:50.126138 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:50.160432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1fa12-463d-4724-b93e-00085feed987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:50.161116 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1fa12-463d-4724-b93e-00085feed987 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:50.161402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1fa12-463d-4724-b93e-00085feed987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:50.161677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1fa12-463d-4724-b93e-00085feed987 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:50.162372 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1fa12-463d-4724-b93e-00085feed987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:50.164417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1fa12-463d-4724-b93e-00085feed987 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:50.192663 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1345/2670] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:50 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:47:50.196834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa804c-876e-4410-aba6-62c578fe7d5d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:50.212675 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa804c-876e-4410-aba6-62c578fe7d5d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:50.218592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d31bf-6f2d-4e12-b66c-019d7be3b84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:50.219313 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d31bf-6f2d-4e12-b66c-019d7be3b84c admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:50.219608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d31bf-6f2d-4e12-b66c-019d7be3b84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:50.219890 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d31bf-6f2d-4e12-b66c-019d7be3b84c admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:50.220624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d31bf-6f2d-4e12-b66c-019d7be3b84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:50.222281 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d31bf-6f2d-4e12-b66c-019d7be3b84c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:50.236690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1326/2671] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:47:50.237920 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1fa12-463d-4724-b93e-00085feed987 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:50.249392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1fa12-463d-4724-b93e-00085feed987 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:50.257190 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4de79-63fd-4b23-a2a6-f7e7be62b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:50.258097 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4de79-63fd-4b23-a2a6-f7e7be62b667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:50.258382 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4de79-63fd-4b23-a2a6-f7e7be62b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:50.258658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4de79-63fd-4b23-a2a6-f7e7be62b667 admin admin] PATH_INFO: `/v3/projects/cafee3a810834c9582cc21dc7de2a8e7/users/9c0c752f5e044f2eb1caba174db4c343/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:50.280932 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4de79-63fd-4b23-a2a6-f7e7be62b667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafee3a810834c9582cc21dc7de2a8e7, user_id=9c0c752f5e044f2eb1caba174db4c343, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:50.284206 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4de79-63fd-4b23-a2a6-f7e7be62b667 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:50.302151 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1346/2672] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:50 2022] PUT /identity/v3/projects/cafee3a810834c9582cc21dc7de2a8e7/users/9c0c752f5e044f2eb1caba174db4c343/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:50.308678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d31bf-6f2d-4e12-b66c-019d7be3b84c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:50.323830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d31bf-6f2d-4e12-b66c-019d7be3b84c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:50.390204 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23359652-6f74-4367-98c5-99ff7ac2f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:50.391159 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23359652-6f74-4367-98c5-99ff7ac2f4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:50.391469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23359652-6f74-4367-98c5-99ff7ac2f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:50.391742 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23359652-6f74-4367-98c5-99ff7ac2f4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:50.392487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23359652-6f74-4367-98c5-99ff7ac2f4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:50.394255 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23359652-6f74-4367-98c5-99ff7ac2f4a7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:50.404090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1327/2673] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:50.408848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4de79-63fd-4b23-a2a6-f7e7be62b667 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:50.422001 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4de79-63fd-4b23-a2a6-f7e7be62b667 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:50.426700 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0c317-ce5e-4809-9696-3e95146b4b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:50.427652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0c317-ce5e-4809-9696-3e95146b4b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:50.427935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0c317-ce5e-4809-9696-3e95146b4b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:50.428211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0c317-ce5e-4809-9696-3e95146b4b92 admin admin] PATH_INFO: `/v3/projects/cafee3a810834c9582cc21dc7de2a8e7/users/9c0c752f5e044f2eb1caba174db4c343/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:50.430184 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0c317-ce5e-4809-9696-3e95146b4b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafee3a810834c9582cc21dc7de2a8e7, user_id=9c0c752f5e044f2eb1caba174db4c343, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:50.432931 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0c317-ce5e-4809-9696-3e95146b4b92 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:50.444182 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1347/2674] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:50 2022] PUT /identity/v3/projects/cafee3a810834c9582cc21dc7de2a8e7/users/9c0c752f5e044f2eb1caba174db4c343/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:50.454870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4786b63-bef9-4fc3-9a9f-9992a6b8bd2d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:50.455159 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4786b63-bef9-4fc3-9a9f-9992a6b8bd2d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:50.455469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4786b63-bef9-4fc3-9a9f-9992a6b8bd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:50.486601 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b4786b63-bef9-4fc3-9a9f-9992a6b8bd2d None None] MFA Rules not processed for user `9c0c752f5e044f2eb1caba174db4c343`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:50.488624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b4786b63-bef9-4fc3-9a9f-9992a6b8bd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:50.492175 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:50.581071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1328/2675] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:50.593736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0c317-ce5e-4809-9696-3e95146b4b92 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:50.595489 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-38e0c317-ce5e-4809-9696-3e95146b4b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:50.661299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0c317-ce5e-4809-9696-3e95146b4b92 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:50.664986 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52490b14-7e5f-4ce8-a172-841b0a39851a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:50.665635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52490b14-7e5f-4ce8-a172-841b0a39851a service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:50.665918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52490b14-7e5f-4ce8-a172-841b0a39851a service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:50.666197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52490b14-7e5f-4ce8-a172-841b0a39851a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:50.675622 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52490b14-7e5f-4ce8-a172-841b0a39851a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:50.677056 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52490b14-7e5f-4ce8-a172-841b0a39851a service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:50.687716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1348/2676] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:50.773471 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4786b63-bef9-4fc3-9a9f-9992a6b8bd2d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:50.790453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4786b63-bef9-4fc3-9a9f-9992a6b8bd2d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:50.800821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b1876-fa55-449a-8881-cec0605a2ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:50.800821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b1876-fa55-449a-8881-cec0605a2ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:50.800821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b1876-fa55-449a-8881-cec0605a2ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:50.800821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b1876-fa55-449a-8881-cec0605a2ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:50.882401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b1876-fa55-449a-8881-cec0605a2ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:50.885081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b1876-fa55-449a-8881-cec0605a2ef1 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:50.897050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1329/2677] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:55.518693 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52490b14-7e5f-4ce8-a172-841b0a39851a service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:55.520285 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-52490b14-7e5f-4ce8-a172-841b0a39851a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:55.607037 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52490b14-7e5f-4ce8-a172-841b0a39851a service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:55.613795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6867f3-7441-4f47-83b1-072204263847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:55.614994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6867f3-7441-4f47-83b1-072204263847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:55.615437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6867f3-7441-4f47-83b1-072204263847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:55.615793 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6867f3-7441-4f47-83b1-072204263847 admin admin] PATH_INFO: `/v3/users/16d5e04511e2489c933c713e2b4399de` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:55.617411 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6867f3-7441-4f47-83b1-072204263847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d5e04511e2489c933c713e2b4399de)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:55.619784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6867f3-7441-4f47-83b1-072204263847 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:55.658278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:55.683730 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ed6867f3-7441-4f47-83b1-072204263847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d5e04511e2489c933c713e2b4399de'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:55.690912 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b1876-fa55-449a-8881-cec0605a2ef1 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:55.691893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ed6867f3-7441-4f47-83b1-072204263847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d5e04511e2489c933c713e2b4399de'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:55.698927 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ed6867f3-7441-4f47-83b1-072204263847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d5e04511e2489c933c713e2b4399de'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:55.699577 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ed6867f3-7441-4f47-83b1-072204263847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d5e04511e2489c933c713e2b4399de'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:55.702427 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b1876-fa55-449a-8881-cec0605a2ef1 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:55.706992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d06c0-12d5-41ad-bc58-2eee5a9c6e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:55.707904 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d06c0-12d5-41ad-bc58-2eee5a9c6e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:55.708190 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d06c0-12d5-41ad-bc58-2eee5a9c6e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:55.708472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d06c0-12d5-41ad-bc58-2eee5a9c6e92 admin admin] PATH_INFO: `/v3/users/a0a73b8f26f54430aa221999e358bfdb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:55.709667 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d06c0-12d5-41ad-bc58-2eee5a9c6e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a73b8f26f54430aa221999e358bfdb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:55.711672 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d06c0-12d5-41ad-bc58-2eee5a9c6e92 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:55.712059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ed6867f3-7441-4f47-83b1-072204263847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d5e04511e2489c933c713e2b4399de'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:55.718647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1349/2678] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:55 2022] DELETE /identity/v3/users/16d5e04511e2489c933c713e2b4399de => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:55.723640 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ab118-a10a-46a3-8443-21b7a037ba05 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:55.724016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ab118-a10a-46a3-8443-21b7a037ba05 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:55.724367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ab118-a10a-46a3-8443-21b7a037ba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:55.745050 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d47ab118-a10a-46a3-8443-21b7a037ba05 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:55.746276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d47ab118-a10a-46a3-8443-21b7a037ba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:55.761892 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eb6d06c0-12d5-41ad-bc58-2eee5a9c6e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a73b8f26f54430aa221999e358bfdb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:55.762546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eb6d06c0-12d5-41ad-bc58-2eee5a9c6e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a73b8f26f54430aa221999e358bfdb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:55.775454 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eb6d06c0-12d5-41ad-bc58-2eee5a9c6e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a73b8f26f54430aa221999e358bfdb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:55.783275 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eb6d06c0-12d5-41ad-bc58-2eee5a9c6e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a73b8f26f54430aa221999e358bfdb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:55.790572 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-eb6d06c0-12d5-41ad-bc58-2eee5a9c6e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a73b8f26f54430aa221999e358bfdb'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:55.797269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1330/2679] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:55 2022] DELETE /identity/v3/users/a0a73b8f26f54430aa221999e358bfdb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:47:55.801635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2977171-2cfc-4592-8300-f9db4a21beae None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:55.801926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2977171-2cfc-4592-8300-f9db4a21beae None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:55.802236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2977171-2cfc-4592-8300-f9db4a21beae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:55.810026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1350/2680] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:47:55.819220 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a2977171-2cfc-4592-8300-f9db4a21beae None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:55.820437 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a2977171-2cfc-4592-8300-f9db4a21beae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:55.820674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ab118-a10a-46a3-8443-21b7a037ba05 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:55.821977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d47ab118-a10a-46a3-8443-21b7a037ba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:55.825880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:55.883654 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ab118-a10a-46a3-8443-21b7a037ba05 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:55.884743 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1331/2681] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:47:55.894929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2977171-2cfc-4592-8300-f9db4a21beae None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:55.896431 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a2977171-2cfc-4592-8300-f9db4a21beae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:55.934314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909bdc7-4696-4177-93e4-16dc00338169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:55.934961 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909bdc7-4696-4177-93e4-16dc00338169 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:55.935274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909bdc7-4696-4177-93e4-16dc00338169 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:55.935548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909bdc7-4696-4177-93e4-16dc00338169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:55.945289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909bdc7-4696-4177-93e4-16dc00338169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:55.946718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909bdc7-4696-4177-93e4-16dc00338169 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:55.954254 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2977171-2cfc-4592-8300-f9db4a21beae None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:55.956919 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1351/2682] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:47:55.957999 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcda6a-29e4-4351-8fcd-479a48c58377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:55.958673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcda6a-29e4-4351-8fcd-479a48c58377 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:55.958958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcda6a-29e4-4351-8fcd-479a48c58377 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:55.959274 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcda6a-29e4-4351-8fcd-479a48c58377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:55.969457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcda6a-29e4-4351-8fcd-479a48c58377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:55.971084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcda6a-29e4-4351-8fcd-479a48c58377 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:55.981129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1332/2683] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:47:56.236288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909bdc7-4696-4177-93e4-16dc00338169 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:56.237944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e909bdc7-4696-4177-93e4-16dc00338169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:56.247843 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:56.258708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909bdc7-4696-4177-93e4-16dc00338169 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:56.266117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522135f9-618e-44e4-90d4-41ca48814ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:56.266982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522135f9-618e-44e4-90d4-41ca48814ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:56.267417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522135f9-618e-44e4-90d4-41ca48814ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:56.267729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522135f9-618e-44e4-90d4-41ca48814ee0 admin admin] PATH_INFO: `/v3/projects/67b851a8c51e4fa0b77042fc22bd5123` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:56.269105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522135f9-618e-44e4-90d4-41ca48814ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b851a8c51e4fa0b77042fc22bd5123)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:56.271256 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522135f9-618e-44e4-90d4-41ca48814ee0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:56.276640 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcda6a-29e4-4351-8fcd-479a48c58377 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:56.278502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-31dcda6a-29e4-4351-8fcd-479a48c58377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:56.296719 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcda6a-29e4-4351-8fcd-479a48c58377 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:56.301844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:56.302714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:56.303077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:56.303288 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] PATH_INFO: `/v3/projects/9910fe8b4e6a4da6b9cfd44f3b5ffb87` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:56.304565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9910fe8b4e6a4da6b9cfd44f3b5ffb87)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:56.306452 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:56.331803 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-522135f9-618e-44e4-90d4-41ca48814ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b851a8c51e4fa0b77042fc22bd5123', 'request_id': 'req-522135f9-618e-44e4-90d4-41ca48814ee0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.337907 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-522135f9-618e-44e4-90d4-41ca48814ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b851a8c51e4fa0b77042fc22bd5123', 'request_id': 'req-522135f9-618e-44e4-90d4-41ca48814ee0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.347201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-522135f9-618e-44e4-90d4-41ca48814ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b851a8c51e4fa0b77042fc22bd5123', 'request_id': 'req-522135f9-618e-44e4-90d4-41ca48814ee0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.357615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9910fe8b4e6a4da6b9cfd44f3b5ffb87', 'request_id': 'req-099b153a-aa5a-4c9e-a53b-fe01066aaa77'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.357836 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-522135f9-618e-44e4-90d4-41ca48814ee0 admin admin] The token cache is being invalidate because project 67b851a8c51e4fa0b77042fc22bd5123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:56.358120 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-522135f9-618e-44e4-90d4-41ca48814ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.358741 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-522135f9-618e-44e4-90d4-41ca48814ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.361191 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1352/2684] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:56 2022] DELETE /identity/v3/projects/67b851a8c51e4fa0b77042fc22bd5123 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:56.365614 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9910fe8b4e6a4da6b9cfd44f3b5ffb87', 'request_id': 'req-099b153a-aa5a-4c9e-a53b-fe01066aaa77'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.366691 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f4f7d-7538-49d3-a900-ccd908e53eb8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:56.366985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f4f7d-7538-49d3-a900-ccd908e53eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:56.367296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f4f7d-7538-49d3-a900-ccd908e53eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:56.371772 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9910fe8b4e6a4da6b9cfd44f3b5ffb87', 'request_id': 'req-099b153a-aa5a-4c9e-a53b-fe01066aaa77'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.383992 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] The token cache is being invalidate because project 9910fe8b4e6a4da6b9cfd44f3b5ffb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:56.384360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.385070 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.386781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fe7f4f7d-7538-49d3-a900-ccd908e53eb8 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:56.387059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1333/2685] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:56 2022] DELETE /identity/v3/projects/9910fe8b4e6a4da6b9cfd44f3b5ffb87 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:47:56.388044 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fe7f4f7d-7538-49d3-a900-ccd908e53eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:56.391677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:56.392967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:56.436934 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:56.453849 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1353/2686] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:47:56.460962 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b153a-aa5a-4c9e-a53b-fe01066aaa77 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:56.461355 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cba76-6dc6-4d27-af2a-7faa99d79421 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:56.461650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cba76-6dc6-4d27-af2a-7faa99d79421 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:56.462001 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cba76-6dc6-4d27-af2a-7faa99d79421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:56.465615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360f468-3f01-4429-8385-6633bfa3e2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:56.466475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360f468-3f01-4429-8385-6633bfa3e2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:56.466756 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360f468-3f01-4429-8385-6633bfa3e2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:56.467751 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360f468-3f01-4429-8385-6633bfa3e2e1 admin admin] PATH_INFO: `/v3/users/9c0c752f5e044f2eb1caba174db4c343` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:56.468947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360f468-3f01-4429-8385-6633bfa3e2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c0c752f5e044f2eb1caba174db4c343)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:56.470844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360f468-3f01-4429-8385-6633bfa3e2e1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:56.480313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6d8cba76-6dc6-4d27-af2a-7faa99d79421 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:56.481519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6d8cba76-6dc6-4d27-af2a-7faa99d79421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:56.490642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1354/2687] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:47:56.494833 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cba76-6dc6-4d27-af2a-7faa99d79421 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:56.505769 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cba76-6dc6-4d27-af2a-7faa99d79421 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:56.510479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99985b3d-ce2a-4c22-9da8-371076ed860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:56.511213 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99985b3d-ce2a-4c22-9da8-371076ed860c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:56.511505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99985b3d-ce2a-4c22-9da8-371076ed860c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:56.511784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99985b3d-ce2a-4c22-9da8-371076ed860c admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:56.512513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99985b3d-ce2a-4c22-9da8-371076ed860c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:47:56.512829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99985b3d-ce2a-4c22-9da8-371076ed860c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:56.515055 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99985b3d-ce2a-4c22-9da8-371076ed860c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:56.518988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9360f468-3f01-4429-8385-6633bfa3e2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0c752f5e044f2eb1caba174db4c343'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.519742 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9360f468-3f01-4429-8385-6633bfa3e2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0c752f5e044f2eb1caba174db4c343'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.527488 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1355/2688] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:47:56.532562 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9360f468-3f01-4429-8385-6633bfa3e2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0c752f5e044f2eb1caba174db4c343'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.533105 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99985b3d-ce2a-4c22-9da8-371076ed860c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:56.534872 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-99985b3d-ce2a-4c22-9da8-371076ed860c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:56.540848 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9360f468-3f01-4429-8385-6633bfa3e2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0c752f5e044f2eb1caba174db4c343'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.549568 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9360f468-3f01-4429-8385-6633bfa3e2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0c752f5e044f2eb1caba174db4c343'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:56.550795 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99985b3d-ce2a-4c22-9da8-371076ed860c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:56.555664 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91546c2-3728-4527-8042-a7d4ca7499d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:56.556000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1334/2689] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:47:56 2022] DELETE /identity/v3/users/9c0c752f5e044f2eb1caba174db4c343 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:56.556320 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91546c2-3728-4527-8042-a7d4ca7499d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:56.556606 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91546c2-3728-4527-8042-a7d4ca7499d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:56.556940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91546c2-3728-4527-8042-a7d4ca7499d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:56.557629 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91546c2-3728-4527-8042-a7d4ca7499d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:56.559796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91546c2-3728-4527-8042-a7d4ca7499d1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:56.590498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1356/2690] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:56 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:47:56.591971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360f468-3f01-4429-8385-6633bfa3e2e1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:56.658788 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360f468-3f01-4429-8385-6633bfa3e2e1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:56.735954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda69556-87a7-49ca-a4eb-d6e5dd6aeff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:56.737357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda69556-87a7-49ca-a4eb-d6e5dd6aeff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:56.737813 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda69556-87a7-49ca-a4eb-d6e5dd6aeff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:56.738271 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda69556-87a7-49ca-a4eb-d6e5dd6aeff1 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:56.739191 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda69556-87a7-49ca-a4eb-d6e5dd6aeff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:56.741267 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda69556-87a7-49ca-a4eb-d6e5dd6aeff1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:56.751539 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:56.768340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1335/2691] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:56 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:56.772033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91546c2-3728-4527-8042-a7d4ca7499d1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:56.783144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91546c2-3728-4527-8042-a7d4ca7499d1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:56.791970 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015deb6-d25c-4ffc-b67c-156ad5cd9ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:56.792744 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015deb6-d25c-4ffc-b67c-156ad5cd9ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:56.793155 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015deb6-d25c-4ffc-b67c-156ad5cd9ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:56.793484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015deb6-d25c-4ffc-b67c-156ad5cd9ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:56.794441 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015deb6-d25c-4ffc-b67c-156ad5cd9ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:56.797968 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015deb6-d25c-4ffc-b67c-156ad5cd9ba4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:56.809826 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1357/2692] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:47:56.814455 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda69556-87a7-49ca-a4eb-d6e5dd6aeff1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:56.825839 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda69556-87a7-49ca-a4eb-d6e5dd6aeff1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:56.832028 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26142023-e97f-420b-bd23-22f64cb96b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:56.832800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26142023-e97f-420b-bd23-22f64cb96b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:56.833145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26142023-e97f-420b-bd23-22f64cb96b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:56.833490 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26142023-e97f-420b-bd23-22f64cb96b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:56.834288 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26142023-e97f-420b-bd23-22f64cb96b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:56.836098 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26142023-e97f-420b-bd23-22f64cb96b2b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:56.849750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1336/2693] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:47:56.851206 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015deb6-d25c-4ffc-b67c-156ad5cd9ba4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:56.861796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015deb6-d25c-4ffc-b67c-156ad5cd9ba4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:56.868502 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a7879-9edd-4715-96d7-9f18ce445a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:56.869400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a7879-9edd-4715-96d7-9f18ce445a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:56.869720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a7879-9edd-4715-96d7-9f18ce445a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:56.870002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a7879-9edd-4715-96d7-9f18ce445a6a admin admin] PATH_INFO: `/v3/projects/3a2ea607b16d4417be2db58c863280bc/users/bcca1b9a224446f0bf0a5c211821798f/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:56.886083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a7879-9edd-4715-96d7-9f18ce445a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2ea607b16d4417be2db58c863280bc, user_id=bcca1b9a224446f0bf0a5c211821798f, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:56.888885 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a7879-9edd-4715-96d7-9f18ce445a6a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:56.902933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1358/2694] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:56 2022] PUT /identity/v3/projects/3a2ea607b16d4417be2db58c863280bc/users/bcca1b9a224446f0bf0a5c211821798f/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:56.910176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f87a3-88e8-4f5b-91db-6191bf57da9e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:56.910176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f87a3-88e8-4f5b-91db-6191bf57da9e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:56.910538 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f87a3-88e8-4f5b-91db-6191bf57da9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:56.938531 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a7879-9edd-4715-96d7-9f18ce445a6a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:56.940551 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-018a7879-9edd-4715-96d7-9f18ce445a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:56.949971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e26f87a3-88e8-4f5b-91db-6191bf57da9e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:56.952265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e26f87a3-88e8-4f5b-91db-6191bf57da9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:56.956694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:57.019817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a7879-9edd-4715-96d7-9f18ce445a6a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:57.021917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1337/2695] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:47:57.026530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:57.027439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.027724 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.028007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f admin admin] PATH_INFO: `/v3/projects/cafee3a810834c9582cc21dc7de2a8e7` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:57.029231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cafee3a810834c9582cc21dc7de2a8e7)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:57.032061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:57.033042 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f87a3-88e8-4f5b-91db-6191bf57da9e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:57.034662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e26f87a3-88e8-4f5b-91db-6191bf57da9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:57.091144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cafee3a810834c9582cc21dc7de2a8e7', 'request_id': 'req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:57.100695 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cafee3a810834c9582cc21dc7de2a8e7', 'request_id': 'req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:57.101940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f87a3-88e8-4f5b-91db-6191bf57da9e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:57.110041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cafee3a810834c9582cc21dc7de2a8e7', 'request_id': 'req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:57.122098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f admin admin] The token cache is being invalidate because project cafee3a810834c9582cc21dc7de2a8e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:47:57.122472 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:57.124784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-895a22d3-fdf8-4052-bf4e-a11ccd9f440f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:47:57.127645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1359/2696] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:47:56 2022] DELETE /identity/v3/projects/cafee3a810834c9582cc21dc7de2a8e7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:57.132585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d5213-01c2-4ec8-b963-0f426e2c66c6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.132950 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d5213-01c2-4ec8-b963-0f426e2c66c6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.133313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d5213-01c2-4ec8-b963-0f426e2c66c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:57.156046 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-876d5213-01c2-4ec8-b963-0f426e2c66c6 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:57.157706 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-876d5213-01c2-4ec8-b963-0f426e2c66c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:57.158068 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514cf06-0e89-499a-ad1b-c951d3e7f2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:57.158797 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514cf06-0e89-499a-ad1b-c951d3e7f2db service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.159397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514cf06-0e89-499a-ad1b-c951d3e7f2db service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.159397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514cf06-0e89-499a-ad1b-c951d3e7f2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:57.161198 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0514cf06-0e89-499a-ad1b-c951d3e7f2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:57.220657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:57.228876 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1360/2697] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:57.232852 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d5213-01c2-4ec8-b963-0f426e2c66c6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:57.236362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514cf06-0e89-499a-ad1b-c951d3e7f2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:57.237305 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-876d5213-01c2-4ec8-b963-0f426e2c66c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:57.238171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514cf06-0e89-499a-ad1b-c951d3e7f2db service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:57.249110 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1338/2698] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:47:57.250402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a952b3-eb29-4b39-9dd7-f6788b36fc09 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.250696 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a952b3-eb29-4b39-9dd7-f6788b36fc09 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.250975 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a952b3-eb29-4b39-9dd7-f6788b36fc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:57.269812 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-06a952b3-eb29-4b39-9dd7-f6788b36fc09 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:57.271090 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-06a952b3-eb29-4b39-9dd7-f6788b36fc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:57.280000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1339/2699] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:57.283803 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a952b3-eb29-4b39-9dd7-f6788b36fc09 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:57.293701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:57.294205 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a952b3-eb29-4b39-9dd7-f6788b36fc09 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:57.302571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea688f3-ff42-4fc4-8a20-58830f900bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:57.303880 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea688f3-ff42-4fc4-8a20-58830f900bee admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.304677 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea688f3-ff42-4fc4-8a20-58830f900bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.304988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea688f3-ff42-4fc4-8a20-58830f900bee admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:57.306143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea688f3-ff42-4fc4-8a20-58830f900bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:47:57.306409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea688f3-ff42-4fc4-8a20-58830f900bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:57.308129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea688f3-ff42-4fc4-8a20-58830f900bee admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:57.323418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1340/2700] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:47:57.326353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d5213-01c2-4ec8-b963-0f426e2c66c6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:57.327919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea688f3-ff42-4fc4-8a20-58830f900bee admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:57.332617 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7d1a3-8a19-4626-9074-7d86b09e0e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:57.333397 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7d1a3-8a19-4626-9074-7d86b09e0e03 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.333760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7d1a3-8a19-4626-9074-7d86b09e0e03 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.334107 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7d1a3-8a19-4626-9074-7d86b09e0e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:57.336188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4ab7d1a3-8a19-4626-9074-7d86b09e0e03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:57.341950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea688f3-ff42-4fc4-8a20-58830f900bee admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:57.350652 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7d1a3-8a19-4626-9074-7d86b09e0e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:57.352805 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7d1a3-8a19-4626-9074-7d86b09e0e03 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:57.358069 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17086f06-5155-44ff-9418-9223ff2bf1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:57.359465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17086f06-5155-44ff-9418-9223ff2bf1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.359762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17086f06-5155-44ff-9418-9223ff2bf1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.360099 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17086f06-5155-44ff-9418-9223ff2bf1d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:57.360809 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17086f06-5155-44ff-9418-9223ff2bf1d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:57.363247 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17086f06-5155-44ff-9418-9223ff2bf1d8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:57.365798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1361/2701] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:57.395414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1341/2702] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:47:57 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:57.400011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7d1a3-8a19-4626-9074-7d86b09e0e03 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:57.415289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7d1a3-8a19-4626-9074-7d86b09e0e03 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:57.494100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d09b39-13fa-43f6-8313-fc2cdc3e08a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:57.494938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d09b39-13fa-43f6-8313-fc2cdc3e08a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.495354 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d09b39-13fa-43f6-8313-fc2cdc3e08a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.495867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d09b39-13fa-43f6-8313-fc2cdc3e08a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:57.496658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d09b39-13fa-43f6-8313-fc2cdc3e08a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:57.499028 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d09b39-13fa-43f6-8313-fc2cdc3e08a3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:57.524083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1362/2703] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:47:57 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:47:57.528041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17086f06-5155-44ff-9418-9223ff2bf1d8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:57.540331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17086f06-5155-44ff-9418-9223ff2bf1d8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:57.547069 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa3030-221c-4a66-b625-1969d434cb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:57.547778 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa3030-221c-4a66-b625-1969d434cb7a admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.548059 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa3030-221c-4a66-b625-1969d434cb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.548333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa3030-221c-4a66-b625-1969d434cb7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:57.549057 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa3030-221c-4a66-b625-1969d434cb7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:57.550662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa3030-221c-4a66-b625-1969d434cb7a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:57.561970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1342/2704] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:57.568593 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d09b39-13fa-43f6-8313-fc2cdc3e08a3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:57.579735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d09b39-13fa-43f6-8313-fc2cdc3e08a3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:57.590378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198fb1c-234a-4021-98e5-e465462eaa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:57.590923 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198fb1c-234a-4021-98e5-e465462eaa8b admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.591347 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198fb1c-234a-4021-98e5-e465462eaa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.591720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198fb1c-234a-4021-98e5-e465462eaa8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:57.593582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198fb1c-234a-4021-98e5-e465462eaa8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:57.595340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198fb1c-234a-4021-98e5-e465462eaa8b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:57.608555 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1363/2705] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:47:57.611637 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa3030-221c-4a66-b625-1969d434cb7a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:57.621881 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa3030-221c-4a66-b625-1969d434cb7a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:57.627980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af6a90-3d4a-4d43-8be7-af4da465d6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:57.629081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af6a90-3d4a-4d43-8be7-af4da465d6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.629461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af6a90-3d4a-4d43-8be7-af4da465d6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.629747 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af6a90-3d4a-4d43-8be7-af4da465d6d7 admin admin] PATH_INFO: `/v3/projects/8a0169c4c7214982923d71ded3430241/users/05348d1b6bec4ea2b83375465cea0307/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:57.648864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af6a90-3d4a-4d43-8be7-af4da465d6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0169c4c7214982923d71ded3430241, user_id=05348d1b6bec4ea2b83375465cea0307, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:57.652046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af6a90-3d4a-4d43-8be7-af4da465d6d7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:57.676740 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1343/2706] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:47:57 2022] PUT /identity/v3/projects/8a0169c4c7214982923d71ded3430241/users/05348d1b6bec4ea2b83375465cea0307/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:47:57.688883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6c43-55c2-4273-86d3-63c65b9bea96 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.689175 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6c43-55c2-4273-86d3-63c65b9bea96 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.689462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6c43-55c2-4273-86d3-63c65b9bea96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:57.723150 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ae3d6c43-55c2-4273-86d3-63c65b9bea96 None None] MFA Rules not processed for user `05348d1b6bec4ea2b83375465cea0307`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:57.724410 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ae3d6c43-55c2-4273-86d3-63c65b9bea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:57.792940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1364/2707] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:57.805558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af6a90-3d4a-4d43-8be7-af4da465d6d7 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:57.807403 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-48af6a90-3d4a-4d43-8be7-af4da465d6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:57.868060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af6a90-3d4a-4d43-8be7-af4da465d6d7 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:57.872220 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72690b-02f4-4ce9-ba4c-4e583480f2ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:57.872924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72690b-02f4-4ce9-ba4c-4e583480f2ee service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.873756 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72690b-02f4-4ce9-ba4c-4e583480f2ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.874137 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72690b-02f4-4ce9-ba4c-4e583480f2ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:57.883278 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72690b-02f4-4ce9-ba4c-4e583480f2ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:57.884729 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72690b-02f4-4ce9-ba4c-4e583480f2ee service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:57.895855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1344/2708] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:47:57.975362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302abd3-11ab-4241-bde4-48b0f3dded19 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:57.975657 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302abd3-11ab-4241-bde4-48b0f3dded19 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:57.975936 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302abd3-11ab-4241-bde4-48b0f3dded19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:58.027601 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8302abd3-11ab-4241-bde4-48b0f3dded19 None None] MFA Rules not processed for user `bcca1b9a224446f0bf0a5c211821798f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:58.028851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8302abd3-11ab-4241-bde4-48b0f3dded19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:58.069432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:47:58.130438 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1365/2709] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:47:58.142897 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72690b-02f4-4ce9-ba4c-4e583480f2ee service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:47:58.145715 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6d72690b-02f4-4ce9-ba4c-4e583480f2ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:58.162388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72690b-02f4-4ce9-ba4c-4e583480f2ee service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:47:58.168357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66494c3-6ee4-4b58-bafb-d942ce8981d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:47:58.169170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66494c3-6ee4-4b58-bafb-d942ce8981d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:58.169407 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66494c3-6ee4-4b58-bafb-d942ce8981d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:58.169712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66494c3-6ee4-4b58-bafb-d942ce8981d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:58.179953 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66494c3-6ee4-4b58-bafb-d942ce8981d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:47:58.181769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66494c3-6ee4-4b58-bafb-d942ce8981d8 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:47:58.193451 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1345/2710] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:47:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:47:59.653159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beee881-d058-4058-9da3-c2f8c4f7eb8c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:47:59.653705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beee881-d058-4058-9da3-c2f8c4f7eb8c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:47:59.653705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beee881-d058-4058-9da3-c2f8c4f7eb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:47:59.677924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2beee881-d058-4058-9da3-c2f8c4f7eb8c None None] MFA Rules not processed for user `bcca1b9a224446f0bf0a5c211821798f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:47:59.679348 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2beee881-d058-4058-9da3-c2f8c4f7eb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:47:59.688244 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1366/2711] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:47:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:48:00.463818 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66494c3-6ee4-4b58-bafb-d942ce8981d8 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:48:00.532824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:48:00.553295 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66494c3-6ee4-4b58-bafb-d942ce8981d8 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:48:00.562219 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c765f-207d-49b4-bf87-5f60a61f1090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:48:00.563041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c765f-207d-49b4-bf87-5f60a61f1090 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:00.563484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c765f-207d-49b4-bf87-5f60a61f1090 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:00.563868 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c765f-207d-49b4-bf87-5f60a61f1090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:00.565903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-871c765f-207d-49b4-bf87-5f60a61f1090 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:48:00.588265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c765f-207d-49b4-bf87-5f60a61f1090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:48:00.588265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c765f-207d-49b4-bf87-5f60a61f1090 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:48:00.603833 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1346/2712] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:48:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:48:09.670693 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=19 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:48:10.596395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=6 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:48:32.907688 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beee881-d058-4058-9da3-c2f8c4f7eb8c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:48:32.973293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beee881-d058-4058-9da3-c2f8c4f7eb8c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:48:32.978109 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:48:32.979045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:32.979461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:32.979752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] PATH_INFO: `/v3/users/05348d1b6bec4ea2b83375465cea0307` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:32.980988 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05348d1b6bec4ea2b83375465cea0307)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:48:32.982905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:48:33.033355 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05348d1b6bec4ea2b83375465cea0307'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:48:33.044069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05348d1b6bec4ea2b83375465cea0307'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:48:33.052059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05348d1b6bec4ea2b83375465cea0307'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:48:33.052958 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05348d1b6bec4ea2b83375465cea0307'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:48:33.070203 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05348d1b6bec4ea2b83375465cea0307'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:48:33.076373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1367/2713] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:48:32 2022] DELETE /identity/v3/users/05348d1b6bec4ea2b83375465cea0307 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:48:33.080967 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138ec9f-6d62-4217-9196-cab357e09994 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:33.081894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138ec9f-6d62-4217-9196-cab357e09994 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:33.082454 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138ec9f-6d62-4217-9196-cab357e09994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:33.101502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e138ec9f-6d62-4217-9196-cab357e09994 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:48:33.102727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e138ec9f-6d62-4217-9196-cab357e09994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:48:33.163636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1347/2714] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:48:33.173323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:48:33.174770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:48:33.234010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f97e73-142a-4b06-a4e5-99bcab0e6f28 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:48:33.237935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227b3ab-acee-4ce0-a02b-740b08506d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:48:33.238598 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227b3ab-acee-4ce0-a02b-740b08506d01 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:33.238881 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227b3ab-acee-4ce0-a02b-740b08506d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:33.239159 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227b3ab-acee-4ce0-a02b-740b08506d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:33.249081 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227b3ab-acee-4ce0-a02b-740b08506d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:48:33.250507 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227b3ab-acee-4ce0-a02b-740b08506d01 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:48:33.260726 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1368/2715] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:48:33.372450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc228958-c947-4d47-b3e9-63c14f306ec0 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:33.372851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc228958-c947-4d47-b3e9-63c14f306ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:33.373226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc228958-c947-4d47-b3e9-63c14f306ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:33.392199 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cc228958-c947-4d47-b3e9-63c14f306ec0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:48:33.393409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cc228958-c947-4d47-b3e9-63c14f306ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:48:33.413147 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1348/2716] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 6 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:48:33.436898 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227b3ab-acee-4ce0-a02b-740b08506d01 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:48:33.438429 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0227b3ab-acee-4ce0-a02b-740b08506d01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:48:33.467781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:48:33.520651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227b3ab-acee-4ce0-a02b-740b08506d01 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:48:33.527626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f4219-7f96-4baf-9349-25fb0fdd5e9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:48:33.528516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f4219-7f96-4baf-9349-25fb0fdd5e9a service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:33.528830 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f4219-7f96-4baf-9349-25fb0fdd5e9a service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:33.529115 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f4219-7f96-4baf-9349-25fb0fdd5e9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:33.539746 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f4219-7f96-4baf-9349-25fb0fdd5e9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:48:33.541381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f4219-7f96-4baf-9349-25fb0fdd5e9a service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:48:33.546711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc228958-c947-4d47-b3e9-63c14f306ec0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:48:33.548418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cc228958-c947-4d47-b3e9-63c14f306ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:48:33.552495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1369/2717] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:48:33.561699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc228958-c947-4d47-b3e9-63c14f306ec0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:48:33.566958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:48:33.567682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:33.568082 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:33.568250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] PATH_INFO: `/v3/projects/8a0169c4c7214982923d71ded3430241` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:33.569438 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0169c4c7214982923d71ded3430241)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:48:33.572200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:48:33.622084 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0169c4c7214982923d71ded3430241', 'request_id': 'req-27d93d3d-63cb-47bd-9016-32e5df8070bc'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:48:33.630162 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0169c4c7214982923d71ded3430241', 'request_id': 'req-27d93d3d-63cb-47bd-9016-32e5df8070bc'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:48:33.638599 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0169c4c7214982923d71ded3430241', 'request_id': 'req-27d93d3d-63cb-47bd-9016-32e5df8070bc'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:48:33.651368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] The token cache is being invalidate because project 8a0169c4c7214982923d71ded3430241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:48:33.651663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:48:33.652337 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:48:33.653919 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1349/2718] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:48:33 2022] DELETE /identity/v3/projects/8a0169c4c7214982923d71ded3430241 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:48:36.413548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64fbe9-c92b-44f0-8a85-000d7e535495 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:36.414114 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64fbe9-c92b-44f0-8a85-000d7e535495 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:36.414462 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64fbe9-c92b-44f0-8a85-000d7e535495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:36.432872 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9d64fbe9-c92b-44f0-8a85-000d7e535495 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:48:36.434068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9d64fbe9-c92b-44f0-8a85-000d7e535495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:48:36.492742 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1370/2719] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 6 20:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:48:36.515290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:48:36.516698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:48:36.590914 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d93d3d-63cb-47bd-9016-32e5df8070bc admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:48:36.596404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0189a3-1923-4127-bb52-b6bde88a0460 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:48:36.597055 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0189a3-1923-4127-bb52-b6bde88a0460 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:36.597336 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0189a3-1923-4127-bb52-b6bde88a0460 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:36.597612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0189a3-1923-4127-bb52-b6bde88a0460 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:36.606247 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0189a3-1923-4127-bb52-b6bde88a0460 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:48:36.607890 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0189a3-1923-4127-bb52-b6bde88a0460 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:48:36.617762 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1350/2720] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:48:39.708453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6087bb-ce54-4ac5-803a-72a5a3fa6397 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:39.709169 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6087bb-ce54-4ac5-803a-72a5a3fa6397 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:39.709450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6087bb-ce54-4ac5-803a-72a5a3fa6397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:39.729266 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fd6087bb-ce54-4ac5-803a-72a5a3fa6397 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:48:39.730469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fd6087bb-ce54-4ac5-803a-72a5a3fa6397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:48:39.738771 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1371/2721] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 6 20:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:48:39.776727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0189a3-1923-4127-bb52-b6bde88a0460 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:48:39.778179 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5b0189a3-1923-4127-bb52-b6bde88a0460 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:48:39.788984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:48:39.797230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0189a3-1923-4127-bb52-b6bde88a0460 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:48:39.803164 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b3184-f7e5-4959-be83-190ad42594b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:48:39.803844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b3184-f7e5-4959-be83-190ad42594b8 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:39.804150 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b3184-f7e5-4959-be83-190ad42594b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:39.804548 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b3184-f7e5-4959-be83-190ad42594b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:39.813372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b3184-f7e5-4959-be83-190ad42594b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:48:39.814941 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b3184-f7e5-4959-be83-190ad42594b8 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:48:39.824947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1351/2722] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:48:42.752217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3476ecb-b0eb-4fcd-a788-7eca52d5e979 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:42.752722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3476ecb-b0eb-4fcd-a788-7eca52d5e979 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:42.752834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3476ecb-b0eb-4fcd-a788-7eca52d5e979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:42.771956 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f3476ecb-b0eb-4fcd-a788-7eca52d5e979 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:48:42.773752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f3476ecb-b0eb-4fcd-a788-7eca52d5e979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:48:42.781673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1372/2723] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 6 20:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:48:42.804841 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b3184-f7e5-4959-be83-190ad42594b8 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:48:42.816006 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b3184-f7e5-4959-be83-190ad42594b8 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:48:42.822161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582fb7-623b-4459-afab-9ce3a52073eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:48:42.822790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582fb7-623b-4459-afab-9ce3a52073eb service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:42.823071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582fb7-623b-4459-afab-9ce3a52073eb service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:42.823377 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582fb7-623b-4459-afab-9ce3a52073eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:42.831342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08582fb7-623b-4459-afab-9ce3a52073eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:48:42.832891 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08582fb7-623b-4459-afab-9ce3a52073eb service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:48:42.842814 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1352/2724] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:48:45.907503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdf295-8dc0-43e0-b496-2c1a873c3dae None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:45.907994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdf295-8dc0-43e0-b496-2c1a873c3dae None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:45.908117 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdf295-8dc0-43e0-b496-2c1a873c3dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:45.925980 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a0bdf295-8dc0-43e0-b496-2c1a873c3dae None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:48:45.927186 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a0bdf295-8dc0-43e0-b496-2c1a873c3dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:48:45.935340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1373/2725] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 6 20:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:48:45.959382 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582fb7-623b-4459-afab-9ce3a52073eb service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:48:45.971592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582fb7-623b-4459-afab-9ce3a52073eb service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:48:45.977742 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d3c2-1c1f-4d3f-9943-659c9ac0b218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:48:45.978380 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d3c2-1c1f-4d3f-9943-659c9ac0b218 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:45.978667 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d3c2-1c1f-4d3f-9943-659c9ac0b218 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:45.978948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d3c2-1c1f-4d3f-9943-659c9ac0b218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:45.987504 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68d3c2-1c1f-4d3f-9943-659c9ac0b218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:48:45.989071 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68d3c2-1c1f-4d3f-9943-659c9ac0b218 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:48:45.998527 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1353/2726] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:48:49.061028 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6a0a8-c62e-4a2c-843c-95e1d84cdd0b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:49.061576 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6a0a8-c62e-4a2c-843c-95e1d84cdd0b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:49.061679 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6a0a8-c62e-4a2c-843c-95e1d84cdd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:49.079885 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-cec6a0a8-c62e-4a2c-843c-95e1d84cdd0b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:48:49.081088 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cec6a0a8-c62e-4a2c-843c-95e1d84cdd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:48:49.089722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1374/2727] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 6 20:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:48:49.111023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d3c2-1c1f-4d3f-9943-659c9ac0b218 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:48:49.122703 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d3c2-1c1f-4d3f-9943-659c9ac0b218 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:48:49.128241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5631020-e0db-4dcb-8db9-017c9a4c5966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:48:49.128877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5631020-e0db-4dcb-8db9-017c9a4c5966 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:48:49.129163 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5631020-e0db-4dcb-8db9-017c9a4c5966 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:48:49.129445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5631020-e0db-4dcb-8db9-017c9a4c5966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:48:49.138357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5631020-e0db-4dcb-8db9-017c9a4c5966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:48:49.140213 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5631020-e0db-4dcb-8db9-017c9a4c5966 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:48:49.151146 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1354/2728] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:48:59.074595 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=63 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:48:59.145866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=23 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:49:02.993106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafe05d-5b8a-4a16-ba7b-a51184595f5a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:02.993598 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafe05d-5b8a-4a16-ba7b-a51184595f5a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:02.993722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafe05d-5b8a-4a16-ba7b-a51184595f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:03.011608 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8cafe05d-5b8a-4a16-ba7b-a51184595f5a None None] MFA Rules not processed for user `bcca1b9a224446f0bf0a5c211821798f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:49:03.012865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8cafe05d-5b8a-4a16-ba7b-a51184595f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:03.068366 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1375/2729] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:49:03.296066 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5631020-e0db-4dcb-8db9-017c9a4c5966 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:03.297470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b5631020-e0db-4dcb-8db9-017c9a4c5966 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:03.356030 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5631020-e0db-4dcb-8db9-017c9a4c5966 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:03.359770 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8a3ad-7ea4-4bd7-92aa-fd3489211eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:03.360416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8a3ad-7ea4-4bd7-92aa-fd3489211eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:03.360702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8a3ad-7ea4-4bd7-92aa-fd3489211eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:03.360983 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8a3ad-7ea4-4bd7-92aa-fd3489211eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:03.362753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3ba8a3ad-7ea4-4bd7-92aa-fd3489211eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:03.372286 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8a3ad-7ea4-4bd7-92aa-fd3489211eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:03.373712 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8a3ad-7ea4-4bd7-92aa-fd3489211eb4 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:03.381643 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1355/2730] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:49:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:49:13.061519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=25 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:49:13.378177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=26 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:49:15.875346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518d069-0b6d-48cf-880f-c96d8db6182f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:15.875912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518d069-0b6d-48cf-880f-c96d8db6182f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:15.875912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518d069-0b6d-48cf-880f-c96d8db6182f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:15.895108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1518d069-0b6d-48cf-880f-c96d8db6182f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:49:15.896367 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1518d069-0b6d-48cf-880f-c96d8db6182f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:15.905103 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1376/2731] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 6 20:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:49:15.926599 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8a3ad-7ea4-4bd7-92aa-fd3489211eb4 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:15.939815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8a3ad-7ea4-4bd7-92aa-fd3489211eb4 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:15.945226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db895403-81ff-4f6d-b27b-ef799ca95274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:15.945861 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db895403-81ff-4f6d-b27b-ef799ca95274 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:15.946146 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db895403-81ff-4f6d-b27b-ef799ca95274 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:15.946425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db895403-81ff-4f6d-b27b-ef799ca95274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:15.954672 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db895403-81ff-4f6d-b27b-ef799ca95274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:15.956272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db895403-81ff-4f6d-b27b-ef799ca95274 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:15.966358 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1356/2732] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:49:19.115751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898ba8c-72cb-434b-8390-30d0b60ad47d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:19.116293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898ba8c-72cb-434b-8390-30d0b60ad47d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:19.116293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898ba8c-72cb-434b-8390-30d0b60ad47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:19.134590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a898ba8c-72cb-434b-8390-30d0b60ad47d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:49:19.135861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a898ba8c-72cb-434b-8390-30d0b60ad47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:19.144057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1377/2733] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 6 20:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:49:19.165487 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db895403-81ff-4f6d-b27b-ef799ca95274 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:19.177966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db895403-81ff-4f6d-b27b-ef799ca95274 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:19.184128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0811330-f3a3-4d8c-863c-16796f0efa2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:19.184763 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0811330-f3a3-4d8c-863c-16796f0efa2e service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:19.185046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0811330-f3a3-4d8c-863c-16796f0efa2e service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:19.185325 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0811330-f3a3-4d8c-863c-16796f0efa2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:19.193514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0811330-f3a3-4d8c-863c-16796f0efa2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:19.195081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0811330-f3a3-4d8c-863c-16796f0efa2e service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:19.204745 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1357/2734] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:49:22.194233 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0eb7-d419-439b-9e15-9a711e24f21b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:22.194719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0eb7-d419-439b-9e15-9a711e24f21b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:22.194719 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0eb7-d419-439b-9e15-9a711e24f21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:22.213181 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9dfb0eb7-d419-439b-9e15-9a711e24f21b None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:49:22.214391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9dfb0eb7-d419-439b-9e15-9a711e24f21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:22.222330 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1378/2735] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 6 20:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:49:22.242557 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0811330-f3a3-4d8c-863c-16796f0efa2e service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:22.254989 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0811330-f3a3-4d8c-863c-16796f0efa2e service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:22.260477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa835f-ddaa-49af-8af1-01853034f81b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:22.261187 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa835f-ddaa-49af-8af1-01853034f81b service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:22.262092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa835f-ddaa-49af-8af1-01853034f81b service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:22.262642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa835f-ddaa-49af-8af1-01853034f81b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:22.270846 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa835f-ddaa-49af-8af1-01853034f81b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:22.272456 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa835f-ddaa-49af-8af1-01853034f81b service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:22.281978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1358/2736] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:49:25.358578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7fc29-bea2-44a5-b2ad-5c3a365016d1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:25.359124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7fc29-bea2-44a5-b2ad-5c3a365016d1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:25.359124 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7fc29-bea2-44a5-b2ad-5c3a365016d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:25.378281 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-add7fc29-bea2-44a5-b2ad-5c3a365016d1 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:49:25.379498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-add7fc29-bea2-44a5-b2ad-5c3a365016d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:25.388350 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1379/2737] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 6 20:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:49:25.411642 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa835f-ddaa-49af-8af1-01853034f81b service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:25.426430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa835f-ddaa-49af-8af1-01853034f81b service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:25.431911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14789af-132b-4048-b681-f90f05eaa01f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:25.432552 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14789af-132b-4048-b681-f90f05eaa01f service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:25.432834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14789af-132b-4048-b681-f90f05eaa01f service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:25.434661 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14789af-132b-4048-b681-f90f05eaa01f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:25.443270 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14789af-132b-4048-b681-f90f05eaa01f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:25.444875 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14789af-132b-4048-b681-f90f05eaa01f service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:25.454632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1359/2738] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:49:28.513693 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55db10-a5d4-430f-b73e-4650ddb8ec61 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:28.514208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55db10-a5d4-430f-b73e-4650ddb8ec61 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:28.514314 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55db10-a5d4-430f-b73e-4650ddb8ec61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:28.532860 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7a55db10-a5d4-430f-b73e-4650ddb8ec61 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:49:28.534053 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7a55db10-a5d4-430f-b73e-4650ddb8ec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:28.542208 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1380/2739] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 6 20:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:49:28.568461 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14789af-132b-4048-b681-f90f05eaa01f service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:28.580709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14789af-132b-4048-b681-f90f05eaa01f service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:28.586150 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0310ab-6aed-48e0-abf1-37e65eddea4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:28.586787 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0310ab-6aed-48e0-abf1-37e65eddea4a service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:28.587193 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0310ab-6aed-48e0-abf1-37e65eddea4a service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:28.587492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0310ab-6aed-48e0-abf1-37e65eddea4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:28.597330 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0310ab-6aed-48e0-abf1-37e65eddea4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:28.599422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0310ab-6aed-48e0-abf1-37e65eddea4a service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:28.611008 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1360/2740] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:49:38.528453 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=15 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:49:38.605986 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=30 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:49:57.509443 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55db10-a5d4-430f-b73e-4650ddb8ec61 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:57.510970 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7a55db10-a5d4-430f-b73e-4650ddb8ec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:57.574991 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0310ab-6aed-48e0-abf1-37e65eddea4a service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:57.577215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6e0310ab-6aed-48e0-abf1-37e65eddea4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:57.584457 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55db10-a5d4-430f-b73e-4650ddb8ec61 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:57.594395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213316a-b911-4050-86db-5f7f72585078 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98059ebef5d470db684fb78d19a8839', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:57.594395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213316a-b911-4050-86db-5f7f72585078 service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:57.594395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213316a-b911-4050-86db-5f7f72585078 service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:57.594395 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213316a-b911-4050-86db-5f7f72585078 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:57.594846 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8213316a-b911-4050-86db-5f7f72585078 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:57.594926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0310ab-6aed-48e0-abf1-37e65eddea4a service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:57.599001 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7e24c-8932-4652-88b3-035f32bc5d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:57.599913 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7e24c-8932-4652-88b3-035f32bc5d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:57.600253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7e24c-8932-4652-88b3-035f32bc5d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:57.600472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7e24c-8932-4652-88b3-035f32bc5d5c admin admin] PATH_INFO: `/v3/users/bcca1b9a224446f0bf0a5c211821798f` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:57.601665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7e24c-8932-4652-88b3-035f32bc5d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcca1b9a224446f0bf0a5c211821798f)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:57.603855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7e24c-8932-4652-88b3-035f32bc5d5c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:57.607634 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213316a-b911-4050-86db-5f7f72585078 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:57.609337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213316a-b911-4050-86db-5f7f72585078 service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:57.619851 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1381/2741] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:49:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:49:57.654948 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-abb7e24c-8932-4652-88b3-035f32bc5d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcca1b9a224446f0bf0a5c211821798f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:49:57.655662 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-abb7e24c-8932-4652-88b3-035f32bc5d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcca1b9a224446f0bf0a5c211821798f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:49:57.668145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-abb7e24c-8932-4652-88b3-035f32bc5d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcca1b9a224446f0bf0a5c211821798f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:49:57.675522 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-abb7e24c-8932-4652-88b3-035f32bc5d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcca1b9a224446f0bf0a5c211821798f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:49:57.682683 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-abb7e24c-8932-4652-88b3-035f32bc5d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcca1b9a224446f0bf0a5c211821798f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:49:57.688699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1361/2742] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:49:57 2022] DELETE /identity/v3/users/bcca1b9a224446f0bf0a5c211821798f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:49:57.861331 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213316a-b911-4050-86db-5f7f72585078 service placement] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:57.873214 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213316a-b911-4050-86db-5f7f72585078 service placement] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:57.931468 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572460-f89c-4bdd-9e96-43fae1796bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:57.932346 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572460-f89c-4bdd-9e96-43fae1796bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:57.932658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572460-f89c-4bdd-9e96-43fae1796bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:57.932939 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572460-f89c-4bdd-9e96-43fae1796bfc admin admin] PATH_INFO: `/v3/projects/3a2ea607b16d4417be2db58c863280bc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:57.934168 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a572460-f89c-4bdd-9e96-43fae1796bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2ea607b16d4417be2db58c863280bc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:57.936134 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a572460-f89c-4bdd-9e96-43fae1796bfc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:57.981616 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a572460-f89c-4bdd-9e96-43fae1796bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2ea607b16d4417be2db58c863280bc', 'request_id': 'req-8a572460-f89c-4bdd-9e96-43fae1796bfc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:49:57.987508 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a572460-f89c-4bdd-9e96-43fae1796bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2ea607b16d4417be2db58c863280bc', 'request_id': 'req-8a572460-f89c-4bdd-9e96-43fae1796bfc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:49:57.995153 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a572460-f89c-4bdd-9e96-43fae1796bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2ea607b16d4417be2db58c863280bc', 'request_id': 'req-8a572460-f89c-4bdd-9e96-43fae1796bfc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:49:58.005138 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a572460-f89c-4bdd-9e96-43fae1796bfc admin admin] The token cache is being invalidate because project 3a2ea607b16d4417be2db58c863280bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:49:58.005420 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a572460-f89c-4bdd-9e96-43fae1796bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:49:58.006029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8a572460-f89c-4bdd-9e96-43fae1796bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:49:58.007568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1382/2743] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:49:57 2022] DELETE /identity/v3/projects/3a2ea607b16d4417be2db58c863280bc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:49:58.013230 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c792940-dc26-4d26-a195-ee495a8b7ce6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:58.013514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c792940-dc26-4d26-a195-ee495a8b7ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:58.013788 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c792940-dc26-4d26-a195-ee495a8b7ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:58.032130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8c792940-dc26-4d26-a195-ee495a8b7ce6 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:49:58.033322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8c792940-dc26-4d26-a195-ee495a8b7ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:58.091589 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1362/2744] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:49:58.099391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928fcb1-07c2-4147-bea1-0c411339558e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:58.099685 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928fcb1-07c2-4147-bea1-0c411339558e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:58.099969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928fcb1-07c2-4147-bea1-0c411339558e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:58.120941 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1928fcb1-07c2-4147-bea1-0c411339558e None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:49:58.121954 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1928fcb1-07c2-4147-bea1-0c411339558e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:58.129802 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1383/2745] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:49:58.134132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c792940-dc26-4d26-a195-ee495a8b7ce6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:58.144726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c792940-dc26-4d26-a195-ee495a8b7ce6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:58.149272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d278ede-3f3b-4be3-aba2-1d0b27cccc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:58.149920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d278ede-3f3b-4be3-aba2-1d0b27cccc15 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:58.150211 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d278ede-3f3b-4be3-aba2-1d0b27cccc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:58.151110 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d278ede-3f3b-4be3-aba2-1d0b27cccc15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:58.152488 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d278ede-3f3b-4be3-aba2-1d0b27cccc15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:49:58.152800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d278ede-3f3b-4be3-aba2-1d0b27cccc15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:58.154386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d278ede-3f3b-4be3-aba2-1d0b27cccc15 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:58.165736 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1363/2746] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:49:58.170396 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928fcb1-07c2-4147-bea1-0c411339558e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:58.179684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928fcb1-07c2-4147-bea1-0c411339558e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:58.185027 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e1d72-b698-4fa3-9e4e-a38bd705cfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:58.185683 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e1d72-b698-4fa3-9e4e-a38bd705cfac admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:58.185969 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e1d72-b698-4fa3-9e4e-a38bd705cfac admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:58.186247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e1d72-b698-4fa3-9e4e-a38bd705cfac admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:58.186935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e1d72-b698-4fa3-9e4e-a38bd705cfac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:58.188873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e1d72-b698-4fa3-9e4e-a38bd705cfac admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:58.199685 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:49:58.218020 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1384/2747] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:49:58 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:49:58.222633 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d278ede-3f3b-4be3-aba2-1d0b27cccc15 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:58.232936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d278ede-3f3b-4be3-aba2-1d0b27cccc15 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:58.287815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa078cfe-8ff6-4719-81e7-ade8f0e39e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:58.288471 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa078cfe-8ff6-4719-81e7-ade8f0e39e1d admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:58.288756 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa078cfe-8ff6-4719-81e7-ade8f0e39e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:58.289036 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa078cfe-8ff6-4719-81e7-ade8f0e39e1d admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:58.289723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa078cfe-8ff6-4719-81e7-ade8f0e39e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:58.291647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa078cfe-8ff6-4719-81e7-ade8f0e39e1d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:58.298279 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:49:58.313310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1364/2748] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:49:58 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:49:58.317421 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e1d72-b698-4fa3-9e4e-a38bd705cfac admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:58.328447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e1d72-b698-4fa3-9e4e-a38bd705cfac admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:58.333144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53510879-0969-4f32-97dd-268cbf37984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:58.333804 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53510879-0969-4f32-97dd-268cbf37984d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:58.334092 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53510879-0969-4f32-97dd-268cbf37984d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:58.334373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53510879-0969-4f32-97dd-268cbf37984d admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:58.335098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53510879-0969-4f32-97dd-268cbf37984d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:58.336735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53510879-0969-4f32-97dd-268cbf37984d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:58.348701 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1385/2749] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:49:58.352754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa078cfe-8ff6-4719-81e7-ade8f0e39e1d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:58.362654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa078cfe-8ff6-4719-81e7-ade8f0e39e1d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:58.367123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e7241-c339-4137-b217-35546ff2a5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:58.367800 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e7241-c339-4137-b217-35546ff2a5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:58.368087 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e7241-c339-4137-b217-35546ff2a5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:58.368363 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e7241-c339-4137-b217-35546ff2a5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:58.369075 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e7241-c339-4137-b217-35546ff2a5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:58.370663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e7241-c339-4137-b217-35546ff2a5dc admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:58.380560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1365/2750] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:49:58.384313 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53510879-0969-4f32-97dd-268cbf37984d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:58.395126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53510879-0969-4f32-97dd-268cbf37984d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:58.399754 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1228847-eacf-400b-8c33-6780f06dd148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:58.400628 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1228847-eacf-400b-8c33-6780f06dd148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:58.400912 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1228847-eacf-400b-8c33-6780f06dd148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:58.401188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1228847-eacf-400b-8c33-6780f06dd148 admin admin] PATH_INFO: `/v3/projects/4633e02346a44f8db1880dee4b234d24/users/75a880e2f8234ad4861db8353a8544a7/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:58.415755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1228847-eacf-400b-8c33-6780f06dd148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4633e02346a44f8db1880dee4b234d24, user_id=75a880e2f8234ad4861db8353a8544a7, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:58.418557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1228847-eacf-400b-8c33-6780f06dd148 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:58.431360 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1386/2751] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:49:58 2022] PUT /identity/v3/projects/4633e02346a44f8db1880dee4b234d24/users/75a880e2f8234ad4861db8353a8544a7/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:49:58.437253 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a3da5-1fa6-4435-ae29-6906cfabe492 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:58.437542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a3da5-1fa6-4435-ae29-6906cfabe492 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:58.437821 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a3da5-1fa6-4435-ae29-6906cfabe492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:58.455743 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-df3a3da5-1fa6-4435-ae29-6906cfabe492 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:49:58.456921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-df3a3da5-1fa6-4435-ae29-6906cfabe492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:58.514679 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1366/2752] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:49:58.524154 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1228847-eacf-400b-8c33-6780f06dd148 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:49:58.525861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b1228847-eacf-400b-8c33-6780f06dd148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:49:58.582341 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1228847-eacf-400b-8c33-6780f06dd148 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:49:58.586230 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6bec8-baff-4d23-bec4-19237ebf0fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:49:58.586940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6bec8-baff-4d23-bec4-19237ebf0fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:49:58.587260 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6bec8-baff-4d23-bec4-19237ebf0fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:49:58.587688 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6bec8-baff-4d23-bec4-19237ebf0fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:49:58.601548 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6bec8-baff-4d23-bec4-19237ebf0fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:49:58.602998 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6bec8-baff-4d23-bec4-19237ebf0fd5 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:49:58.614160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1387/2753] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:50:02.475582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2ecd9-e7df-4902-b356-c6d549f0c0a3 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:50:02.476037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2ecd9-e7df-4902-b356-c6d549f0c0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:50:02.476131 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2ecd9-e7df-4902-b356-c6d549f0c0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:50:02.502903 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-77e2ecd9-e7df-4902-b356-c6d549f0c0a3 None None] MFA Rules not processed for user `75a880e2f8234ad4861db8353a8544a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:50:02.504266 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-77e2ecd9-e7df-4902-b356-c6d549f0c0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:50:02.582404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1367/2754] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:50:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:50:02.586755 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6bec8-baff-4d23-bec4-19237ebf0fd5 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:50:02.598451 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6bec8-baff-4d23-bec4-19237ebf0fd5 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:50:02.603029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376a6d7-6998-4fc2-8e31-ce00bc21f6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:50:02.603720 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a6d7-6998-4fc2-8e31-ce00bc21f6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:50:02.604005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a6d7-6998-4fc2-8e31-ce00bc21f6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:50:02.604816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a6d7-6998-4fc2-8e31-ce00bc21f6f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:50:02.605644 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376a6d7-6998-4fc2-8e31-ce00bc21f6f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:50:02.607627 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376a6d7-6998-4fc2-8e31-ce00bc21f6f6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:50:02.636123 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1388/2755] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:50:02 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:50:02.640157 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2ecd9-e7df-4902-b356-c6d549f0c0a3 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:50:02.651413 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2ecd9-e7df-4902-b356-c6d549f0c0a3 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:50:02.732237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c46eef-d83b-4164-9244-0f4f941346b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:50:02.732918 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c46eef-d83b-4164-9244-0f4f941346b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:50:02.733217 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c46eef-d83b-4164-9244-0f4f941346b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:50:02.733476 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c46eef-d83b-4164-9244-0f4f941346b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:50:02.734176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c46eef-d83b-4164-9244-0f4f941346b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:50:02.736185 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c46eef-d83b-4164-9244-0f4f941346b2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:50:02.755709 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:50:02.765854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1368/2756] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:50:02 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:50:02.768241 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376a6d7-6998-4fc2-8e31-ce00bc21f6f6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:50:02.779010 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376a6d7-6998-4fc2-8e31-ce00bc21f6f6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:50:02.783759 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5ca38-92de-4090-bd02-7c7a5dc90eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:50:02.784463 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5ca38-92de-4090-bd02-7c7a5dc90eef admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:50:02.784744 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5ca38-92de-4090-bd02-7c7a5dc90eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:50:02.785018 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5ca38-92de-4090-bd02-7c7a5dc90eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:50:02.785739 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5ca38-92de-4090-bd02-7c7a5dc90eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:50:02.787374 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5ca38-92de-4090-bd02-7c7a5dc90eef admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:50:02.799514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1389/2757] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:50:02.803702 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c46eef-d83b-4164-9244-0f4f941346b2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:50:02.816829 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c46eef-d83b-4164-9244-0f4f941346b2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:50:02.823580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf3bd0-793a-42bf-97c0-e6b1994c140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:50:02.824574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf3bd0-793a-42bf-97c0-e6b1994c140e admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:50:02.824859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf3bd0-793a-42bf-97c0-e6b1994c140e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:50:02.825136 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf3bd0-793a-42bf-97c0-e6b1994c140e admin admin] PATH_INFO: `/v3/projects/f2346276d99d41928857c60db9e25119/users/55841ad633b74f0eb5372d7df5b928e4/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:50:02.843120 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf3bd0-793a-42bf-97c0-e6b1994c140e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2346276d99d41928857c60db9e25119, user_id=55841ad633b74f0eb5372d7df5b928e4, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:50:02.845844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf3bd0-793a-42bf-97c0-e6b1994c140e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:50:02.860744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1369/2758] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:50:02 2022] PUT /identity/v3/projects/f2346276d99d41928857c60db9e25119/users/55841ad633b74f0eb5372d7df5b928e4/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:50:02.864875 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5ca38-92de-4090-bd02-7c7a5dc90eef admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:50:02.876012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5ca38-92de-4090-bd02-7c7a5dc90eef admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:50:02.941246 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e312a44-1006-49ec-964b-6a0d3d2303d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:50:02.941928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e312a44-1006-49ec-964b-6a0d3d2303d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:50:02.942215 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e312a44-1006-49ec-964b-6a0d3d2303d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:50:02.942495 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e312a44-1006-49ec-964b-6a0d3d2303d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:50:02.943300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e312a44-1006-49ec-964b-6a0d3d2303d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:50:02.944892 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e312a44-1006-49ec-964b-6a0d3d2303d4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:50:02.956540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1390/2759] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:50:02.960618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf3bd0-793a-42bf-97c0-e6b1994c140e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:50:02.971690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf3bd0-793a-42bf-97c0-e6b1994c140e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:50:02.976397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d5860-a721-492d-af35-377578ed4483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:50:02.977289 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d5860-a721-492d-af35-377578ed4483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:50:02.977576 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d5860-a721-492d-af35-377578ed4483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:50:02.977852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d5860-a721-492d-af35-377578ed4483 admin admin] PATH_INFO: `/v3/projects/f2346276d99d41928857c60db9e25119/users/55841ad633b74f0eb5372d7df5b928e4/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:50:02.980072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d5860-a721-492d-af35-377578ed4483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2346276d99d41928857c60db9e25119, user_id=55841ad633b74f0eb5372d7df5b928e4, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:50:02.982711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d5860-a721-492d-af35-377578ed4483 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:50:02.993979 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1370/2760] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:50:02 2022] PUT /identity/v3/projects/f2346276d99d41928857c60db9e25119/users/55841ad633b74f0eb5372d7df5b928e4/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:50:07.275345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22165b-f51c-4f3f-beb4-8a147e7f7767 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:50:07.276011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22165b-f51c-4f3f-beb4-8a147e7f7767 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:50:07.276011 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22165b-f51c-4f3f-beb4-8a147e7f7767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:50:07.303104 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0b22165b-f51c-4f3f-beb4-8a147e7f7767 None None] MFA Rules not processed for user `55841ad633b74f0eb5372d7df5b928e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:50:07.304716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0b22165b-f51c-4f3f-beb4-8a147e7f7767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:50:07.314752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:50:07.375422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1391/2761] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:50:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:50:07.392509 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d5860-a721-492d-af35-377578ed4483 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:50:07.394514 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-833d5860-a721-492d-af35-377578ed4483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:50:07.476046 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d5860-a721-492d-af35-377578ed4483 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:50:07.483040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaecf67-2f59-4666-8084-5b76f5aade3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:50:07.483040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaecf67-2f59-4666-8084-5b76f5aade3d service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:50:07.483319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaecf67-2f59-4666-8084-5b76f5aade3d service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:50:07.483775 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaecf67-2f59-4666-8084-5b76f5aade3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:50:07.550528 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaecf67-2f59-4666-8084-5b76f5aade3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:50:07.552148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaecf67-2f59-4666-8084-5b76f5aade3d service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:50:07.563950 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1371/2762] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:50:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:50:08.602059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf7ee9-d2f9-4a5a-beea-7abc127ccb23 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:50:08.602571 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf7ee9-d2f9-4a5a-beea-7abc127ccb23 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:50:08.602902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf7ee9-d2f9-4a5a-beea-7abc127ccb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:50:08.624385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a8bf7ee9-d2f9-4a5a-beea-7abc127ccb23 None None] MFA Rules not processed for user `75a880e2f8234ad4861db8353a8544a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:50:08.625588 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a8bf7ee9-d2f9-4a5a-beea-7abc127ccb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:50:08.633197 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1392/2763] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:50:17.559734 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:50:18.618029 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=27 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:50:22.869826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaecf67-2f59-4666-8084-5b76f5aade3d service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:50:22.871401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2eaecf67-2f59-4666-8084-5b76f5aade3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:50:22.943330 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaecf67-2f59-4666-8084-5b76f5aade3d service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:50:22.948660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604c7f-f0e1-4ed9-a39e-ceb6191c26ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98059ebef5d470db684fb78d19a8839', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:50:22.949306 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604c7f-f0e1-4ed9-a39e-ceb6191c26ee service placement] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:50:22.949590 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604c7f-f0e1-4ed9-a39e-ceb6191c26ee service placement] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:50:22.949867 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604c7f-f0e1-4ed9-a39e-ceb6191c26ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:50:22.951691 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0a604c7f-f0e1-4ed9-a39e-ceb6191c26ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:50:22.963067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a604c7f-f0e1-4ed9-a39e-ceb6191c26ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:50:22.964648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a604c7f-f0e1-4ed9-a39e-ceb6191c26ee service placement] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:50:22.974699 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1372/2764] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:50:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:50:32.318338 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96a6a-aef3-4bab-b7d1-4ae16249268a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:50:32.318829 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96a6a-aef3-4bab-b7d1-4ae16249268a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:50:32.318928 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96a6a-aef3-4bab-b7d1-4ae16249268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:50:32.337580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-eda96a6a-aef3-4bab-b7d1-4ae16249268a None None] MFA Rules not processed for user `1663768f5e734624896ba98db07bb45d`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:50:32.339036 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-eda96a6a-aef3-4bab-b7d1-4ae16249268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:50:32.404925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1393/2765] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:50:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:50:32.970516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=32 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:50:34.550035 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604c7f-f0e1-4ed9-a39e-ceb6191c26ee service placement] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:50:34.610564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604c7f-f0e1-4ed9-a39e-ceb6191c26ee service placement] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:50:34.614262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04da395-38a8-4b10-8f25-14f2eec8da02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:50:34.614908 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04da395-38a8-4b10-8f25-14f2eec8da02 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:50:34.615208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04da395-38a8-4b10-8f25-14f2eec8da02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:50:34.615493 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04da395-38a8-4b10-8f25-14f2eec8da02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:50:34.625750 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04da395-38a8-4b10-8f25-14f2eec8da02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:50:34.628009 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04da395-38a8-4b10-8f25-14f2eec8da02 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:50:34.640128 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1373/2766] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:50:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:50:42.397870 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=25 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:50:44.634188 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=26 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:51:32.216445 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda96a6a-aef3-4bab-b7d1-4ae16249268a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:32.226492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda96a6a-aef3-4bab-b7d1-4ae16249268a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:32.230133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94876e8b-0537-4a8a-9190-165ea2f3d2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:32.230885 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94876e8b-0537-4a8a-9190-165ea2f3d2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:32.231274 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94876e8b-0537-4a8a-9190-165ea2f3d2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:32.231641 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94876e8b-0537-4a8a-9190-165ea2f3d2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:32.233623 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-94876e8b-0537-4a8a-9190-165ea2f3d2c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:32.246960 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94876e8b-0537-4a8a-9190-165ea2f3d2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:32.249214 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94876e8b-0537-4a8a-9190-165ea2f3d2c8 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:32.260540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1394/2767] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:51:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:51:40.644937 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04da395-38a8-4b10-8f25-14f2eec8da02 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:40.646498 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e04da395-38a8-4b10-8f25-14f2eec8da02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:40.662176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04da395-38a8-4b10-8f25-14f2eec8da02 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:40.667484 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e35b0e-150e-4840-9eb6-0dc41da3c359 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98059ebef5d470db684fb78d19a8839', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:40.668125 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e35b0e-150e-4840-9eb6-0dc41da3c359 service placement] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:40.668410 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e35b0e-150e-4840-9eb6-0dc41da3c359 service placement] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:40.668685 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e35b0e-150e-4840-9eb6-0dc41da3c359 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:40.671033 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d6e35b0e-150e-4840-9eb6-0dc41da3c359 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:40.691360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e35b0e-150e-4840-9eb6-0dc41da3c359 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:40.691360 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e35b0e-150e-4840-9eb6-0dc41da3c359 service placement] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:40.693193 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94876e8b-0537-4a8a-9190-165ea2f3d2c8 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:40.694668 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-94876e8b-0537-4a8a-9190-165ea2f3d2c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:40.703942 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1374/2768] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:51:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:51:40.771800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94876e8b-0537-4a8a-9190-165ea2f3d2c8 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:40.776476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01377ed-c437-4c8c-aefe-ed87f8dffef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:40.777385 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01377ed-c437-4c8c-aefe-ed87f8dffef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:40.777666 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01377ed-c437-4c8c-aefe-ed87f8dffef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:40.777940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01377ed-c437-4c8c-aefe-ed87f8dffef1 admin admin] PATH_INFO: `/v3/users/1663768f5e734624896ba98db07bb45d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:40.779749 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01377ed-c437-4c8c-aefe-ed87f8dffef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1663768f5e734624896ba98db07bb45d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:40.781708 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01377ed-c437-4c8c-aefe-ed87f8dffef1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:40.833711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c01377ed-c437-4c8c-aefe-ed87f8dffef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1663768f5e734624896ba98db07bb45d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:40.842237 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c01377ed-c437-4c8c-aefe-ed87f8dffef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1663768f5e734624896ba98db07bb45d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:40.849689 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c01377ed-c437-4c8c-aefe-ed87f8dffef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1663768f5e734624896ba98db07bb45d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:40.850322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c01377ed-c437-4c8c-aefe-ed87f8dffef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1663768f5e734624896ba98db07bb45d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:40.861905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c01377ed-c437-4c8c-aefe-ed87f8dffef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1663768f5e734624896ba98db07bb45d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:40.868219 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1395/2769] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:51:40 2022] DELETE /identity/v3/users/1663768f5e734624896ba98db07bb45d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:51:41.047077 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e35b0e-150e-4840-9eb6-0dc41da3c359 service placement] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:41.057773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e35b0e-150e-4840-9eb6-0dc41da3c359 service placement] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:41.116108 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77baba-3b0c-4f36-a2eb-7a071974f72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:41.116894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77baba-3b0c-4f36-a2eb-7a071974f72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.117174 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77baba-3b0c-4f36-a2eb-7a071974f72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.117448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77baba-3b0c-4f36-a2eb-7a071974f72c admin admin] PATH_INFO: `/v3/projects/329c53ec98ce4574acfe47a2b1ea87ad` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:41.118600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77baba-3b0c-4f36-a2eb-7a071974f72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=329c53ec98ce4574acfe47a2b1ea87ad)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:41.120578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77baba-3b0c-4f36-a2eb-7a071974f72c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:41.165228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9c77baba-3b0c-4f36-a2eb-7a071974f72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329c53ec98ce4574acfe47a2b1ea87ad', 'request_id': 'req-9c77baba-3b0c-4f36-a2eb-7a071974f72c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:41.172624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9c77baba-3b0c-4f36-a2eb-7a071974f72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329c53ec98ce4574acfe47a2b1ea87ad', 'request_id': 'req-9c77baba-3b0c-4f36-a2eb-7a071974f72c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:41.178216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9c77baba-3b0c-4f36-a2eb-7a071974f72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329c53ec98ce4574acfe47a2b1ea87ad', 'request_id': 'req-9c77baba-3b0c-4f36-a2eb-7a071974f72c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:41.189537 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9c77baba-3b0c-4f36-a2eb-7a071974f72c admin admin] The token cache is being invalidate because project 329c53ec98ce4574acfe47a2b1ea87ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:51:41.189823 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9c77baba-3b0c-4f36-a2eb-7a071974f72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:41.190444 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9c77baba-3b0c-4f36-a2eb-7a071974f72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:41.192018 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1375/2770] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:51:41 2022] DELETE /identity/v3/projects/329c53ec98ce4574acfe47a2b1ea87ad => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:51:41.196925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0403-2634-44bc-a76d-05c776586159 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.197216 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0403-2634-44bc-a76d-05c776586159 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.197498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0403-2634-44bc-a76d-05c776586159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:41.215614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d3cf0403-2634-44bc-a76d-05c776586159 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:51:41.216971 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d3cf0403-2634-44bc-a76d-05c776586159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:41.276408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1396/2771] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:51:41.284830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2a8a0-3413-4e03-87f3-0e5e8f2a174a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.285119 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2a8a0-3413-4e03-87f3-0e5e8f2a174a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.285398 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2a8a0-3413-4e03-87f3-0e5e8f2a174a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:41.304226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-88c2a8a0-3413-4e03-87f3-0e5e8f2a174a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:51:41.305422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-88c2a8a0-3413-4e03-87f3-0e5e8f2a174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:41.314236 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1376/2772] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:51:41.318336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf0403-2634-44bc-a76d-05c776586159 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:41.328456 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf0403-2634-44bc-a76d-05c776586159 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:41.332993 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af125a4-eefd-4c97-af83-e2b5abda99eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:41.333647 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af125a4-eefd-4c97-af83-e2b5abda99eb admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.333934 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af125a4-eefd-4c97-af83-e2b5abda99eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.334213 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af125a4-eefd-4c97-af83-e2b5abda99eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:41.334932 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af125a4-eefd-4c97-af83-e2b5abda99eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:51:41.335276 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af125a4-eefd-4c97-af83-e2b5abda99eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:41.336872 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af125a4-eefd-4c97-af83-e2b5abda99eb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:41.338300 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:51:41.350980 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1397/2773] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:51:41.354939 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2a8a0-3413-4e03-87f3-0e5e8f2a174a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:41.364710 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2a8a0-3413-4e03-87f3-0e5e8f2a174a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:41.369404 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4f513-fdad-42a2-b19d-7a55b80ab885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:41.370061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f513-fdad-42a2-b19d-7a55b80ab885 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.370348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f513-fdad-42a2-b19d-7a55b80ab885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.370630 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f513-fdad-42a2-b19d-7a55b80ab885 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:41.371464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4f513-fdad-42a2-b19d-7a55b80ab885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:41.374567 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4f513-fdad-42a2-b19d-7a55b80ab885 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:41.403648 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1377/2774] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:51:41 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:51:41.405303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af125a4-eefd-4c97-af83-e2b5abda99eb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:41.415352 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af125a4-eefd-4c97-af83-e2b5abda99eb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:41.473509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f8458-da85-450f-abcf-0e67182bd7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:41.474184 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f8458-da85-450f-abcf-0e67182bd7ac admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.474501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f8458-da85-450f-abcf-0e67182bd7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.474779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f8458-da85-450f-abcf-0e67182bd7ac admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:41.475493 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f8458-da85-450f-abcf-0e67182bd7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:41.477417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f8458-da85-450f-abcf-0e67182bd7ac admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:41.498651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1398/2775] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:51:41 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:51:41.501897 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4f513-fdad-42a2-b19d-7a55b80ab885 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:41.512440 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4f513-fdad-42a2-b19d-7a55b80ab885 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:41.518000 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714f2c0-9e62-44c4-aa49-162a48c04f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:41.518671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f2c0-9e62-44c4-aa49-162a48c04f37 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.518964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f2c0-9e62-44c4-aa49-162a48c04f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.519287 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f2c0-9e62-44c4-aa49-162a48c04f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:41.520030 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714f2c0-9e62-44c4-aa49-162a48c04f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:41.521706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714f2c0-9e62-44c4-aa49-162a48c04f37 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:41.535650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1378/2776] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:51:41.539847 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f8458-da85-450f-abcf-0e67182bd7ac admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:41.550659 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f8458-da85-450f-abcf-0e67182bd7ac admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:41.555442 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb034a58-ae45-4abb-9d5e-2cc314b964ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:41.556110 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb034a58-ae45-4abb-9d5e-2cc314b964ad admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.556401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb034a58-ae45-4abb-9d5e-2cc314b964ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.556684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb034a58-ae45-4abb-9d5e-2cc314b964ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:41.557412 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb034a58-ae45-4abb-9d5e-2cc314b964ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:41.559012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb034a58-ae45-4abb-9d5e-2cc314b964ad admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:41.571000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1399/2777] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:51:41.574765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714f2c0-9e62-44c4-aa49-162a48c04f37 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:41.585617 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714f2c0-9e62-44c4-aa49-162a48c04f37 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:41.590508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce83f5e-ae32-42f1-af23-4b0a2cfb4ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:41.592445 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce83f5e-ae32-42f1-af23-4b0a2cfb4ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.592775 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce83f5e-ae32-42f1-af23-4b0a2cfb4ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.593060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce83f5e-ae32-42f1-af23-4b0a2cfb4ecb admin admin] PATH_INFO: `/v3/projects/d7f509545401429c834a2e9be41b459b/users/e97f2bac0eec4fe1b6000b7ade4866f7/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:41.608784 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce83f5e-ae32-42f1-af23-4b0a2cfb4ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f509545401429c834a2e9be41b459b, user_id=e97f2bac0eec4fe1b6000b7ade4866f7, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:41.611467 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce83f5e-ae32-42f1-af23-4b0a2cfb4ecb admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:41.625726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1379/2778] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:51:41 2022] PUT /identity/v3/projects/d7f509545401429c834a2e9be41b459b/users/e97f2bac0eec4fe1b6000b7ade4866f7/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:51:41.635918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fd517-f45b-4637-ab42-c97c348c2a05 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.636841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fd517-f45b-4637-ab42-c97c348c2a05 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.637130 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fd517-f45b-4637-ab42-c97c348c2a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:41.664750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fa7fd517-f45b-4637-ab42-c97c348c2a05 None None] MFA Rules not processed for user `e97f2bac0eec4fe1b6000b7ade4866f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:51:41.666003 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fa7fd517-f45b-4637-ab42-c97c348c2a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:41.729944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1400/2779] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:51:41.734596 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce83f5e-ae32-42f1-af23-4b0a2cfb4ecb admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:41.748458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:51:41.797733 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce83f5e-ae32-42f1-af23-4b0a2cfb4ecb admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:41.802371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac93bbb-2e53-4e43-b0ea-ac551090a562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:41.803022 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac93bbb-2e53-4e43-b0ea-ac551090a562 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.803342 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac93bbb-2e53-4e43-b0ea-ac551090a562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.803625 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac93bbb-2e53-4e43-b0ea-ac551090a562 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:41.804309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac93bbb-2e53-4e43-b0ea-ac551090a562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:41.806203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac93bbb-2e53-4e43-b0ea-ac551090a562 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:41.832245 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1380/2780] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:51:41 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:51:41.836293 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fd517-f45b-4637-ab42-c97c348c2a05 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:41.847004 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fd517-f45b-4637-ab42-c97c348c2a05 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:41.902247 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74d22e-1d71-487e-88c7-473008093058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:41.902926 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74d22e-1d71-487e-88c7-473008093058 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.903251 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74d22e-1d71-487e-88c7-473008093058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.903540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74d22e-1d71-487e-88c7-473008093058 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:41.905279 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74d22e-1d71-487e-88c7-473008093058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:41.907232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74d22e-1d71-487e-88c7-473008093058 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:41.914735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:51:41.933388 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1401/2781] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:51:41 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:51:41.934542 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac93bbb-2e53-4e43-b0ea-ac551090a562 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:41.945425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac93bbb-2e53-4e43-b0ea-ac551090a562 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:41.950269 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97f37f-20e0-4fcf-98ef-c7e51d6cf947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:41.951122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97f37f-20e0-4fcf-98ef-c7e51d6cf947 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.951507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97f37f-20e0-4fcf-98ef-c7e51d6cf947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.951786 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97f37f-20e0-4fcf-98ef-c7e51d6cf947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:41.952508 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97f37f-20e0-4fcf-98ef-c7e51d6cf947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:41.954153 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97f37f-20e0-4fcf-98ef-c7e51d6cf947 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:41.964644 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1381/2782] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:51:41.969704 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74d22e-1d71-487e-88c7-473008093058 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:41.979455 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74d22e-1d71-487e-88c7-473008093058 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:41.984924 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38be732-88d7-47f7-8d84-a27722b038ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:41.985805 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38be732-88d7-47f7-8d84-a27722b038ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:41.986089 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38be732-88d7-47f7-8d84-a27722b038ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:41.986398 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38be732-88d7-47f7-8d84-a27722b038ea admin admin] PATH_INFO: `/v3/projects/f2e34cce13c841e6ba80eb0d37ae74fb/users/ef457d1cfc774d198fa88a236222258c/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:42.001523 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38be732-88d7-47f7-8d84-a27722b038ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e34cce13c841e6ba80eb0d37ae74fb, user_id=ef457d1cfc774d198fa88a236222258c, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:42.004218 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38be732-88d7-47f7-8d84-a27722b038ea admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:42.017093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1402/2783] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:51:41 2022] PUT /identity/v3/projects/f2e34cce13c841e6ba80eb0d37ae74fb/users/ef457d1cfc774d198fa88a236222258c/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:51:42.020940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97f37f-20e0-4fcf-98ef-c7e51d6cf947 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:42.031768 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97f37f-20e0-4fcf-98ef-c7e51d6cf947 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:42.087365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3e97f-2f8f-4cfe-a462-549e81761363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:42.087944 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3e97f-2f8f-4cfe-a462-549e81761363 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:42.088225 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3e97f-2f8f-4cfe-a462-549e81761363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:42.088524 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3e97f-2f8f-4cfe-a462-549e81761363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:42.089238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3e97f-2f8f-4cfe-a462-549e81761363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:42.090825 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3e97f-2f8f-4cfe-a462-549e81761363 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:42.101569 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1382/2784] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:51:42.105615 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38be732-88d7-47f7-8d84-a27722b038ea admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:42.117308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38be732-88d7-47f7-8d84-a27722b038ea admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:42.122499 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c4cbc-3f05-4d24-9e0b-db667fee24c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:42.123436 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c4cbc-3f05-4d24-9e0b-db667fee24c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:42.123723 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c4cbc-3f05-4d24-9e0b-db667fee24c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:42.124000 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c4cbc-3f05-4d24-9e0b-db667fee24c5 admin admin] PATH_INFO: `/v3/projects/f2e34cce13c841e6ba80eb0d37ae74fb/users/ef457d1cfc774d198fa88a236222258c/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:42.125954 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c4cbc-3f05-4d24-9e0b-db667fee24c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e34cce13c841e6ba80eb0d37ae74fb, user_id=ef457d1cfc774d198fa88a236222258c, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:42.128639 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c4cbc-3f05-4d24-9e0b-db667fee24c5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:42.139614 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1403/2785] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:51:42 2022] PUT /identity/v3/projects/f2e34cce13c841e6ba80eb0d37ae74fb/users/ef457d1cfc774d198fa88a236222258c/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:51:42.150690 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7a6da-0483-41d8-b793-927d6d0b1096 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:42.150980 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7a6da-0483-41d8-b793-927d6d0b1096 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:42.151288 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7a6da-0483-41d8-b793-927d6d0b1096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:42.178235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e1b7a6da-0483-41d8-b793-927d6d0b1096 None None] MFA Rules not processed for user `ef457d1cfc774d198fa88a236222258c`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:51:42.179502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e1b7a6da-0483-41d8-b793-927d6d0b1096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:42.245752 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1383/2786] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:51:42.257401 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c4cbc-3f05-4d24-9e0b-db667fee24c5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:42.259222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-445c4cbc-3f05-4d24-9e0b-db667fee24c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:42.316425 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c4cbc-3f05-4d24-9e0b-db667fee24c5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:42.320026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57feb6e-1fbe-453b-b642-a0df8b312192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:42.320790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57feb6e-1fbe-453b-b642-a0df8b312192 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:42.321074 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57feb6e-1fbe-453b-b642-a0df8b312192 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:42.321350 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57feb6e-1fbe-453b-b642-a0df8b312192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:42.330817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57feb6e-1fbe-453b-b642-a0df8b312192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:42.332258 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57feb6e-1fbe-453b-b642-a0df8b312192 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:42.342376 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1404/2787] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:51:42 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:51:42.723581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7a6da-0483-41d8-b793-927d6d0b1096 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:42.734920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:51:42.791245 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7a6da-0483-41d8-b793-927d6d0b1096 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:42.795779 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:42.796641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:42.796921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:42.797191 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] PATH_INFO: `/v3/users/e97f2bac0eec4fe1b6000b7ade4866f7` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:42.798374 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e97f2bac0eec4fe1b6000b7ade4866f7)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:42.800304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:42.846346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97f2bac0eec4fe1b6000b7ade4866f7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:42.846926 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97f2bac0eec4fe1b6000b7ade4866f7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:42.858466 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97f2bac0eec4fe1b6000b7ade4866f7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:42.867348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97f2bac0eec4fe1b6000b7ade4866f7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:42.874791 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97f2bac0eec4fe1b6000b7ade4866f7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:42.880848 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1384/2788] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:51:42 2022] DELETE /identity/v3/users/e97f2bac0eec4fe1b6000b7ade4866f7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:51:42.885580 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09b87d-f705-4a18-baca-0ac6c046756a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:42.886066 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09b87d-f705-4a18-baca-0ac6c046756a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:42.886166 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09b87d-f705-4a18-baca-0ac6c046756a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:42.903940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fd09b87d-f705-4a18-baca-0ac6c046756a None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:51:42.905765 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fd09b87d-f705-4a18-baca-0ac6c046756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:42.963378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1405/2789] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:51:42.973720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:42.975132 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:43.036698 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffcc9b-52e8-4b02-ba2e-ea6da5712b2a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:43.040436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc8eeb-f694-43d7-b30b-03b7233d1eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:43.041085 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc8eeb-f694-43d7-b30b-03b7233d1eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:43.041371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc8eeb-f694-43d7-b30b-03b7233d1eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:43.041651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc8eeb-f694-43d7-b30b-03b7233d1eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:43.053565 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc8eeb-f694-43d7-b30b-03b7233d1eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:43.055004 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc8eeb-f694-43d7-b30b-03b7233d1eb2 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:43.064808 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1385/2790] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:51:43.324932 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09b87d-f705-4a18-baca-0ac6c046756a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:43.326403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fd09b87d-f705-4a18-baca-0ac6c046756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:43.339411 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09b87d-f705-4a18-baca-0ac6c046756a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:43.344470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:43.345427 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:43.345790 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:43.346160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] PATH_INFO: `/v3/projects/d7f509545401429c834a2e9be41b459b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:43.347559 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f509545401429c834a2e9be41b459b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:43.349887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:43.397675 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f509545401429c834a2e9be41b459b', 'request_id': 'req-c87141d8-1553-4262-ad82-c519177fc21e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:43.399520 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:51:43.404231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f509545401429c834a2e9be41b459b', 'request_id': 'req-c87141d8-1553-4262-ad82-c519177fc21e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:43.412674 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f509545401429c834a2e9be41b459b', 'request_id': 'req-c87141d8-1553-4262-ad82-c519177fc21e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:43.423163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] The token cache is being invalidate because project d7f509545401429c834a2e9be41b459b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:51:43.423480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:43.424345 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:43.426216 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1406/2791] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:51:43 2022] DELETE /identity/v3/projects/d7f509545401429c834a2e9be41b459b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:51:43.430968 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc8eeb-f694-43d7-b30b-03b7233d1eb2 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:43.443935 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc8eeb-f694-43d7-b30b-03b7233d1eb2 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:43.473248 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:51:43.503037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d6947-a848-4bf8-b1bb-3482622656a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:43.503945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d6947-a848-4bf8-b1bb-3482622656a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:43.504228 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d6947-a848-4bf8-b1bb-3482622656a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:43.504507 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d6947-a848-4bf8-b1bb-3482622656a1 admin admin] PATH_INFO: `/v3/users/ef457d1cfc774d198fa88a236222258c` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:43.505706 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d6947-a848-4bf8-b1bb-3482622656a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef457d1cfc774d198fa88a236222258c)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:43.507920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d6947-a848-4bf8-b1bb-3482622656a1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:43.554194 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b41d6947-a848-4bf8-b1bb-3482622656a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef457d1cfc774d198fa88a236222258c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:43.554848 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b41d6947-a848-4bf8-b1bb-3482622656a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef457d1cfc774d198fa88a236222258c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:43.566362 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b41d6947-a848-4bf8-b1bb-3482622656a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef457d1cfc774d198fa88a236222258c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:43.573842 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b41d6947-a848-4bf8-b1bb-3482622656a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef457d1cfc774d198fa88a236222258c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:43.581437 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b41d6947-a848-4bf8-b1bb-3482622656a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef457d1cfc774d198fa88a236222258c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:43.591614 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1386/2792] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:51:43 2022] DELETE /identity/v3/users/ef457d1cfc774d198fa88a236222258c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:51:43.863974 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:43.865467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:43.880566 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87141d8-1553-4262-ad82-c519177fc21e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:43.940498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96626e69-e6e5-4830-985a-01565cfde6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:43.941297 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626e69-e6e5-4830-985a-01565cfde6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:43.941582 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626e69-e6e5-4830-985a-01565cfde6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:43.941866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626e69-e6e5-4830-985a-01565cfde6a4 admin admin] PATH_INFO: `/v3/projects/f2e34cce13c841e6ba80eb0d37ae74fb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:43.943033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96626e69-e6e5-4830-985a-01565cfde6a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e34cce13c841e6ba80eb0d37ae74fb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:43.944990 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96626e69-e6e5-4830-985a-01565cfde6a4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:43.990586 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-96626e69-e6e5-4830-985a-01565cfde6a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e34cce13c841e6ba80eb0d37ae74fb', 'request_id': 'req-96626e69-e6e5-4830-985a-01565cfde6a4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:43.996569 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-96626e69-e6e5-4830-985a-01565cfde6a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e34cce13c841e6ba80eb0d37ae74fb', 'request_id': 'req-96626e69-e6e5-4830-985a-01565cfde6a4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:44.004239 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-96626e69-e6e5-4830-985a-01565cfde6a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e34cce13c841e6ba80eb0d37ae74fb', 'request_id': 'req-96626e69-e6e5-4830-985a-01565cfde6a4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:44.014773 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-96626e69-e6e5-4830-985a-01565cfde6a4 admin admin] The token cache is being invalidate because project f2e34cce13c841e6ba80eb0d37ae74fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:51:44.015094 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-96626e69-e6e5-4830-985a-01565cfde6a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:44.015745 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-96626e69-e6e5-4830-985a-01565cfde6a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:51:44.017252 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1407/2793] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:51:43 2022] DELETE /identity/v3/projects/f2e34cce13c841e6ba80eb0d37ae74fb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:51:44.022074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68505c-2894-4fd0-9831-00bcc7506f19 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:44.022547 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68505c-2894-4fd0-9831-00bcc7506f19 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:44.022664 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68505c-2894-4fd0-9831-00bcc7506f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:44.049590 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9c68505c-2894-4fd0-9831-00bcc7506f19 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:51:44.050790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9c68505c-2894-4fd0-9831-00bcc7506f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:44.107522 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1387/2794] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:51:44.116102 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0ea57-36da-4df0-afa1-60449b1e5716 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:44.116486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0ea57-36da-4df0-afa1-60449b1e5716 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:44.116840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0ea57-36da-4df0-afa1-60449b1e5716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:44.135269 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-98c0ea57-36da-4df0-afa1-60449b1e5716 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:51:44.136469 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-98c0ea57-36da-4df0-afa1-60449b1e5716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:44.144363 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1408/2795] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:51:44.148388 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68505c-2894-4fd0-9831-00bcc7506f19 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:44.158600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68505c-2894-4fd0-9831-00bcc7506f19 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:44.163095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84cd50-4514-4944-b372-a2530bcb2440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:44.163765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84cd50-4514-4944-b372-a2530bcb2440 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:44.164048 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84cd50-4514-4944-b372-a2530bcb2440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:44.164324 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84cd50-4514-4944-b372-a2530bcb2440 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:44.165040 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84cd50-4514-4944-b372-a2530bcb2440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:51:44.165348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84cd50-4514-4944-b372-a2530bcb2440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:44.166961 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84cd50-4514-4944-b372-a2530bcb2440 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:44.179112 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1388/2796] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:51:44.183337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0ea57-36da-4df0-afa1-60449b1e5716 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:44.193201 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0ea57-36da-4df0-afa1-60449b1e5716 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:44.197802 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d54096-3bb2-4059-a523-49828ce72969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:44.198450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d54096-3bb2-4059-a523-49828ce72969 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:44.198736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d54096-3bb2-4059-a523-49828ce72969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:44.199016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d54096-3bb2-4059-a523-49828ce72969 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:44.199760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d54096-3bb2-4059-a523-49828ce72969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:44.201661 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d54096-3bb2-4059-a523-49828ce72969 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:44.227094 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1409/2797] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:51:44 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:51:44.231115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84cd50-4514-4944-b372-a2530bcb2440 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:44.241217 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84cd50-4514-4944-b372-a2530bcb2440 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:44.274606 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:51:44.301015 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa3b2a-e11f-4af5-afde-64e4a5a4471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:44.301682 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa3b2a-e11f-4af5-afde-64e4a5a4471f admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:44.301963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa3b2a-e11f-4af5-afde-64e4a5a4471f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:44.302238 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa3b2a-e11f-4af5-afde-64e4a5a4471f admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:44.302936 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa3b2a-e11f-4af5-afde-64e4a5a4471f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:44.304873 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa3b2a-e11f-4af5-afde-64e4a5a4471f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:44.323826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1389/2798] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:51:44 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:51:44.329068 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d54096-3bb2-4059-a523-49828ce72969 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:44.339254 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d54096-3bb2-4059-a523-49828ce72969 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:44.344746 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa4ef1-d8ce-43c1-a975-6d530c18205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:44.345400 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa4ef1-d8ce-43c1-a975-6d530c18205b admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:44.345688 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa4ef1-d8ce-43c1-a975-6d530c18205b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:44.345966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa4ef1-d8ce-43c1-a975-6d530c18205b admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:44.346684 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa4ef1-d8ce-43c1-a975-6d530c18205b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:44.348296 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa4ef1-d8ce-43c1-a975-6d530c18205b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:44.358811 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1410/2799] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:51:44.362681 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa3b2a-e11f-4af5-afde-64e4a5a4471f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:44.372475 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa3b2a-e11f-4af5-afde-64e4a5a4471f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:44.377917 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5327199-64e4-40ba-a493-62381463bcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:44.378604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5327199-64e4-40ba-a493-62381463bcab admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:44.378909 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5327199-64e4-40ba-a493-62381463bcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:44.379235 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5327199-64e4-40ba-a493-62381463bcab admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:44.379964 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5327199-64e4-40ba-a493-62381463bcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:44.381557 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5327199-64e4-40ba-a493-62381463bcab admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:44.392921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1390/2800] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:51:44.396909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa4ef1-d8ce-43c1-a975-6d530c18205b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:44.408418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa4ef1-d8ce-43c1-a975-6d530c18205b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:44.413039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700e3ba-2a80-41b5-b087-0efbea9e5179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:44.413916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700e3ba-2a80-41b5-b087-0efbea9e5179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:44.414198 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700e3ba-2a80-41b5-b087-0efbea9e5179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:44.414476 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700e3ba-2a80-41b5-b087-0efbea9e5179 admin admin] PATH_INFO: `/v3/projects/eecdb611daa944ba9f9e79a092f40691/users/dd4b6c20522942179622071964d20a86/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:44.429129 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700e3ba-2a80-41b5-b087-0efbea9e5179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eecdb611daa944ba9f9e79a092f40691, user_id=dd4b6c20522942179622071964d20a86, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:44.432484 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700e3ba-2a80-41b5-b087-0efbea9e5179 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:44.445375 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1411/2801] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:51:44 2022] PUT /identity/v3/projects/eecdb611daa944ba9f9e79a092f40691/users/dd4b6c20522942179622071964d20a86/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:51:44.450321 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a70e2-ebe8-46aa-ac8f-4bd6ba15816f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:44.450608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a70e2-ebe8-46aa-ac8f-4bd6ba15816f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:44.450883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a70e2-ebe8-46aa-ac8f-4bd6ba15816f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:44.470422 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2e2a70e2-ebe8-46aa-ac8f-4bd6ba15816f None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:51:44.471651 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2e2a70e2-ebe8-46aa-ac8f-4bd6ba15816f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:44.531569 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1391/2802] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:51:44.541184 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700e3ba-2a80-41b5-b087-0efbea9e5179 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:44.542867 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1700e3ba-2a80-41b5-b087-0efbea9e5179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:44.555233 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:51:44.612556 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700e3ba-2a80-41b5-b087-0efbea9e5179 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:44.616299 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed64d2-d2b7-40c4-a1f0-f426e13a8b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:44.616981 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed64d2-d2b7-40c4-a1f0-f426e13a8b31 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:44.617272 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed64d2-d2b7-40c4-a1f0-f426e13a8b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:44.617553 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed64d2-d2b7-40c4-a1f0-f426e13a8b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:44.628113 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed64d2-d2b7-40c4-a1f0-f426e13a8b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:44.629554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed64d2-d2b7-40c4-a1f0-f426e13a8b31 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:44.639407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1412/2803] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:51:45.263516 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee8298-7afa-4086-8bb0-60c194d35b5b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:45.264048 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee8298-7afa-4086-8bb0-60c194d35b5b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:45.264148 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee8298-7afa-4086-8bb0-60c194d35b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:45.290012 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-94ee8298-7afa-4086-8bb0-60c194d35b5b None None] MFA Rules not processed for user `dd4b6c20522942179622071964d20a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:51:45.291268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-94ee8298-7afa-4086-8bb0-60c194d35b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:45.360469 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1392/2804] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:51:45.364846 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed64d2-d2b7-40c4-a1f0-f426e13a8b31 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:45.377757 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed64d2-d2b7-40c4-a1f0-f426e13a8b31 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:45.382840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f50705-61fe-4057-871e-a3f3958e8e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:45.383526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50705-61fe-4057-871e-a3f3958e8e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:45.383805 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50705-61fe-4057-871e-a3f3958e8e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:45.384080 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50705-61fe-4057-871e-a3f3958e8e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:45.384753 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f50705-61fe-4057-871e-a3f3958e8e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:45.386662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f50705-61fe-4057-871e-a3f3958e8e6b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:45.415277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1413/2805] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:51:45 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:51:45.417272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee8298-7afa-4086-8bb0-60c194d35b5b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:45.429989 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee8298-7afa-4086-8bb0-60c194d35b5b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:45.476346 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:51:45.490859 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ba56b-4fb5-4cf8-9b77-4d0a2c998d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:45.491558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba56b-4fb5-4cf8-9b77-4d0a2c998d25 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:45.491845 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba56b-4fb5-4cf8-9b77-4d0a2c998d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:45.492122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba56b-4fb5-4cf8-9b77-4d0a2c998d25 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:45.492807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ba56b-4fb5-4cf8-9b77-4d0a2c998d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:45.494731 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ba56b-4fb5-4cf8-9b77-4d0a2c998d25 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:45.516834 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1393/2806] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:51:45 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:51:45.518025 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f50705-61fe-4057-871e-a3f3958e8e6b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:45.528555 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f50705-61fe-4057-871e-a3f3958e8e6b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:45.533802 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e127102-b225-4379-979f-06d6b862ca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:45.534465 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127102-b225-4379-979f-06d6b862ca41 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:45.534751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127102-b225-4379-979f-06d6b862ca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:45.535032 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127102-b225-4379-979f-06d6b862ca41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:45.535791 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e127102-b225-4379-979f-06d6b862ca41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:45.537394 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e127102-b225-4379-979f-06d6b862ca41 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:45.548797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1414/2807] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:51:45.553089 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ba56b-4fb5-4cf8-9b77-4d0a2c998d25 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:45.563149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ba56b-4fb5-4cf8-9b77-4d0a2c998d25 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:45.567715 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19a0f1-fbda-4870-bb61-61c2639c0e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:45.568583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19a0f1-fbda-4870-bb61-61c2639c0e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:45.568864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19a0f1-fbda-4870-bb61-61c2639c0e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:45.569140 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19a0f1-fbda-4870-bb61-61c2639c0e3e admin admin] PATH_INFO: `/v3/projects/80b5ce345a734b4f9095a80dc144a474/users/f1ff632fbefb44e2adbbd4b279dac646/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:45.583753 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19a0f1-fbda-4870-bb61-61c2639c0e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b5ce345a734b4f9095a80dc144a474, user_id=f1ff632fbefb44e2adbbd4b279dac646, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:45.586446 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19a0f1-fbda-4870-bb61-61c2639c0e3e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:45.602502 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1394/2808] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:51:45 2022] PUT /identity/v3/projects/80b5ce345a734b4f9095a80dc144a474/users/f1ff632fbefb44e2adbbd4b279dac646/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:51:45.606310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e127102-b225-4379-979f-06d6b862ca41 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:45.616598 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e127102-b225-4379-979f-06d6b862ca41 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:45.671890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f33e13-8658-4a6b-b39d-b920879f0d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:45.672477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f33e13-8658-4a6b-b39d-b920879f0d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:45.672762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f33e13-8658-4a6b-b39d-b920879f0d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:45.673039 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f33e13-8658-4a6b-b39d-b920879f0d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:45.673753 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f33e13-8658-4a6b-b39d-b920879f0d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:45.675377 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f33e13-8658-4a6b-b39d-b920879f0d22 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:45.684905 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1415/2809] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:51:45.690027 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19a0f1-fbda-4870-bb61-61c2639c0e3e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:45.700270 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19a0f1-fbda-4870-bb61-61c2639c0e3e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:45.705760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c775bb9-9b56-4b7a-bbc4-632c49047bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:45.706641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c775bb9-9b56-4b7a-bbc4-632c49047bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:45.706935 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c775bb9-9b56-4b7a-bbc4-632c49047bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:45.707275 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c775bb9-9b56-4b7a-bbc4-632c49047bfe admin admin] PATH_INFO: `/v3/projects/80b5ce345a734b4f9095a80dc144a474/users/f1ff632fbefb44e2adbbd4b279dac646/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:45.709246 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c775bb9-9b56-4b7a-bbc4-632c49047bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b5ce345a734b4f9095a80dc144a474, user_id=f1ff632fbefb44e2adbbd4b279dac646, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:45.711921 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c775bb9-9b56-4b7a-bbc4-632c49047bfe admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:45.722883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1395/2810] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:51:45 2022] PUT /identity/v3/projects/80b5ce345a734b4f9095a80dc144a474/users/f1ff632fbefb44e2adbbd4b279dac646/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:51:46.321825 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72691a9-9834-4e3e-b7be-a430e2203dc5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:46.322340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72691a9-9834-4e3e-b7be-a430e2203dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:46.322699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72691a9-9834-4e3e-b7be-a430e2203dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:46.353152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c72691a9-9834-4e3e-b7be-a430e2203dc5 None None] MFA Rules not processed for user `f1ff632fbefb44e2adbbd4b279dac646`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:51:46.354467 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c72691a9-9834-4e3e-b7be-a430e2203dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:46.423054 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:51:46.429906 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1416/2811] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:51:46.441603 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008edc32-69f5-47e0-9c6f-c81ecd536492 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:46.442114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008edc32-69f5-47e0-9c6f-c81ecd536492 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:46.442357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008edc32-69f5-47e0-9c6f-c81ecd536492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:46.460998 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-008edc32-69f5-47e0-9c6f-c81ecd536492 None None] MFA Rules not processed for user `dd4b6c20522942179622071964d20a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:51:46.462336 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-008edc32-69f5-47e0-9c6f-c81ecd536492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:46.519050 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1396/2812] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:51:46.530573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72691a9-9834-4e3e-b7be-a430e2203dc5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:46.532014 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c72691a9-9834-4e3e-b7be-a430e2203dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:46.609492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72691a9-9834-4e3e-b7be-a430e2203dc5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:46.614921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252c6c-958d-4b51-9761-b202f03dd6f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:46.615600 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252c6c-958d-4b51-9761-b202f03dd6f3 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:46.615884 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252c6c-958d-4b51-9761-b202f03dd6f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:46.616160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252c6c-958d-4b51-9761-b202f03dd6f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:46.624662 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e252c6c-958d-4b51-9761-b202f03dd6f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:46.626232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e252c6c-958d-4b51-9761-b202f03dd6f3 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:46.635141 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1417/2813] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:51:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:51:47.157623 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008edc32-69f5-47e0-9c6f-c81ecd536492 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:47.159029 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-008edc32-69f5-47e0-9c6f-c81ecd536492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:47.219925 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008edc32-69f5-47e0-9c6f-c81ecd536492 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:47.223963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4ea45-c15e-45aa-b47d-c23494549ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:47.224612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4ea45-c15e-45aa-b47d-c23494549ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:47.224894 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4ea45-c15e-45aa-b47d-c23494549ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:47.225170 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4ea45-c15e-45aa-b47d-c23494549ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:47.227023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-07f4ea45-c15e-45aa-b47d-c23494549ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:47.241383 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4ea45-c15e-45aa-b47d-c23494549ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:47.242807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4ea45-c15e-45aa-b47d-c23494549ce0 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:47.254315 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1397/2814] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:51:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:51:56.630957 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=35 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:51:57.249384 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:51:58.542464 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252c6c-958d-4b51-9761-b202f03dd6f3 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:51:58.543878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9e252c6c-958d-4b51-9761-b202f03dd6f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:51:58.601854 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252c6c-958d-4b51-9761-b202f03dd6f3 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:51:58.605371 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0bd93-900f-4506-a4d4-423c8d4fffed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:51:58.606021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bd93-900f-4506-a4d4-423c8d4fffed service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:51:58.606307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bd93-900f-4506-a4d4-423c8d4fffed service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:51:58.606584 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bd93-900f-4506-a4d4-423c8d4fffed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:51:58.619459 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0bd93-900f-4506-a4d4-423c8d4fffed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:51:58.621303 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0bd93-900f-4506-a4d4-423c8d4fffed service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:51:58.632355 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1418/2815] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:51:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:52:08.627356 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=26 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:17.971386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4ea45-c15e-45aa-b47d-c23494549ce0 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:18.037061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4ea45-c15e-45aa-b47d-c23494549ce0 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:18.041500 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:18.042372 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:18.042654 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:18.042931 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] PATH_INFO: `/v3/users/dd4b6c20522942179622071964d20a86` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:18.044161 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4b6c20522942179622071964d20a86)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:18.046722 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:18.091688 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4b6c20522942179622071964d20a86'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.092448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4b6c20522942179622071964d20a86'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.103984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4b6c20522942179622071964d20a86'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.111423 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4b6c20522942179622071964d20a86'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.118200 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4b6c20522942179622071964d20a86'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.124610 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1398/2816] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:52:17 2022] DELETE /identity/v3/users/dd4b6c20522942179622071964d20a86 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:18.292820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0bd93-900f-4506-a4d4-423c8d4fffed service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:18.305641 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0bd93-900f-4506-a4d4-423c8d4fffed service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:18.363379 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:18.364200 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:18.364488 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:18.364765 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] PATH_INFO: `/v3/projects/eecdb611daa944ba9f9e79a092f40691` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:18.365940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eecdb611daa944ba9f9e79a092f40691)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:18.367966 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:18.413893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eecdb611daa944ba9f9e79a092f40691', 'request_id': 'req-bd587a07-5923-4743-8fd5-a0e8c2816642'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.420428 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eecdb611daa944ba9f9e79a092f40691', 'request_id': 'req-bd587a07-5923-4743-8fd5-a0e8c2816642'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.427813 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eecdb611daa944ba9f9e79a092f40691', 'request_id': 'req-bd587a07-5923-4743-8fd5-a0e8c2816642'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.439237 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] The token cache is being invalidate because project eecdb611daa944ba9f9e79a092f40691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:52:18.439521 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.440148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.441775 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1419/2817] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:52:18 2022] DELETE /identity/v3/projects/eecdb611daa944ba9f9e79a092f40691 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:18.445819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:18.447370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:18.460665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2346be-e5e8-4910-8807-66d215c249d3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:18.516405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b55d6-50a6-41b3-af83-1cff7a52fc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:18.517268 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b55d6-50a6-41b3-af83-1cff7a52fc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:18.517550 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b55d6-50a6-41b3-af83-1cff7a52fc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:18.517824 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b55d6-50a6-41b3-af83-1cff7a52fc14 admin admin] PATH_INFO: `/v3/users/f1ff632fbefb44e2adbbd4b279dac646` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:18.519016 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b55d6-50a6-41b3-af83-1cff7a52fc14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1ff632fbefb44e2adbbd4b279dac646)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:18.520978 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b55d6-50a6-41b3-af83-1cff7a52fc14 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:18.543022 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:18.568718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-399b55d6-50a6-41b3-af83-1cff7a52fc14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1ff632fbefb44e2adbbd4b279dac646'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.569365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-399b55d6-50a6-41b3-af83-1cff7a52fc14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1ff632fbefb44e2adbbd4b279dac646'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.580958 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-399b55d6-50a6-41b3-af83-1cff7a52fc14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1ff632fbefb44e2adbbd4b279dac646'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.592408 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-399b55d6-50a6-41b3-af83-1cff7a52fc14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1ff632fbefb44e2adbbd4b279dac646'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.599547 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-399b55d6-50a6-41b3-af83-1cff7a52fc14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1ff632fbefb44e2adbbd4b279dac646'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.605356 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1399/2818] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:52:18 2022] DELETE /identity/v3/users/f1ff632fbefb44e2adbbd4b279dac646 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:18.786013 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:18.787642 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:18.802061 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd587a07-5923-4743-8fd5-a0e8c2816642 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:18.860501 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:18.861363 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:18.861655 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:18.861938 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e admin admin] PATH_INFO: `/v3/projects/80b5ce345a734b4f9095a80dc144a474` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:18.863121 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b5ce345a734b4f9095a80dc144a474)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:18.865072 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:18.899676 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:18.914137 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b5ce345a734b4f9095a80dc144a474', 'request_id': 'req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.921152 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b5ce345a734b4f9095a80dc144a474', 'request_id': 'req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.927834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b5ce345a734b4f9095a80dc144a474', 'request_id': 'req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.939307 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e admin admin] The token cache is being invalidate because project 80b5ce345a734b4f9095a80dc144a474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:52:18.939610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.940223 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d0c4b7c7-2dcc-4411-b368-af42ca0f442e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:18.941753 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1420/2819] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:52:18 2022] DELETE /identity/v3/projects/80b5ce345a734b4f9095a80dc144a474 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:18.946614 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb94ff-f565-40de-8263-157b7ddbfc31 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:18.946920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb94ff-f565-40de-8263-157b7ddbfc31 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:18.947221 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb94ff-f565-40de-8263-157b7ddbfc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:18.965450 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-77cb94ff-f565-40de-8263-157b7ddbfc31 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:18.967279 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-77cb94ff-f565-40de-8263-157b7ddbfc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:19.032189 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1400/2820] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:19.040770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bce6e-a8cc-4821-98dc-54cd17fed1ec None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.041059 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bce6e-a8cc-4821-98dc-54cd17fed1ec None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.041340 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bce6e-a8cc-4821-98dc-54cd17fed1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.059648 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ba6bce6e-a8cc-4821-98dc-54cd17fed1ec None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:19.061461 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ba6bce6e-a8cc-4821-98dc-54cd17fed1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:19.069275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1421/2821] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:19.073345 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb94ff-f565-40de-8263-157b7ddbfc31 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:19.083043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb94ff-f565-40de-8263-157b7ddbfc31 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:19.087844 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9906b-834a-4946-b842-b439afcc58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:19.088488 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9906b-834a-4946-b842-b439afcc58b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.088769 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9906b-834a-4946-b842-b439afcc58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.089043 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9906b-834a-4946-b842-b439afcc58b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.089760 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9906b-834a-4946-b842-b439afcc58b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:52:19.090063 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9906b-834a-4946-b842-b439afcc58b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:19.092191 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9906b-834a-4946-b842-b439afcc58b8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:19.104249 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1401/2822] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 20:52:19.109073 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bce6e-a8cc-4821-98dc-54cd17fed1ec None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:19.118009 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bce6e-a8cc-4821-98dc-54cd17fed1ec None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:19.123435 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded81d8-8845-4add-87c5-83cc9ce2805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:19.124083 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded81d8-8845-4add-87c5-83cc9ce2805e admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.124364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded81d8-8845-4add-87c5-83cc9ce2805e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.124635 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded81d8-8845-4add-87c5-83cc9ce2805e admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.125317 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded81d8-8845-4add-87c5-83cc9ce2805e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:19.127212 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded81d8-8845-4add-87c5-83cc9ce2805e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:19.152447 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1422/2823] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:52:19 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:52:19.156657 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9906b-834a-4946-b842-b439afcc58b8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:19.167401 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9906b-834a-4946-b842-b439afcc58b8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:19.224386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c595c5-ef51-4062-b6d2-eb22aaa113c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:19.225053 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c595c5-ef51-4062-b6d2-eb22aaa113c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.225339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c595c5-ef51-4062-b6d2-eb22aaa113c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.225618 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c595c5-ef51-4062-b6d2-eb22aaa113c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.226310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c595c5-ef51-4062-b6d2-eb22aaa113c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:19.228261 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c595c5-ef51-4062-b6d2-eb22aaa113c2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:19.247582 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1402/2824] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:52:19 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:52:19.252780 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded81d8-8845-4add-87c5-83cc9ce2805e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:19.264005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded81d8-8845-4add-87c5-83cc9ce2805e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:19.268645 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21783c68-82f3-4b06-bd83-c18c743e0d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:19.269310 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21783c68-82f3-4b06-bd83-c18c743e0d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.269597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21783c68-82f3-4b06-bd83-c18c743e0d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.269893 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21783c68-82f3-4b06-bd83-c18c743e0d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.270627 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21783c68-82f3-4b06-bd83-c18c743e0d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:19.272283 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21783c68-82f3-4b06-bd83-c18c743e0d8f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:19.288052 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1423/2825] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:52:19.289632 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c595c5-ef51-4062-b6d2-eb22aaa113c2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:19.301129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c595c5-ef51-4062-b6d2-eb22aaa113c2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:19.306392 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f5659-f5ba-491a-8d96-0a35f1659a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:19.307082 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f5659-f5ba-491a-8d96-0a35f1659a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.307408 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f5659-f5ba-491a-8d96-0a35f1659a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.307686 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f5659-f5ba-491a-8d96-0a35f1659a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.308430 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f5659-f5ba-491a-8d96-0a35f1659a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:19.310074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f5659-f5ba-491a-8d96-0a35f1659a92 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:19.325546 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1403/2826] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:52:19.327643 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21783c68-82f3-4b06-bd83-c18c743e0d8f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:19.338509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21783c68-82f3-4b06-bd83-c18c743e0d8f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:19.343403 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be4f14-2387-4f5a-a245-e0c30f624519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:19.344324 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be4f14-2387-4f5a-a245-e0c30f624519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.344610 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be4f14-2387-4f5a-a245-e0c30f624519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.344887 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be4f14-2387-4f5a-a245-e0c30f624519 admin admin] PATH_INFO: `/v3/projects/c5a9c8041a434e8ab93c2c872e740a02/users/49b430c4a18345e3bc8da47e101816dc/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.361086 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be4f14-2387-4f5a-a245-e0c30f624519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a9c8041a434e8ab93c2c872e740a02, user_id=49b430c4a18345e3bc8da47e101816dc, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:19.363861 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be4f14-2387-4f5a-a245-e0c30f624519 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:19.379800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1424/2827] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:52:19 2022] PUT /identity/v3/projects/c5a9c8041a434e8ab93c2c872e740a02/users/49b430c4a18345e3bc8da47e101816dc/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:52:19.390971 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148b5e-ec91-4818-8b08-08d000bff060 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.391218 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148b5e-ec91-4818-8b08-08d000bff060 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.391492 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148b5e-ec91-4818-8b08-08d000bff060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.398357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:19.420911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d0148b5e-ec91-4818-8b08-08d000bff060 None None] MFA Rules not processed for user `49b430c4a18345e3bc8da47e101816dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:19.422047 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d0148b5e-ec91-4818-8b08-08d000bff060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:19.488604 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1404/2828] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:19.492779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be4f14-2387-4f5a-a245-e0c30f624519 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:19.553100 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be4f14-2387-4f5a-a245-e0c30f624519 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:19.557816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481337a-2b37-47c1-a7b9-55a8f5316119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:19.558450 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481337a-2b37-47c1-a7b9-55a8f5316119 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.558735 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481337a-2b37-47c1-a7b9-55a8f5316119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.559021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481337a-2b37-47c1-a7b9-55a8f5316119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.559731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481337a-2b37-47c1-a7b9-55a8f5316119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:19.562332 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481337a-2b37-47c1-a7b9-55a8f5316119 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:19.586908 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1425/2829] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:52:19 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:52:19.590871 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0148b5e-ec91-4818-8b08-08d000bff060 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:19.602149 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0148b5e-ec91-4818-8b08-08d000bff060 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:19.660520 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499583f-abb8-4465-862b-5194edec273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:19.661217 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499583f-abb8-4465-862b-5194edec273c admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.661499 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499583f-abb8-4465-862b-5194edec273c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.661777 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499583f-abb8-4465-862b-5194edec273c admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.662472 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499583f-abb8-4465-862b-5194edec273c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:19.664408 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499583f-abb8-4465-862b-5194edec273c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:19.684226 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1405/2830] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:52:19 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:52:19.688670 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481337a-2b37-47c1-a7b9-55a8f5316119 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:19.698840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481337a-2b37-47c1-a7b9-55a8f5316119 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:19.703895 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7f5aa-8bd2-48a0-ad2b-5289d53144a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:19.704554 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7f5aa-8bd2-48a0-ad2b-5289d53144a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.704842 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7f5aa-8bd2-48a0-ad2b-5289d53144a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.705125 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7f5aa-8bd2-48a0-ad2b-5289d53144a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.705845 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7f5aa-8bd2-48a0-ad2b-5289d53144a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:19.707496 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7f5aa-8bd2-48a0-ad2b-5289d53144a3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:19.719079 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1426/2831] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:52:19.723061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499583f-abb8-4465-862b-5194edec273c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:19.733645 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499583f-abb8-4465-862b-5194edec273c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:19.738241 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac4f8a-f587-430b-b8f5-f74d3c1ffde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:19.739107 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac4f8a-f587-430b-b8f5-f74d3c1ffde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.739425 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac4f8a-f587-430b-b8f5-f74d3c1ffde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.739735 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac4f8a-f587-430b-b8f5-f74d3c1ffde6 admin admin] PATH_INFO: `/v3/projects/9f3124b7812e4b1bb392276970bf3743/users/cd561772239f42c1b8f5bef67380fdf2/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.754708 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac4f8a-f587-430b-b8f5-f74d3c1ffde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3124b7812e4b1bb392276970bf3743, user_id=cd561772239f42c1b8f5bef67380fdf2, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:19.757635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac4f8a-f587-430b-b8f5-f74d3c1ffde6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:19.770920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1406/2832] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:52:19 2022] PUT /identity/v3/projects/9f3124b7812e4b1bb392276970bf3743/users/cd561772239f42c1b8f5bef67380fdf2/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:52:19.774760 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7f5aa-8bd2-48a0-ad2b-5289d53144a3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:19.784688 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7f5aa-8bd2-48a0-ad2b-5289d53144a3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:19.814211 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:19.843764 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3c360-8cf7-416c-82e5-c9f86ef1ed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:19.844432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3c360-8cf7-416c-82e5-c9f86ef1ed6d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.844717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3c360-8cf7-416c-82e5-c9f86ef1ed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.844995 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3c360-8cf7-416c-82e5-c9f86ef1ed6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.845711 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3c360-8cf7-416c-82e5-c9f86ef1ed6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:19.847336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3c360-8cf7-416c-82e5-c9f86ef1ed6d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:19.856837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1427/2833] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:52:19.861440 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac4f8a-f587-430b-b8f5-f74d3c1ffde6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:19.871744 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac4f8a-f587-430b-b8f5-f74d3c1ffde6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:19.876988 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08518d6-d2a1-4026-b8f5-790702920700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:19.877856 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08518d6-d2a1-4026-b8f5-790702920700 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.878141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08518d6-d2a1-4026-b8f5-790702920700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.878418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08518d6-d2a1-4026-b8f5-790702920700 admin admin] PATH_INFO: `/v3/projects/9f3124b7812e4b1bb392276970bf3743/users/cd561772239f42c1b8f5bef67380fdf2/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.880658 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08518d6-d2a1-4026-b8f5-790702920700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3124b7812e4b1bb392276970bf3743, user_id=cd561772239f42c1b8f5bef67380fdf2, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:19.883289 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08518d6-d2a1-4026-b8f5-790702920700 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:19.893693 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1407/2834] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:52:19 2022] PUT /identity/v3/projects/9f3124b7812e4b1bb392276970bf3743/users/cd561772239f42c1b8f5bef67380fdf2/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:19.903626 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b55e3-2bec-4004-ad5c-331cc1d56bc7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:19.904514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b55e3-2bec-4004-ad5c-331cc1d56bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:19.904925 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b55e3-2bec-4004-ad5c-331cc1d56bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:19.931694 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7b8b55e3-2bec-4004-ad5c-331cc1d56bc7 None None] MFA Rules not processed for user `cd561772239f42c1b8f5bef67380fdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:19.932948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7b8b55e3-2bec-4004-ad5c-331cc1d56bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:19.999624 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1428/2835] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:20.010317 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08518d6-d2a1-4026-b8f5-790702920700 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:20.012074 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f08518d6-d2a1-4026-b8f5-790702920700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:20.063386 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:20.068370 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08518d6-d2a1-4026-b8f5-790702920700 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:20.072788 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02cf4f-07b4-4fe7-9740-d97484173c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:20.073455 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02cf4f-07b4-4fe7-9740-d97484173c7d service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:20.073743 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02cf4f-07b4-4fe7-9740-d97484173c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:20.074143 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02cf4f-07b4-4fe7-9740-d97484173c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:20.130209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02cf4f-07b4-4fe7-9740-d97484173c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:20.131922 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02cf4f-07b4-4fe7-9740-d97484173c7d service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:20.141440 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1408/2836] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:52:22.666619 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b55e3-2bec-4004-ad5c-331cc1d56bc7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:22.731611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b55e3-2bec-4004-ad5c-331cc1d56bc7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:22.737265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:22.738133 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:22.738418 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:22.738699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] PATH_INFO: `/v3/users/49b430c4a18345e3bc8da47e101816dc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:22.739909 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b430c4a18345e3bc8da47e101816dc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:22.741866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:22.790023 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b430c4a18345e3bc8da47e101816dc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:22.797673 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b430c4a18345e3bc8da47e101816dc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:22.798935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:22.805408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b430c4a18345e3bc8da47e101816dc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:22.806336 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b430c4a18345e3bc8da47e101816dc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:22.819420 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b430c4a18345e3bc8da47e101816dc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:22.825724 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1429/2837] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:52:22 2022] DELETE /identity/v3/users/49b430c4a18345e3bc8da47e101816dc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:22.830792 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a3819-e9f4-4d2d-807e-eb4309eefe9d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:22.831299 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a3819-e9f4-4d2d-807e-eb4309eefe9d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:22.831409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a3819-e9f4-4d2d-807e-eb4309eefe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:22.848204 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8a3a3819-e9f4-4d2d-807e-eb4309eefe9d None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:22.849335 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8a3a3819-e9f4-4d2d-807e-eb4309eefe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:22.908381 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1409/2838] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:22.918098 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:22.919526 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:22.978958 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5e1dd-2e77-49d8-8017-e40b156bea69 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:22.982649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4818f9c-9742-4157-a2d5-6f9c42f4eae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:22.983329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4818f9c-9742-4157-a2d5-6f9c42f4eae9 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:22.984232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4818f9c-9742-4157-a2d5-6f9c42f4eae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:22.984716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4818f9c-9742-4157-a2d5-6f9c42f4eae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:22.993781 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4818f9c-9742-4157-a2d5-6f9c42f4eae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:22.995240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4818f9c-9742-4157-a2d5-6f9c42f4eae9 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:23.004903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1430/2839] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:52:23.269995 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a3819-e9f4-4d2d-807e-eb4309eefe9d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:23.271462 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8a3a3819-e9f4-4d2d-807e-eb4309eefe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:23.284879 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a3819-e9f4-4d2d-807e-eb4309eefe9d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:23.289619 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:23.290773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:23.291065 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:23.291377 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] PATH_INFO: `/v3/projects/c5a9c8041a434e8ab93c2c872e740a02` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:23.292571 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a9c8041a434e8ab93c2c872e740a02)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:23.294588 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:23.341322 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a9c8041a434e8ab93c2c872e740a02', 'request_id': 'req-fc1a149f-786a-4fd2-ae14-5333c844fb24'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.348639 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a9c8041a434e8ab93c2c872e740a02', 'request_id': 'req-fc1a149f-786a-4fd2-ae14-5333c844fb24'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.354152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a9c8041a434e8ab93c2c872e740a02', 'request_id': 'req-fc1a149f-786a-4fd2-ae14-5333c844fb24'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.366114 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] The token cache is being invalidate because project c5a9c8041a434e8ab93c2c872e740a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:52:23.366399 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.367020 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.368723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1410/2840] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:52:23 2022] DELETE /identity/v3/projects/c5a9c8041a434e8ab93c2c872e740a02 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:23.372899 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4818f9c-9742-4157-a2d5-6f9c42f4eae9 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:23.383348 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4818f9c-9742-4157-a2d5-6f9c42f4eae9 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:23.439118 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8e5a0-0b33-43a2-a4ba-2e4ed5d2faf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:23.439951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8e5a0-0b33-43a2-a4ba-2e4ed5d2faf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:23.440232 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8e5a0-0b33-43a2-a4ba-2e4ed5d2faf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:23.440870 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8e5a0-0b33-43a2-a4ba-2e4ed5d2faf5 admin admin] PATH_INFO: `/v3/users/cd561772239f42c1b8f5bef67380fdf2` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:23.442074 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8e5a0-0b33-43a2-a4ba-2e4ed5d2faf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd561772239f42c1b8f5bef67380fdf2)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:23.444019 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8e5a0-0b33-43a2-a4ba-2e4ed5d2faf5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:23.488568 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-87f8e5a0-0b33-43a2-a4ba-2e4ed5d2faf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd561772239f42c1b8f5bef67380fdf2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.495487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-87f8e5a0-0b33-43a2-a4ba-2e4ed5d2faf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd561772239f42c1b8f5bef67380fdf2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.503087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-87f8e5a0-0b33-43a2-a4ba-2e4ed5d2faf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd561772239f42c1b8f5bef67380fdf2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.503736 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-87f8e5a0-0b33-43a2-a4ba-2e4ed5d2faf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd561772239f42c1b8f5bef67380fdf2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.513817 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:23.516255 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-87f8e5a0-0b33-43a2-a4ba-2e4ed5d2faf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd561772239f42c1b8f5bef67380fdf2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.524228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1431/2841] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:52:23 2022] DELETE /identity/v3/users/cd561772239f42c1b8f5bef67380fdf2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:23.790122 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:23.791663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:23.807883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a149f-786a-4fd2-ae14-5333c844fb24 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:23.827987 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:23.867600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75174077-0e2b-4850-a912-029bb145f3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:23.868488 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75174077-0e2b-4850-a912-029bb145f3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:23.868768 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75174077-0e2b-4850-a912-029bb145f3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:23.869041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75174077-0e2b-4850-a912-029bb145f3b4 admin admin] PATH_INFO: `/v3/projects/9f3124b7812e4b1bb392276970bf3743` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:23.870237 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75174077-0e2b-4850-a912-029bb145f3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3124b7812e4b1bb392276970bf3743)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:23.872212 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75174077-0e2b-4850-a912-029bb145f3b4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:23.919183 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-75174077-0e2b-4850-a912-029bb145f3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3124b7812e4b1bb392276970bf3743', 'request_id': 'req-75174077-0e2b-4850-a912-029bb145f3b4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.927737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-75174077-0e2b-4850-a912-029bb145f3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3124b7812e4b1bb392276970bf3743', 'request_id': 'req-75174077-0e2b-4850-a912-029bb145f3b4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.933227 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-75174077-0e2b-4850-a912-029bb145f3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3124b7812e4b1bb392276970bf3743', 'request_id': 'req-75174077-0e2b-4850-a912-029bb145f3b4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.944203 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-75174077-0e2b-4850-a912-029bb145f3b4 admin admin] The token cache is being invalidate because project 9f3124b7812e4b1bb392276970bf3743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:52:23.944489 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-75174077-0e2b-4850-a912-029bb145f3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.945120 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-75174077-0e2b-4850-a912-029bb145f3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:23.946635 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1411/2842] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:52:23 2022] DELETE /identity/v3/projects/9f3124b7812e4b1bb392276970bf3743 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:23.951840 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b4fc9-fa4e-4e81-9dd3-68037b2b9054 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:23.952291 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b4fc9-fa4e-4e81-9dd3-68037b2b9054 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:23.952408 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b4fc9-fa4e-4e81-9dd3-68037b2b9054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:23.971562 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b16b4fc9-fa4e-4e81-9dd3-68037b2b9054 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:23.972723 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b16b4fc9-fa4e-4e81-9dd3-68037b2b9054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:24.029470 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1432/2843] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:24.091086 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127b485-089d-473e-9836-bede1f8378d7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:24.091396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127b485-089d-473e-9836-bede1f8378d7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:24.091673 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127b485-089d-473e-9836-bede1f8378d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:24.111129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4127b485-089d-473e-9836-bede1f8378d7 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:24.112352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4127b485-089d-473e-9836-bede1f8378d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:24.120501 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1412/2844] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:24.124240 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b4fc9-fa4e-4e81-9dd3-68037b2b9054 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:24.135402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b4fc9-fa4e-4e81-9dd3-68037b2b9054 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:24.140001 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf78ae-a4ef-41a9-add1-85dea4a9e4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:24.140723 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf78ae-a4ef-41a9-add1-85dea4a9e4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:24.141069 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf78ae-a4ef-41a9-add1-85dea4a9e4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:24.141350 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf78ae-a4ef-41a9-add1-85dea4a9e4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:24.142079 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf78ae-a4ef-41a9-add1-85dea4a9e4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:52:24.142391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf78ae-a4ef-41a9-add1-85dea4a9e4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:24.144057 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf78ae-a4ef-41a9-add1-85dea4a9e4d6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:24.155649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1433/2845] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:52:24.159755 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127b485-089d-473e-9836-bede1f8378d7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:24.168957 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127b485-089d-473e-9836-bede1f8378d7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:24.174600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf59769-50e2-4098-9151-f91d3cc0cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:24.175273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59769-50e2-4098-9151-f91d3cc0cfcf admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:24.175580 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59769-50e2-4098-9151-f91d3cc0cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:24.175857 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59769-50e2-4098-9151-f91d3cc0cfcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:24.176534 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf59769-50e2-4098-9151-f91d3cc0cfcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:24.178396 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf59769-50e2-4098-9151-f91d3cc0cfcf admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:24.203500 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1413/2846] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:52:24 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:52:24.207722 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf78ae-a4ef-41a9-add1-85dea4a9e4d6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:24.217598 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf78ae-a4ef-41a9-add1-85dea4a9e4d6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:24.275488 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b4f0c-4f7a-4f07-8b2d-e98bd888464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:24.276108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b4f0c-4f7a-4f07-8b2d-e98bd888464b admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:24.276432 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b4f0c-4f7a-4f07-8b2d-e98bd888464b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:24.276710 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b4f0c-4f7a-4f07-8b2d-e98bd888464b admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:24.277414 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b4f0c-4f7a-4f07-8b2d-e98bd888464b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:24.279353 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b4f0c-4f7a-4f07-8b2d-e98bd888464b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:24.299731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1434/2847] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:52:24 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:52:24.303737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf59769-50e2-4098-9151-f91d3cc0cfcf admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:24.313798 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf59769-50e2-4098-9151-f91d3cc0cfcf admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:24.318300 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a01307-5163-4fdf-8deb-ae8ee002755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:24.318947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a01307-5163-4fdf-8deb-ae8ee002755f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:24.319331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a01307-5163-4fdf-8deb-ae8ee002755f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:24.319609 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a01307-5163-4fdf-8deb-ae8ee002755f admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:24.320319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a01307-5163-4fdf-8deb-ae8ee002755f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:24.321887 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a01307-5163-4fdf-8deb-ae8ee002755f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:24.332144 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1414/2848] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:52:24.335916 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b4f0c-4f7a-4f07-8b2d-e98bd888464b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:24.346800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b4f0c-4f7a-4f07-8b2d-e98bd888464b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:24.351535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e949f-8bff-4cad-8ebc-b0930951b354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:24.352195 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e949f-8bff-4cad-8ebc-b0930951b354 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:24.352481 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e949f-8bff-4cad-8ebc-b0930951b354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:24.352762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e949f-8bff-4cad-8ebc-b0930951b354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:24.353485 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e949f-8bff-4cad-8ebc-b0930951b354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:24.355075 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e949f-8bff-4cad-8ebc-b0930951b354 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:24.367222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1435/2849] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:52:24.371357 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a01307-5163-4fdf-8deb-ae8ee002755f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:24.381454 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a01307-5163-4fdf-8deb-ae8ee002755f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:24.386135 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113dda9-15e1-4211-8f68-d33f86728818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:24.387044 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113dda9-15e1-4211-8f68-d33f86728818 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:24.387371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113dda9-15e1-4211-8f68-d33f86728818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:24.387650 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113dda9-15e1-4211-8f68-d33f86728818 admin admin] PATH_INFO: `/v3/projects/535343070a2c448bbbc93795b3520a9b/users/61362b0164374666b47be870a69455f0/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:24.401774 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113dda9-15e1-4211-8f68-d33f86728818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535343070a2c448bbbc93795b3520a9b, user_id=61362b0164374666b47be870a69455f0, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:24.404420 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113dda9-15e1-4211-8f68-d33f86728818 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:24.417168 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1415/2850] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:52:24 2022] PUT /identity/v3/projects/535343070a2c448bbbc93795b3520a9b/users/61362b0164374666b47be870a69455f0/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:24.427437 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39489f4-9179-4e34-9857-38dd97ae5bdf None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:24.427782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39489f4-9179-4e34-9857-38dd97ae5bdf None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:24.428063 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39489f4-9179-4e34-9857-38dd97ae5bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:24.456012 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d39489f4-9179-4e34-9857-38dd97ae5bdf None None] MFA Rules not processed for user `61362b0164374666b47be870a69455f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:24.457210 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d39489f4-9179-4e34-9857-38dd97ae5bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:24.503904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:24.522820 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1436/2851] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:24.534464 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113dda9-15e1-4211-8f68-d33f86728818 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:24.536171 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a113dda9-15e1-4211-8f68-d33f86728818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:24.600991 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113dda9-15e1-4211-8f68-d33f86728818 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:24.604645 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5852b8c-92da-49e2-9d7a-2b1459c7fd77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:24.605297 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5852b8c-92da-49e2-9d7a-2b1459c7fd77 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:24.605581 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5852b8c-92da-49e2-9d7a-2b1459c7fd77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:24.605858 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5852b8c-92da-49e2-9d7a-2b1459c7fd77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:24.611314 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:24.616052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5852b8c-92da-49e2-9d7a-2b1459c7fd77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:24.618098 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5852b8c-92da-49e2-9d7a-2b1459c7fd77 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:24.627738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1416/2852] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:52:34.519946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:34.623250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:35.951402 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39489f4-9179-4e34-9857-38dd97ae5bdf None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:36.012005 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39489f4-9179-4e34-9857-38dd97ae5bdf None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:36.017085 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:36.017942 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:36.018222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:36.018492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] PATH_INFO: `/v3/users/61362b0164374666b47be870a69455f0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:36.019687 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=61362b0164374666b47be870a69455f0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:36.021592 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:36.067910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61362b0164374666b47be870a69455f0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:36.074672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61362b0164374666b47be870a69455f0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:36.082321 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61362b0164374666b47be870a69455f0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:36.082890 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61362b0164374666b47be870a69455f0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:36.095342 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61362b0164374666b47be870a69455f0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:36.101228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1437/2853] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:52:35 2022] DELETE /identity/v3/users/61362b0164374666b47be870a69455f0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:36.105720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff4a2-a2a9-42d0-9615-53344f5e30a0 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:36.106214 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff4a2-a2a9-42d0-9615-53344f5e30a0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:36.106316 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff4a2-a2a9-42d0-9615-53344f5e30a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:36.122773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-be5ff4a2-a2a9-42d0-9615-53344f5e30a0 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:36.124013 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-be5ff4a2-a2a9-42d0-9615-53344f5e30a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:36.185972 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1417/2854] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:36.195940 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:36.197392 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:36.254573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675222a4-64c5-44fe-851a-393c5ced4b6d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:36.258530 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ff11b-a6c5-44ff-aa09-fcce51122f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:36.259191 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ff11b-a6c5-44ff-aa09-fcce51122f8f service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:36.259486 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ff11b-a6c5-44ff-aa09-fcce51122f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:36.259763 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ff11b-a6c5-44ff-aa09-fcce51122f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:36.269378 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ff11b-a6c5-44ff-aa09-fcce51122f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:36.270804 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ff11b-a6c5-44ff-aa09-fcce51122f8f service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:36.280143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1438/2855] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:52:36.551587 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ff4a2-a2a9-42d0-9615-53344f5e30a0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:36.553280 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-be5ff4a2-a2a9-42d0-9615-53344f5e30a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:36.565870 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ff4a2-a2a9-42d0-9615-53344f5e30a0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:36.571402 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:36.572265 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:36.572578 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:36.572854 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1 admin admin] PATH_INFO: `/v3/projects/535343070a2c448bbbc93795b3520a9b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:36.574045 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=535343070a2c448bbbc93795b3520a9b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:36.576782 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:36.629100 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535343070a2c448bbbc93795b3520a9b', 'request_id': 'req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:36.636303 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535343070a2c448bbbc93795b3520a9b', 'request_id': 'req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:36.641929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535343070a2c448bbbc93795b3520a9b', 'request_id': 'req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:36.652585 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1 admin admin] The token cache is being invalidate because project 535343070a2c448bbbc93795b3520a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:52:36.652855 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:36.653474 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f9be3ac7-9403-4318-8a50-3fbd519d3aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:36.655208 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1418/2856] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:52:36 2022] DELETE /identity/v3/projects/535343070a2c448bbbc93795b3520a9b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:36.659921 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f282c-8338-4e2d-8f1d-f5f10b33e3b8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:36.660214 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f282c-8338-4e2d-8f1d-f5f10b33e3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:36.660492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f282c-8338-4e2d-8f1d-f5f10b33e3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:36.678139 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-347f282c-8338-4e2d-8f1d-f5f10b33e3b8 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:36.679411 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-347f282c-8338-4e2d-8f1d-f5f10b33e3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:36.701514 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:36.746677 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1439/2857] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:36.756991 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac75bf-d1c0-45e3-a324-0130ca7b43e6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:36.757279 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac75bf-d1c0-45e3-a324-0130ca7b43e6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:36.757558 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac75bf-d1c0-45e3-a324-0130ca7b43e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:36.776041 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1cac75bf-d1c0-45e3-a324-0130ca7b43e6 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:36.777254 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1cac75bf-d1c0-45e3-a324-0130ca7b43e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:36.785285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1419/2858] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:36.789532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f282c-8338-4e2d-8f1d-f5f10b33e3b8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:36.800033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f282c-8338-4e2d-8f1d-f5f10b33e3b8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:36.804611 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2489bf-c19d-4d08-9eb9-5234f2ef3126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:36.805288 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2489bf-c19d-4d08-9eb9-5234f2ef3126 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:36.805551 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2489bf-c19d-4d08-9eb9-5234f2ef3126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:36.805824 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2489bf-c19d-4d08-9eb9-5234f2ef3126 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:36.806544 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2489bf-c19d-4d08-9eb9-5234f2ef3126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:52:36.806856 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2489bf-c19d-4d08-9eb9-5234f2ef3126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:36.808487 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2489bf-c19d-4d08-9eb9-5234f2ef3126 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:36.821424 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1440/2859] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:52:36.825293 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac75bf-d1c0-45e3-a324-0130ca7b43e6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:36.834477 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac75bf-d1c0-45e3-a324-0130ca7b43e6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:36.839096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0d562-2c6c-42bb-a731-578ae0017410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:36.839771 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0d562-2c6c-42bb-a731-578ae0017410 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:36.840052 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0d562-2c6c-42bb-a731-578ae0017410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:36.840339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0d562-2c6c-42bb-a731-578ae0017410 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:36.841061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0d562-2c6c-42bb-a731-578ae0017410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:36.843029 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0d562-2c6c-42bb-a731-578ae0017410 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:36.869667 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1420/2860] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:52:36 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:52:36.873789 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2489bf-c19d-4d08-9eb9-5234f2ef3126 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:36.884834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2489bf-c19d-4d08-9eb9-5234f2ef3126 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:36.940563 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a984-bced-4e45-ace2-896b4d51ce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:36.941291 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a984-bced-4e45-ace2-896b4d51ce41 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:36.941690 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a984-bced-4e45-ace2-896b4d51ce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:36.941983 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a984-bced-4e45-ace2-896b4d51ce41 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:36.942707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852a984-bced-4e45-ace2-896b4d51ce41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:36.944650 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852a984-bced-4e45-ace2-896b4d51ce41 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:36.965955 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1441/2861] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:52:36 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:52:36.970106 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0d562-2c6c-42bb-a731-578ae0017410 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:36.980384 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0d562-2c6c-42bb-a731-578ae0017410 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:36.985789 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f84c3-c680-4219-a1ce-5b1ddd3a7dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:36.986439 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f84c3-c680-4219-a1ce-5b1ddd3a7dda admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:36.986722 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f84c3-c680-4219-a1ce-5b1ddd3a7dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:36.987019 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f84c3-c680-4219-a1ce-5b1ddd3a7dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:36.987765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f84c3-c680-4219-a1ce-5b1ddd3a7dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:36.989354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f84c3-c680-4219-a1ce-5b1ddd3a7dda admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:36.999895 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1421/2862] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:52:37.003744 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a984-bced-4e45-ace2-896b4d51ce41 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:37.013899 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a984-bced-4e45-ace2-896b4d51ce41 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:37.019555 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136b8a8-d367-4f66-a516-425a80687743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:37.020214 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b8a8-d367-4f66-a516-425a80687743 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.020505 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b8a8-d367-4f66-a516-425a80687743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.020788 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b8a8-d367-4f66-a516-425a80687743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.021511 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136b8a8-d367-4f66-a516-425a80687743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:37.023108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136b8a8-d367-4f66-a516-425a80687743 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:37.033742 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1442/2863] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:52:37.037608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f84c3-c680-4219-a1ce-5b1ddd3a7dda admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:37.047443 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f84c3-c680-4219-a1ce-5b1ddd3a7dda admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:37.051990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebde313-efe0-4776-af85-c9acf611161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:37.052862 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebde313-efe0-4776-af85-c9acf611161f admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.053152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebde313-efe0-4776-af85-c9acf611161f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.053429 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebde313-efe0-4776-af85-c9acf611161f admin admin] PATH_INFO: `/v3/projects/1bfff3a4e2ed4f3582a65baf34990d65/users/df811a9533a345a3987e91a2d4fc51a2/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.068177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebde313-efe0-4776-af85-c9acf611161f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfff3a4e2ed4f3582a65baf34990d65, user_id=df811a9533a345a3987e91a2d4fc51a2, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:37.070807 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebde313-efe0-4776-af85-c9acf611161f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:37.085096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1422/2864] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:52:37 2022] PUT /identity/v3/projects/1bfff3a4e2ed4f3582a65baf34990d65/users/df811a9533a345a3987e91a2d4fc51a2/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:37.095332 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d5f8-f9ed-4501-bcf4-7992b99f3f3e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.095631 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d5f8-f9ed-4501-bcf4-7992b99f3f3e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.095918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d5f8-f9ed-4501-bcf4-7992b99f3f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.122329 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fb45d5f8-f9ed-4501-bcf4-7992b99f3f3e None None] MFA Rules not processed for user `df811a9533a345a3987e91a2d4fc51a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:37.123586 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fb45d5f8-f9ed-4501-bcf4-7992b99f3f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:37.186289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1443/2865] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:37.192095 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebde313-efe0-4776-af85-c9acf611161f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:37.213608 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:37.257037 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebde313-efe0-4776-af85-c9acf611161f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:37.261718 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44828988-2316-4ad3-909a-0b3721e707e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:37.262373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44828988-2316-4ad3-909a-0b3721e707e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.262661 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44828988-2316-4ad3-909a-0b3721e707e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.262940 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44828988-2316-4ad3-909a-0b3721e707e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.263672 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44828988-2316-4ad3-909a-0b3721e707e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:37.265594 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44828988-2316-4ad3-909a-0b3721e707e0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:37.290136 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1423/2866] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:52:37 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:52:37.294143 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d5f8-f9ed-4501-bcf4-7992b99f3f3e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:37.305442 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d5f8-f9ed-4501-bcf4-7992b99f3f3e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:37.317409 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:37.361904 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4485e-69c6-4a01-b8bb-43a6d440d5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:37.362573 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4485e-69c6-4a01-b8bb-43a6d440d5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.362864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4485e-69c6-4a01-b8bb-43a6d440d5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.363148 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4485e-69c6-4a01-b8bb-43a6d440d5e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.363873 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4485e-69c6-4a01-b8bb-43a6d440d5e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:37.365800 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4485e-69c6-4a01-b8bb-43a6d440d5e4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:37.388204 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1444/2867] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:52:37 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:52:37.389334 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44828988-2316-4ad3-909a-0b3721e707e0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:37.400096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44828988-2316-4ad3-909a-0b3721e707e0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:37.404655 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de096db-2907-4dc9-998c-a5a17c2c006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:37.405308 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de096db-2907-4dc9-998c-a5a17c2c006e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.406163 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de096db-2907-4dc9-998c-a5a17c2c006e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.406448 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de096db-2907-4dc9-998c-a5a17c2c006e admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.407213 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de096db-2907-4dc9-998c-a5a17c2c006e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:37.408815 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de096db-2907-4dc9-998c-a5a17c2c006e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:37.419262 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1424/2868] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 20:52:37.422973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4485e-69c6-4a01-b8bb-43a6d440d5e4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:37.432982 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4485e-69c6-4a01-b8bb-43a6d440d5e4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:37.439331 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152ef52-290f-47ff-8ccd-8c7c1127cc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:37.439933 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152ef52-290f-47ff-8ccd-8c7c1127cc88 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.440221 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152ef52-290f-47ff-8ccd-8c7c1127cc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.440503 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152ef52-290f-47ff-8ccd-8c7c1127cc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.441229 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152ef52-290f-47ff-8ccd-8c7c1127cc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:37.442822 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152ef52-290f-47ff-8ccd-8c7c1127cc88 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:37.453217 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1445/2869] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:52:37.457333 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de096db-2907-4dc9-998c-a5a17c2c006e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:37.467319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de096db-2907-4dc9-998c-a5a17c2c006e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:37.472826 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bce36-69ed-40d4-a6a8-6f740c195d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:37.473766 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bce36-69ed-40d4-a6a8-6f740c195d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.474038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bce36-69ed-40d4-a6a8-6f740c195d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.474319 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bce36-69ed-40d4-a6a8-6f740c195d6e admin admin] PATH_INFO: `/v3/projects/1fa270078ce549f3a314b98ec84ff6d1/users/774f26df0bb54705aef5d3cc6e34a7e1/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.489741 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bce36-69ed-40d4-a6a8-6f740c195d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa270078ce549f3a314b98ec84ff6d1, user_id=774f26df0bb54705aef5d3cc6e34a7e1, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:37.492418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bce36-69ed-40d4-a6a8-6f740c195d6e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:37.505620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1425/2870] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:52:37 2022] PUT /identity/v3/projects/1fa270078ce549f3a314b98ec84ff6d1/users/774f26df0bb54705aef5d3cc6e34a7e1/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:37.516216 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab511a9-61ec-4fa9-8cca-57ae67d33c86 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.516513 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab511a9-61ec-4fa9-8cca-57ae67d33c86 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.516797 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab511a9-61ec-4fa9-8cca-57ae67d33c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.543135 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3ab511a9-61ec-4fa9-8cca-57ae67d33c86 None None] MFA Rules not processed for user `774f26df0bb54705aef5d3cc6e34a7e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:37.544448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3ab511a9-61ec-4fa9-8cca-57ae67d33c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:37.610883 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1446/2871] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:37.615337 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bce36-69ed-40d4-a6a8-6f740c195d6e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:37.675338 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bce36-69ed-40d4-a6a8-6f740c195d6e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:37.679963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212beeb-fa42-43f3-b219-506b6d372aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:37.680613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212beeb-fa42-43f3-b219-506b6d372aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.680898 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212beeb-fa42-43f3-b219-506b6d372aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.681177 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212beeb-fa42-43f3-b219-506b6d372aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.681866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212beeb-fa42-43f3-b219-506b6d372aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:37.683790 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212beeb-fa42-43f3-b219-506b6d372aa5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:37.708397 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1426/2872] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:52:37 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:52:37.712349 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab511a9-61ec-4fa9-8cca-57ae67d33c86 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:37.723535 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab511a9-61ec-4fa9-8cca-57ae67d33c86 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:37.778519 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0785e9-954e-48c9-8839-2662a6c73d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:37.779195 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0785e9-954e-48c9-8839-2662a6c73d65 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.779492 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0785e9-954e-48c9-8839-2662a6c73d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.779766 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0785e9-954e-48c9-8839-2662a6c73d65 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.781147 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0785e9-954e-48c9-8839-2662a6c73d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:37.783539 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0785e9-954e-48c9-8839-2662a6c73d65 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:37.802700 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1447/2873] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:52:37 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 20:52:37.806678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212beeb-fa42-43f3-b219-506b6d372aa5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:37.817272 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212beeb-fa42-43f3-b219-506b6d372aa5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:37.821793 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fd810-cb96-4317-8521-75c6c079ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:37.822442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fd810-cb96-4317-8521-75c6c079ef82 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.822725 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fd810-cb96-4317-8521-75c6c079ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.823002 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fd810-cb96-4317-8521-75c6c079ef82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.823754 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fd810-cb96-4317-8521-75c6c079ef82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:37.825365 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fd810-cb96-4317-8521-75c6c079ef82 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:37.836185 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1427/2874] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:52:37.840018 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0785e9-954e-48c9-8839-2662a6c73d65 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:37.850180 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0785e9-954e-48c9-8839-2662a6c73d65 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:37.854796 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a943d15-4ab1-4439-8fdb-df8d955113e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:37.855699 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a943d15-4ab1-4439-8fdb-df8d955113e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.855985 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a943d15-4ab1-4439-8fdb-df8d955113e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.856265 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a943d15-4ab1-4439-8fdb-df8d955113e9 admin admin] PATH_INFO: `/v3/projects/a2282e8f0bd64250a6ed3027f337eba1/users/f1f5642a2eb847e5af8c750ae238e94f/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.868030 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:37.871422 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a943d15-4ab1-4439-8fdb-df8d955113e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2282e8f0bd64250a6ed3027f337eba1, user_id=f1f5642a2eb847e5af8c750ae238e94f, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:37.875474 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a943d15-4ab1-4439-8fdb-df8d955113e9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:37.893163 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1448/2875] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:52:37 2022] PUT /identity/v3/projects/a2282e8f0bd64250a6ed3027f337eba1/users/f1f5642a2eb847e5af8c750ae238e94f/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:37.896835 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fd810-cb96-4317-8521-75c6c079ef82 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:37.907092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fd810-cb96-4317-8521-75c6c079ef82 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:37.950503 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:37.968560 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cc894-5f04-42b1-a3c5-76b7819722e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:37.969285 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cc894-5f04-42b1-a3c5-76b7819722e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:37.969574 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cc894-5f04-42b1-a3c5-76b7819722e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:37.969852 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cc894-5f04-42b1-a3c5-76b7819722e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:37.970605 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cc894-5f04-42b1-a3c5-76b7819722e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:37.972222 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cc894-5f04-42b1-a3c5-76b7819722e9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:37.982304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1428/2876] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:52:37.986665 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a943d15-4ab1-4439-8fdb-df8d955113e9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:37.997053 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a943d15-4ab1-4439-8fdb-df8d955113e9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:38.002322 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550bfcf-2e58-4aac-8ec7-c8eabc28e7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:38.003239 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550bfcf-2e58-4aac-8ec7-c8eabc28e7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:38.003527 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550bfcf-2e58-4aac-8ec7-c8eabc28e7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:38.003809 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550bfcf-2e58-4aac-8ec7-c8eabc28e7e4 admin admin] PATH_INFO: `/v3/projects/a2282e8f0bd64250a6ed3027f337eba1/users/f1f5642a2eb847e5af8c750ae238e94f/roles/9bd5687ac7cc4304abdd5ba1d004f7cf` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:38.006016 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550bfcf-2e58-4aac-8ec7-c8eabc28e7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2282e8f0bd64250a6ed3027f337eba1, user_id=f1f5642a2eb847e5af8c750ae238e94f, role_id=9bd5687ac7cc4304abdd5ba1d004f7cf)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:38.008706 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550bfcf-2e58-4aac-8ec7-c8eabc28e7e4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:38.020435 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1449/2877] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:52:37 2022] PUT /identity/v3/projects/a2282e8f0bd64250a6ed3027f337eba1/users/f1f5642a2eb847e5af8c750ae238e94f/roles/9bd5687ac7cc4304abdd5ba1d004f7cf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:38.032034 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700afe79-41a7-4125-b8c5-25e1355a8a6f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:38.032395 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700afe79-41a7-4125-b8c5-25e1355a8a6f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:38.032747 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700afe79-41a7-4125-b8c5-25e1355a8a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:38.060663 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-700afe79-41a7-4125-b8c5-25e1355a8a6f None None] MFA Rules not processed for user `f1f5642a2eb847e5af8c750ae238e94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:38.062615 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-700afe79-41a7-4125-b8c5-25e1355a8a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:38.130007 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1429/2878] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:38.141806 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550bfcf-2e58-4aac-8ec7-c8eabc28e7e4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:38.143541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5550bfcf-2e58-4aac-8ec7-c8eabc28e7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:38.199609 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550bfcf-2e58-4aac-8ec7-c8eabc28e7e4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:38.203308 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f30fc5-849e-4475-a112-861531e5b3e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:38.203946 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f30fc5-849e-4475-a112-861531e5b3e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:38.204231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f30fc5-849e-4475-a112-861531e5b3e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:38.204510 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f30fc5-849e-4475-a112-861531e5b3e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:38.265865 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f30fc5-849e-4475-a112-861531e5b3e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:38.267291 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f30fc5-849e-4475-a112-861531e5b3e4 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:38.276194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1450/2879] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:52:39.753030 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700afe79-41a7-4125-b8c5-25e1355a8a6f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:39.754847 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-700afe79-41a7-4125-b8c5-25e1355a8a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:39.766952 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700afe79-41a7-4125-b8c5-25e1355a8a6f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:39.770400 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295a8f2-4cf4-49cf-9d03-547de4e3df3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:39.771028 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295a8f2-4cf4-49cf-9d03-547de4e3df3f service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:39.771345 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295a8f2-4cf4-49cf-9d03-547de4e3df3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:39.771624 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295a8f2-4cf4-49cf-9d03-547de4e3df3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:39.828864 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295a8f2-4cf4-49cf-9d03-547de4e3df3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:39.830216 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295a8f2-4cf4-49cf-9d03-547de4e3df3f service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:39.839028 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1430/2880] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:52:40.349471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f30fc5-849e-4475-a112-861531e5b3e4 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:40.358108 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f30fc5-849e-4475-a112-861531e5b3e4 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:40.361859 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1ac2d-fd1c-4809-8967-95a5e0b9146a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:40.362509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1ac2d-fd1c-4809-8967-95a5e0b9146a service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:40.362798 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1ac2d-fd1c-4809-8967-95a5e0b9146a service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:40.363076 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1ac2d-fd1c-4809-8967-95a5e0b9146a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:40.372436 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1ac2d-fd1c-4809-8967-95a5e0b9146a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:40.375951 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1ac2d-fd1c-4809-8967-95a5e0b9146a service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:40.386637 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1451/2881] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:52:41.163304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295a8f2-4cf4-49cf-9d03-547de4e3df3f service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:41.164716 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4295a8f2-4cf4-49cf-9d03-547de4e3df3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:41.220726 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295a8f2-4cf4-49cf-9d03-547de4e3df3f service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:41.224310 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be539c47-99bd-4dd9-b9ee-7837626c1fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:41.224945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539c47-99bd-4dd9-b9ee-7837626c1fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:41.225225 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539c47-99bd-4dd9-b9ee-7837626c1fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:41.225496 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539c47-99bd-4dd9-b9ee-7837626c1fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:41.227273 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-be539c47-99bd-4dd9-b9ee-7837626c1fb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:41.237305 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be539c47-99bd-4dd9-b9ee-7837626c1fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:41.238705 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be539c47-99bd-4dd9-b9ee-7837626c1fb3 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:41.246671 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1431/2882] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:52:44.238227 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1ac2d-fd1c-4809-8967-95a5e0b9146a service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:44.302479 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1ac2d-fd1c-4809-8967-95a5e0b9146a service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:44.306964 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:44.307864 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:44.308145 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:44.308416 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] PATH_INFO: `/v3/users/df811a9533a345a3987e91a2d4fc51a2` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:44.309578 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df811a9533a345a3987e91a2d4fc51a2)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:44.311525 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:44.333024 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:44.358407 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df811a9533a345a3987e91a2d4fc51a2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:44.365466 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df811a9533a345a3987e91a2d4fc51a2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:44.372229 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df811a9533a345a3987e91a2d4fc51a2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:44.372850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df811a9533a345a3987e91a2d4fc51a2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:44.384880 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df811a9533a345a3987e91a2d4fc51a2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:44.391705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1452/2883] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:52:44 2022] DELETE /identity/v3/users/df811a9533a345a3987e91a2d4fc51a2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:44.396494 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee76929-1b80-4092-af6b-edfc5b384f34 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:44.396947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee76929-1b80-4092-af6b-edfc5b384f34 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:44.397067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee76929-1b80-4092-af6b-edfc5b384f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:44.410376 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:44.417414 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2ee76929-1b80-4092-af6b-edfc5b384f34 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:44.418647 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2ee76929-1b80-4092-af6b-edfc5b384f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:44.487819 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1432/2884] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:44.497326 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:44.498787 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:44.555910 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc9a23-4fbd-4f1d-8b3a-04769da8b92d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:44.559515 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017803b1-9f6a-4199-986f-bb8c252021c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:44.560160 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017803b1-9f6a-4199-986f-bb8c252021c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:44.560448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017803b1-9f6a-4199-986f-bb8c252021c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:44.560729 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017803b1-9f6a-4199-986f-bb8c252021c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:44.570417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017803b1-9f6a-4199-986f-bb8c252021c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:44.571878 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017803b1-9f6a-4199-986f-bb8c252021c3 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:44.581858 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1453/2885] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:52:44.854510 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee76929-1b80-4092-af6b-edfc5b384f34 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:44.855984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2ee76929-1b80-4092-af6b-edfc5b384f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:44.868482 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee76929-1b80-4092-af6b-edfc5b384f34 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:44.873291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:44.874152 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:44.874436 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:44.874714 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] PATH_INFO: `/v3/projects/1bfff3a4e2ed4f3582a65baf34990d65` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:44.876564 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfff3a4e2ed4f3582a65baf34990d65)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:44.878557 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:44.925786 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfff3a4e2ed4f3582a65baf34990d65', 'request_id': 'req-6f3322f2-91ae-42cf-8a41-2cec9857172d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:44.934145 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfff3a4e2ed4f3582a65baf34990d65', 'request_id': 'req-6f3322f2-91ae-42cf-8a41-2cec9857172d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:44.940637 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfff3a4e2ed4f3582a65baf34990d65', 'request_id': 'req-6f3322f2-91ae-42cf-8a41-2cec9857172d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:44.951896 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] The token cache is being invalidate because project 1bfff3a4e2ed4f3582a65baf34990d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:52:44.952182 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:44.952830 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:44.954409 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1433/2886] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:52:44 2022] DELETE /identity/v3/projects/1bfff3a4e2ed4f3582a65baf34990d65 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:44.958391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017803b1-9f6a-4199-986f-bb8c252021c3 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:44.968041 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017803b1-9f6a-4199-986f-bb8c252021c3 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:45.028126 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:45.029278 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:45.029636 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:45.029987 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] PATH_INFO: `/v3/users/774f26df0bb54705aef5d3cc6e34a7e1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:45.031541 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] RBAC: Authorizing `identity:delete_user(user_id=774f26df0bb54705aef5d3cc6e34a7e1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:45.033801 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:45.041737 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:45.043250 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:45.086879 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:45.093731 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774f26df0bb54705aef5d3cc6e34a7e1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.104973 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774f26df0bb54705aef5d3cc6e34a7e1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.114835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774f26df0bb54705aef5d3cc6e34a7e1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.115718 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774f26df0bb54705aef5d3cc6e34a7e1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.118061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3322f2-91ae-42cf-8a41-2cec9857172d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:45.122724 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4cc5b-68fb-412e-91f7-efb001fd568c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:45.123656 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4cc5b-68fb-412e-91f7-efb001fd568c service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:45.123961 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4cc5b-68fb-412e-91f7-efb001fd568c service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:45.124307 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4cc5b-68fb-412e-91f7-efb001fd568c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:45.127009 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fbc4cc5b-68fb-412e-91f7-efb001fd568c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:45.130222 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774f26df0bb54705aef5d3cc6e34a7e1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.137597 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1454/2887] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:52:44 2022] DELETE /identity/v3/users/774f26df0bb54705aef5d3cc6e34a7e1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:45.139352 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4cc5b-68fb-412e-91f7-efb001fd568c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:45.141680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4cc5b-68fb-412e-91f7-efb001fd568c service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:45.152133 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1434/2888] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:52:45.420770 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:45.422289 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:45.488604 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd2493-07ce-41df-b10a-39b61153b21b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:45.493902 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:45.494782 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:45.495094 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:45.495410 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] PATH_INFO: `/v3/projects/1fa270078ce549f3a314b98ec84ff6d1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:45.496596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa270078ce549f3a314b98ec84ff6d1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:45.498557 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:45.546478 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa270078ce549f3a314b98ec84ff6d1', 'request_id': 'req-f1267699-be57-4aca-ab84-bcb8e23ad473'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.552758 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa270078ce549f3a314b98ec84ff6d1', 'request_id': 'req-f1267699-be57-4aca-ab84-bcb8e23ad473'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.559707 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa270078ce549f3a314b98ec84ff6d1', 'request_id': 'req-f1267699-be57-4aca-ab84-bcb8e23ad473'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.570620 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] The token cache is being invalidate because project 1fa270078ce549f3a314b98ec84ff6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:52:45.570886 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.571585 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.573439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1455/2889] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:52:45 2022] DELETE /identity/v3/projects/1fa270078ce549f3a314b98ec84ff6d1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:45.577215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4cc5b-68fb-412e-91f7-efb001fd568c service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:45.590244 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4cc5b-68fb-412e-91f7-efb001fd568c service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:45.621483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:45.650449 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:45.651348 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:45.651637 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:45.651920 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] PATH_INFO: `/v3/users/f1f5642a2eb847e5af8c750ae238e94f` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:45.653115 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f5642a2eb847e5af8c750ae238e94f)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:45.655038 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:45.700458 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f5642a2eb847e5af8c750ae238e94f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.701129 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f5642a2eb847e5af8c750ae238e94f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.712843 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f5642a2eb847e5af8c750ae238e94f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.720014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f5642a2eb847e5af8c750ae238e94f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.726759 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f5642a2eb847e5af8c750ae238e94f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:45.732825 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1435/2890] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:52:45 2022] DELETE /identity/v3/users/f1f5642a2eb847e5af8c750ae238e94f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 20:52:46.247516 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:46.250026 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:46.261949 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:46.263930 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:46.276205 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1267699-be57-4aca-ab84-bcb8e23ad473 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:46.330007 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:46.339124 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae642c-ae23-4d53-a02b-7b810f812d1d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:46.343966 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbecac4-edba-4fba-a038-5f80377f17be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:46.345194 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fafb48-cd25-4df0-a801-dfd217e39e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:46.345340 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbecac4-edba-4fba-a038-5f80377f17be service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:46.345727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbecac4-edba-4fba-a038-5f80377f17be service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:46.345866 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbecac4-edba-4fba-a038-5f80377f17be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:46.347071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fafb48-cd25-4df0-a801-dfd217e39e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:46.347789 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fafb48-cd25-4df0-a801-dfd217e39e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:46.348067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2dbecac4-edba-4fba-a038-5f80377f17be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:46.348213 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fafb48-cd25-4df0-a801-dfd217e39e58 admin admin] PATH_INFO: `/v3/projects/a2282e8f0bd64250a6ed3027f337eba1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:46.349532 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fafb48-cd25-4df0-a801-dfd217e39e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2282e8f0bd64250a6ed3027f337eba1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:46.352391 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fafb48-cd25-4df0-a801-dfd217e39e58 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:46.411715 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-58fafb48-cd25-4df0-a801-dfd217e39e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2282e8f0bd64250a6ed3027f337eba1', 'request_id': 'req-58fafb48-cd25-4df0-a801-dfd217e39e58'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:46.418784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-58fafb48-cd25-4df0-a801-dfd217e39e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2282e8f0bd64250a6ed3027f337eba1', 'request_id': 'req-58fafb48-cd25-4df0-a801-dfd217e39e58'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:46.425442 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:46.428277 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-58fafb48-cd25-4df0-a801-dfd217e39e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2282e8f0bd64250a6ed3027f337eba1', 'request_id': 'req-58fafb48-cd25-4df0-a801-dfd217e39e58'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:46.431118 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbecac4-edba-4fba-a038-5f80377f17be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:46.433298 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbecac4-edba-4fba-a038-5f80377f17be service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:46.440561 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-58fafb48-cd25-4df0-a801-dfd217e39e58 admin admin] The token cache is being invalidate because project a2282e8f0bd64250a6ed3027f337eba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:52:46.440850 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-58fafb48-cd25-4df0-a801-dfd217e39e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:46.441498 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-58fafb48-cd25-4df0-a801-dfd217e39e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:46.443033 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1456/2891] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:52:46 2022] DELETE /identity/v3/projects/a2282e8f0bd64250a6ed3027f337eba1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:46.445780 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1436/2892] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 20:52:46.447732 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db1718-09c7-49e3-be9f-d8fc82945009 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:46.448092 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db1718-09c7-49e3-be9f-d8fc82945009 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:46.448369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db1718-09c7-49e3-be9f-d8fc82945009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:46.465945 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-68db1718-09c7-49e3-be9f-d8fc82945009 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:46.467162 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-68db1718-09c7-49e3-be9f-d8fc82945009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:46.528881 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1437/2893] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 20:52:46.537352 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2140a3-be4f-4425-bd54-80b4f68fddae None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:46.537752 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2140a3-be4f-4425-bd54-80b4f68fddae None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:46.537914 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2140a3-be4f-4425-bd54-80b4f68fddae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:46.561087 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7c2140a3-be4f-4425-bd54-80b4f68fddae None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:46.562344 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7c2140a3-be4f-4425-bd54-80b4f68fddae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:46.572045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1457/2894] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:46.576307 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db1718-09c7-49e3-be9f-d8fc82945009 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:46.586415 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db1718-09c7-49e3-be9f-d8fc82945009 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:46.591984 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afc157-de9b-4b2f-a4e7-491921cb3486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:46.592660 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afc157-de9b-4b2f-a4e7-491921cb3486 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:46.592947 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afc157-de9b-4b2f-a4e7-491921cb3486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:46.593229 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afc157-de9b-4b2f-a4e7-491921cb3486 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:46.594665 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afc157-de9b-4b2f-a4e7-491921cb3486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 20:52:46.595096 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afc157-de9b-4b2f-a4e7-491921cb3486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:46.596748 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afc157-de9b-4b2f-a4e7-491921cb3486 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:46.612883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1438/2895] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jul 6 20:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 20:52:46.613997 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2140a3-be4f-4425-bd54-80b4f68fddae None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:46.623262 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2140a3-be4f-4425-bd54-80b4f68fddae None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:46.628596 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574f856-e935-4b97-b569-c36066a7ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:46.629509 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574f856-e935-4b97-b569-c36066a7ca93 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:46.629794 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574f856-e935-4b97-b569-c36066a7ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:46.630071 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574f856-e935-4b97-b569-c36066a7ca93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:46.630751 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574f856-e935-4b97-b569-c36066a7ca93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:46.632762 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574f856-e935-4b97-b569-c36066a7ca93 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:46.663231 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1458/2896] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jul 6 20:52:46 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:52:46.667877 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afc157-de9b-4b2f-a4e7-491921cb3486 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:46.678949 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afc157-de9b-4b2f-a4e7-491921cb3486 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:46.735465 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f95e0c-2cb9-4e1e-b217-5cacace56ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:46.736176 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f95e0c-2cb9-4e1e-b217-5cacace56ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:46.736483 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f95e0c-2cb9-4e1e-b217-5cacace56ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:46.736774 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f95e0c-2cb9-4e1e-b217-5cacace56ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:46.737990 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f95e0c-2cb9-4e1e-b217-5cacace56ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:46.740209 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f95e0c-2cb9-4e1e-b217-5cacace56ff7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:46.761405 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1439/2897] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jul 6 20:52:46 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 20:52:46.765435 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574f856-e935-4b97-b569-c36066a7ca93 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:46.776475 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574f856-e935-4b97-b569-c36066a7ca93 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:46.781045 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf81c4-c1a8-4e35-bb87-c90c1c985488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:46.781716 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf81c4-c1a8-4e35-bb87-c90c1c985488 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:46.781994 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf81c4-c1a8-4e35-bb87-c90c1c985488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:46.782267 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf81c4-c1a8-4e35-bb87-c90c1c985488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:46.782978 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf81c4-c1a8-4e35-bb87-c90c1c985488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:46.784603 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf81c4-c1a8-4e35-bb87-c90c1c985488 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:46.795188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1459/2898] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:52:46.799369 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f95e0c-2cb9-4e1e-b217-5cacace56ff7 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:46.809416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f95e0c-2cb9-4e1e-b217-5cacace56ff7 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:46.814678 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4b984-283f-4067-bc1f-2a675a5353e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:46.815354 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4b984-283f-4067-bc1f-2a675a5353e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:46.815636 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4b984-283f-4067-bc1f-2a675a5353e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:46.815929 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4b984-283f-4067-bc1f-2a675a5353e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:46.816629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4b984-283f-4067-bc1f-2a675a5353e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:46.818204 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4b984-283f-4067-bc1f-2a675a5353e5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:46.828291 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1440/2899] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jul 6 20:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 20:52:46.832944 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf81c4-c1a8-4e35-bb87-c90c1c985488 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:46.842841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf81c4-c1a8-4e35-bb87-c90c1c985488 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:46.847363 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d410dee-d9c5-44b6-82b4-376d019a7bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:46.848228 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410dee-d9c5-44b6-82b4-376d019a7bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:46.848506 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410dee-d9c5-44b6-82b4-376d019a7bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:46.848779 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410dee-d9c5-44b6-82b4-376d019a7bf8 admin admin] PATH_INFO: `/v3/projects/5645d0e6c4144e2e83685e01121f10a6/users/57de1d4007a8418c8b006b92d9a1cf78/roles/e9451c79645545d78e667c61eece4ec8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:46.863284 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d410dee-d9c5-44b6-82b4-376d019a7bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5645d0e6c4144e2e83685e01121f10a6, user_id=57de1d4007a8418c8b006b92d9a1cf78, role_id=e9451c79645545d78e667c61eece4ec8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:46.865975 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d410dee-d9c5-44b6-82b4-376d019a7bf8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:46.880705 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1460/2900] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jul 6 20:52:46 2022] PUT /identity/v3/projects/5645d0e6c4144e2e83685e01121f10a6/users/57de1d4007a8418c8b006b92d9a1cf78/roles/e9451c79645545d78e667c61eece4ec8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:46.892309 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ba431-a541-410f-9912-5eedec975a88 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:46.892600 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ba431-a541-410f-9912-5eedec975a88 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:46.892883 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ba431-a541-410f-9912-5eedec975a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:46.919384 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-378ba431-a541-410f-9912-5eedec975a88 None None] MFA Rules not processed for user `57de1d4007a8418c8b006b92d9a1cf78`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:46.920573 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-378ba431-a541-410f-9912-5eedec975a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:46.966612 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:46.986331 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1441/2901] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:46.997328 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d410dee-d9c5-44b6-82b4-376d019a7bf8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:46.999021 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0d410dee-d9c5-44b6-82b4-376d019a7bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:47.055205 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d410dee-d9c5-44b6-82b4-376d019a7bf8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:47.058805 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd7c1f-2071-4d6c-a9f4-c84c0a0fddd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693da03c42e4328b74869abd0ae4b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:47.059480 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd7c1f-2071-4d6c-a9f4-c84c0a0fddd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:47.059816 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd7c1f-2071-4d6c-a9f4-c84c0a0fddd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:47.060093 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd7c1f-2071-4d6c-a9f4-c84c0a0fddd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:47.069022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd7c1f-2071-4d6c-a9f4-c84c0a0fddd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:47.070439 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd7c1f-2071-4d6c-a9f4-c84c0a0fddd2 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:47.080235 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1461/2902] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:52:47.104229 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ba431-a541-410f-9912-5eedec975a88 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:47.166081 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ba431-a541-410f-9912-5eedec975a88 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:47.171721 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:47.173339 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:47.173629 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:47.173911 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] PATH_INFO: `/v3/users/57de1d4007a8418c8b006b92d9a1cf78` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:47.175123 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57de1d4007a8418c8b006b92d9a1cf78)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:47.177079 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:47.222366 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57de1d4007a8418c8b006b92d9a1cf78'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:47.222970 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57de1d4007a8418c8b006b92d9a1cf78'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:47.235415 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57de1d4007a8418c8b006b92d9a1cf78'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:47.242641 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57de1d4007a8418c8b006b92d9a1cf78'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:47.249455 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57de1d4007a8418c8b006b92d9a1cf78'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:47.259765 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1442/2903] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:52:47 2022] DELETE /identity/v3/users/57de1d4007a8418c8b006b92d9a1cf78 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:47.265583 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882cccb-8cf3-480e-adc2-06533c1f4fb5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:47.266605 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882cccb-8cf3-480e-adc2-06533c1f4fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:47.266920 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882cccb-8cf3-480e-adc2-06533c1f4fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:47.284633 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2882cccb-8cf3-480e-adc2-06533c1f4fb5 None None] MFA Rules not processed for user `cfed129aafe54696bb42f388ec9baac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 20:52:47.285834 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2882cccb-8cf3-480e-adc2-06533c1f4fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:47.298721 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:47.346649 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1462/2904] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jul 6 20:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 20:52:47.356061 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:47.357453 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:47.414511 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c34c48-cb35-4eec-b52f-2df440f5a8e7 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:47.418222 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f7a17-0567-4efb-848d-795f81a9a8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bb4a244df24a19b4c3ad3d1ad2bc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:47.418872 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f7a17-0567-4efb-848d-795f81a9a8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:47.419232 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f7a17-0567-4efb-848d-795f81a9a8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:47.419517 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f7a17-0567-4efb-848d-795f81a9a8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:47.429720 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f7a17-0567-4efb-848d-795f81a9a8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:47.431198 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f7a17-0567-4efb-848d-795f81a9a8a7 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:47.443379 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1443/2905] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:52:47.623540 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882cccb-8cf3-480e-adc2-06533c1f4fb5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:47.625918 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2882cccb-8cf3-480e-adc2-06533c1f4fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:47.700866 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882cccb-8cf3-480e-adc2-06533c1f4fb5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:47.706727 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ffaa8-bc63-41f6-855f-6c35a0f40190 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98059ebef5d470db684fb78d19a8839', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:47.707414 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ffaa8-bc63-41f6-855f-6c35a0f40190 service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:47.707697 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ffaa8-bc63-41f6-855f-6c35a0f40190 service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:47.707977 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ffaa8-bc63-41f6-855f-6c35a0f40190 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:47.709743 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f92ffaa8-bc63-41f6-855f-6c35a0f40190 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:47.721835 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ffaa8-bc63-41f6-855f-6c35a0f40190 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:47.723448 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ffaa8-bc63-41f6-855f-6c35a0f40190 service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:47.733785 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1463/2906] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:52:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:52:47.796141 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f7a17-0567-4efb-848d-795f81a9a8a7 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:52:47.798788 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4c2f7a17-0567-4efb-848d-795f81a9a8a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:52:47.815290 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f7a17-0567-4efb-848d-795f81a9a8a7 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:52:47.820703 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:52:47.821457 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:52:47.821738 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:52:47.822014 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] PATH_INFO: `/v3/projects/5645d0e6c4144e2e83685e01121f10a6` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:52:47.823416 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5645d0e6c4144e2e83685e01121f10a6)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:52:47.825327 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:52:47.832954 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:47.873711 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5645d0e6c4144e2e83685e01121f10a6', 'request_id': 'req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:47.881670 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5645d0e6c4144e2e83685e01121f10a6', 'request_id': 'req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:47.887072 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5645d0e6c4144e2e83685e01121f10a6', 'request_id': 'req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:47.897900 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] The token cache is being invalidate because project 5645d0e6c4144e2e83685e01121f10a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:52:47.898191 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:47.898814 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:52:47.900351 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1444/2907] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:52:47 2022] DELETE /identity/v3/projects/5645d0e6c4144e2e83685e01121f10a6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:52:57.729323 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=50 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:52:57.894889 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:54:10.929295 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ffaa8-bc63-41f6-855f-6c35a0f40190 service placement] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:54:10.930841 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f92ffaa8-bc63-41f6-855f-6c35a0f40190 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:54:11.085471 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ffaa8-bc63-41f6-855f-6c35a0f40190 service placement] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:54:11.170948 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38e8fb-c19b-40d8-8eb1-e43573e2aa47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:54:11.171671 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38e8fb-c19b-40d8-8eb1-e43573e2aa47 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:54:11.171961 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38e8fb-c19b-40d8-8eb1-e43573e2aa47 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:54:11.172364 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38e8fb-c19b-40d8-8eb1-e43573e2aa47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:54:11.174903 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-af38e8fb-c19b-40d8-8eb1-e43573e2aa47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:54:11.188142 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38e8fb-c19b-40d8-8eb1-e43573e2aa47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:54:11.189743 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38e8fb-c19b-40d8-8eb1-e43573e2aa47 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:54:11.202494 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1464/2908] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:54:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:54:13.199848 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:54:13.201536 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:54:13.245130 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a01e5-bf83-497f-9aa9-6db1edd85ec9 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:54:13.251215 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56248a7-7a8e-44da-b3b1-09d036e6bc90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d68c8fdb65343b8b2f58070addeaf13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:54:13.251851 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56248a7-7a8e-44da-b3b1-09d036e6bc90 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:54:13.252680 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56248a7-7a8e-44da-b3b1-09d036e6bc90 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:54:13.252963 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56248a7-7a8e-44da-b3b1-09d036e6bc90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:54:13.254723 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e56248a7-7a8e-44da-b3b1-09d036e6bc90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:54:13.266998 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56248a7-7a8e-44da-b3b1-09d036e6bc90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:54:13.269433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56248a7-7a8e-44da-b3b1-09d036e6bc90 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:54:13.281067 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1445/2909] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:54:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:54:20.910380 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38e8fb-c19b-40d8-8eb1-e43573e2aa47 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:54:20.912182 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-af38e8fb-c19b-40d8-8eb1-e43573e2aa47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:54:20.953943 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:54:21.010144 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38e8fb-c19b-40d8-8eb1-e43573e2aa47 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:54:21.014659 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:54:21.015558 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:54:21.015837 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:54:21.016106 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] PATH_INFO: `/v3/users/75a880e2f8234ad4861db8353a8544a7` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:54:21.017848 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a880e2f8234ad4861db8353a8544a7)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:54:21.019802 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:54:21.066002 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a880e2f8234ad4861db8353a8544a7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.073157 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a880e2f8234ad4861db8353a8544a7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.080672 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a880e2f8234ad4861db8353a8544a7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.081477 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a880e2f8234ad4861db8353a8544a7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.093286 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a880e2f8234ad4861db8353a8544a7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.099784 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1465/2910] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:54:20 2022] DELETE /identity/v3/users/75a880e2f8234ad4861db8353a8544a7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:54:21.272592 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56248a7-7a8e-44da-b3b1-09d036e6bc90 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:54:21.285727 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56248a7-7a8e-44da-b3b1-09d036e6bc90 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:54:21.342304 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:54:21.343097 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:54:21.343411 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:54:21.343717 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] PATH_INFO: `/v3/projects/4633e02346a44f8db1880dee4b234d24` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:54:21.344901 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4633e02346a44f8db1880dee4b234d24)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:54:21.346832 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:54:21.393371 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4633e02346a44f8db1880dee4b234d24', 'request_id': 'req-e5de12d6-cf28-40b1-b340-67172998e79e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.400924 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4633e02346a44f8db1880dee4b234d24', 'request_id': 'req-e5de12d6-cf28-40b1-b340-67172998e79e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.406418 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4633e02346a44f8db1880dee4b234d24', 'request_id': 'req-e5de12d6-cf28-40b1-b340-67172998e79e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.417162 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] The token cache is being invalidate because project 4633e02346a44f8db1880dee4b234d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:54:21.417433 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.418060 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.419620 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1446/2911] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:54:21 2022] DELETE /identity/v3/projects/4633e02346a44f8db1880dee4b234d24 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:54:21.423590 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:54:21.425188 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:54:21.438182 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60059bce-279e-443b-822a-c52b8a4b7523 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:54:21.494176 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:54:21.495051 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:54:21.495373 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:54:21.495651 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] PATH_INFO: `/v3/users/55841ad633b74f0eb5372d7df5b928e4` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:54:21.496830 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] RBAC: Authorizing `identity:delete_user(user_id=55841ad633b74f0eb5372d7df5b928e4)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:54:21.498750 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:54:21.527221 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:54:21.545381 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55841ad633b74f0eb5372d7df5b928e4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.553491 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55841ad633b74f0eb5372d7df5b928e4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.560417 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55841ad633b74f0eb5372d7df5b928e4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.561054 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55841ad633b74f0eb5372d7df5b928e4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.574275 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55841ad633b74f0eb5372d7df5b928e4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.580337 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1466/2912] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jul 6 20:54:21 2022] DELETE /identity/v3/users/55841ad633b74f0eb5372d7df5b928e4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:54:21.770419 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:54:21.771885 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:54:21.785525 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de12d6-cf28-40b1-b340-67172998e79e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:54:21.833583 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:54:21.843613 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfed129aafe54696bb42f388ec9baac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '371b1675f3c34bee9789abbf8b4d7fc5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:54:21.844470 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:54:21.844749 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:54:21.845023 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2 admin admin] PATH_INFO: `/v3/projects/f2346276d99d41928857c60db9e25119` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:54:21.846504 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2346276d99d41928857c60db9e25119)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:54:21.848368 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:54:21.894746 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2346276d99d41928857c60db9e25119', 'request_id': 'req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.902938 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2346276d99d41928857c60db9e25119', 'request_id': 'req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.909373 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2346276d99d41928857c60db9e25119', 'request_id': 'req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.924435 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2 admin admin] The token cache is being invalidate because project f2346276d99d41928857c60db9e25119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 20:54:21.924747 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.925417 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b2c974ed-a6e9-4f1c-9fdd-edc3245d89c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 20:54:21.928134 dv-cinder-848900-2-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1447/2913] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jul 6 20:54:21 2022] DELETE /identity/v3/projects/f2346276d99d41928857c60db9e25119 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 20:54:31.576756 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=19,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:54:31.918773 dv-cinder-848900-2-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 20:55:43.713362 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 20:55:43.715022 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:55:43.806186 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007af908-81c2-4b6f-8502-d501e07e071a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 20:55:43.865717 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd23dd-7ffb-49b3-961e-51e1362d9867 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98059ebef5d470db684fb78d19a8839', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eda6c9cf4b1439eb280b0db35b3bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 20:55:43.866371 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd23dd-7ffb-49b3-961e-51e1362d9867 service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 20:55:43.866658 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd23dd-7ffb-49b3-961e-51e1362d9867 service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 20:55:43.866935 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd23dd-7ffb-49b3-961e-51e1362d9867 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 20:55:43.868725 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6acd23dd-7ffb-49b3-961e-51e1362d9867 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 20:55:43.880458 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd23dd-7ffb-49b3-961e-51e1362d9867 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 20:55:43.882031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd23dd-7ffb-49b3-961e-51e1362d9867 service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 20:55:43.892714 dv-cinder-848900-2-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1467/2914] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jul 6 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 20:55:53.888031 dv-cinder-848900-2-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=67 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}